-- Logs begin at Wed 2022-02-09 04:01:09 UTC, end at Wed 2022-02-09 05:05:58 UTC. -- Feb 09 04:26:44.150964 dv-cinder-798783-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 09 04:26:44.160021 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 09 04:26:44.162089 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Feb 9 04:26:44 2022] *** Feb 09 04:26:44.162089 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 09 04:26:44.162089 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 09 04:26:44.162089 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: nodename: dv-cinder-798783-3-iscsi Feb 09 04:26:44.162089 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: machine: x86_64 Feb 09 04:26:44.162089 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: clock source: unix Feb 09 04:26:44.162089 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: pcre jit disabled Feb 09 04:26:44.162089 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: detected number of CPU cores: 4 Feb 09 04:26:44.162089 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: current working directory: / Feb 09 04:26:44.162089 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: detected binary path: /usr/bin/uwsgi-core Feb 09 04:26:44.162089 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: your processes number limit is 47680 Feb 09 04:26:44.162089 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: your memory page size is 4096 bytes Feb 09 04:26:44.162089 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: detected max file descriptor number: 2048 Feb 09 04:26:44.162089 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: lock engine: pthread robust mutexes Feb 09 04:26:44.163271 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: thunder lock: enabled Feb 09 04:26:44.163271 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 09 04:26:44.163271 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 09 04:26:44.208649 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: Python main interpreter initialized at 0x5654c2e689c0 Feb 09 04:26:44.208649 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: python threads support enabled Feb 09 04:26:44.208649 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: your server socket listen backlog is limited to 100 connections Feb 09 04:26:44.208649 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: your mercy for graceful operations on workers is 90 seconds Feb 09 04:26:44.209033 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: mapped 403077 bytes (393 KB) for 2 cores Feb 09 04:26:44.209105 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: *** Operational MODE: preforking *** Feb 09 04:26:44.209381 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: *** uWSGI is running in multiple interpreter mode *** Feb 09 04:26:44.209381 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: spawned uWSGI master process (pid: 79163) Feb 09 04:26:44.209590 dv-cinder-798783-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 09 04:26:44.210417 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: spawned uWSGI worker 1 (pid: 79176, cores: 1) Feb 09 04:26:44.210553 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: spawned uWSGI worker 2 (pid: 79177, cores: 1) Feb 09 04:26:44.214141 dv-cinder-798783-3-iscsi devstack@keystone.service[79163]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 09 04:26:49.949342 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 09 04:26:49.949342 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: from cryptography.utils import int_from_bytes Feb 09 04:26:49.950070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 09 04:26:49.950070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: from cryptography.utils import int_from_bytes Feb 09 04:26:49.950744 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 09 04:26:49.950744 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: from cryptography.utils import int_from_bytes Feb 09 04:26:49.951205 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 09 04:26:49.951205 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: from cryptography.utils import int_from_bytes Feb 09 04:26:49.996162 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 09 04:26:49.996360 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 09 04:26:49.996553 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] command line args: [] {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 09 04:26:49.996824 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 09 04:26:49.996996 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 09 04:26:49.997105 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ================================================================================ {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 09 04:26:49.997224 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 09 04:26:49.997309 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] admin_token = **** {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:49.997415 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] command line args: [] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 09 04:26:49.997548 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] config_dir = [] {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:49.997692 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 09 04:26:49.997778 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:49.997870 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] config_source = [] {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:49.997943 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ================================================================================ {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 09 04:26:49.998049 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] debug = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:49.998137 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] admin_token = **** {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:49.998247 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:49.998498 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] config_dir = [] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:49.998566 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:49.998628 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:49.998694 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] config_source = [] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:49.998833 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:49.998914 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] debug = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:49.999043 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:49.999119 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:49.999308 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:49.999391 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:49.999492 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:49.999588 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] list_limit = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:49.999715 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] log_config_append = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:49.999835 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:49.999931 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.000031 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.000130 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] log_dir = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.000230 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] list_limit = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.000323 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] log_file = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.000426 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] log_config_append = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.000526 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.000609 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.000730 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.000809 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] log_dir = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.000921 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] log_file = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.001020 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.001137 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.001221 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.001344 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.001424 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.001544 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.001627 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.001757 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.001845 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.001988 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.002126 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.002206 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.002330 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.002411 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.002487 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.002633 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.002719 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.002869 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.002946 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.003119 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.003195 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.003355 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.003431 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.003592 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.003714 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.003840 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.004085 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.004166 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.004289 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] publish_errors = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.004362 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.004481 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.004700 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.004838 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.004926 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.005039 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] publish_errors = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.005140 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.005279 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.005369 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.005510 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.005658 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] standard_threads = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.005733 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.005824 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.005908 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.006068 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.006149 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.006246 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.006368 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] standard_threads = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.006443 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] use_journal = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.006585 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] use_json = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.006666 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.006759 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] use_stderr = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.006839 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.006958 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] use_syslog = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.007037 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.007148 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.007231 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] use_journal = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.007331 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] use_json = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.007407 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.007506 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] use_stderr = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.007621 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.007707 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] use_syslog = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.007879 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.007960 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 09 04:26:50.008116 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.008191 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.008365 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.008456 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.008602 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.008677 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.008847 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.008928 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.009103 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.009264 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.009344 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.009413 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.009587 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.009663 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.009824 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.009907 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.010057 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.010132 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.010302 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.010379 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.010537 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.010614 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.010769 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.010843 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.011016 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.011100 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.011248 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.011325 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.011494 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.011577 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.011742 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.011817 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.011978 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.012055 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.012209 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.012290 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.012462 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.012538 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.012703 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.012778 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.012938 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.013028 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.013221 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.013296 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.013453 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.013531 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.013683 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.013758 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.013914 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.013990 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.014149 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.014225 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.014391 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.014471 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.014623 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.014699 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.014846 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.015419 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.015600 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.015676 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.015848 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.015929 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.016082 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.016158 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.016313 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.016388 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.016560 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.016633 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.016794 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.016870 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.017047 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.017126 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.017286 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.017372 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.017518 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.017594 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.017748 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.017825 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.017978 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.018064 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.018207 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.018283 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.018439 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.018523 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.018671 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.018754 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.018901 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.018976 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.019135 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.019210 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.019366 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.019483 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.019600 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.019700 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.019831 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.019931 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.020066 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.020180 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.020298 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.020428 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.020515 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.020629 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.020759 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.020842 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.020989 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.021102 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.021249 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.021367 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.021485 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.021573 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.021714 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.021795 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.021948 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.022026 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.022183 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.022269 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.022410 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.022486 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.022637 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.022760 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.022883 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.022959 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.023116 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.023203 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.023344 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.023421 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.023577 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.023655 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.023812 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.023896 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.024053 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.024135 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.024293 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.024372 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.024529 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.024615 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.024769 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.024850 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.025032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.025122 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.025259 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.025347 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.025496 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.025572 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.025733 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.025809 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.025969 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.026056 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.026203 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.026278 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.026446 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.026533 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.026683 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.026833 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.026906 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.026974 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.027138 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.027213 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.027373 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.027460 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.027607 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.027683 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.027842 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.027918 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.028079 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.028156 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.028316 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.028391 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.028554 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.028631 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.028795 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.028878 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.029052 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.029132 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.029290 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.029366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.029525 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.029612 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.029755 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.029832 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.029986 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.030062 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.030215 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.030282 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.030444 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.030520 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.031233 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.031320 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.031468 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.031545 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.031706 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.031784 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.031939 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.032016 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.032176 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.032258 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.032412 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.032488 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.032662 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.032744 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.032901 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.032978 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.033157 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] auth.external = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.033234 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.033388 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.033470 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.033670 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.033745 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.033904 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] auth.external = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.033981 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.034130 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] auth.password = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.034215 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.034359 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] auth.token = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.034435 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.034595 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.034672 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.034830 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.034908 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] auth.password = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.035078 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.035156 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] auth.token = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.035308 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.035385 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.035542 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.035620 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.035790 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.035867 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.036019 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.036102 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.036250 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] credential.caching = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.036325 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.036495 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.036573 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.036725 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.036810 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.036961 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] credential.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.037098 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.037222 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.037299 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.037464 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.037549 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.037697 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.037774 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.038188 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.038265 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.038433 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.038521 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.038668 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.038744 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.038914 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.038990 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.039174 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.039261 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.039412 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.039536 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.039663 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.039747 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.039901 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.039985 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.040155 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.040233 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.040390 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] federation.caching = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.040467 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.040626 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.040711 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.040871 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.040948 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.041140 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.041220 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] federation.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.041371 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.041532 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.041607 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.041676 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.041843 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.041925 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.042072 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.042162 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.042316 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.042399 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.042551 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.042627 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.042791 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.042874 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.043029 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.043105 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.043265 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] identity.caching = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.043391 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.043512 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.043611 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.043756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.043832 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.043989 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.044065 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.044221 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.044305 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.044468 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.044545 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.044702 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.044778 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.044938 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.045041 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.045213 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.045291 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.045458 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.045535 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.045687 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.045775 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.045923 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.046001 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.046182 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.046302 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.046425 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.046510 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.046659 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.046737 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.046893 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.046970 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.047137 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.047217 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.047387 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.047463 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.047657 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.047734 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.047894 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.047993 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.048131 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.048281 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.048358 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.048554 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.048639 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.048795 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.048872 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.049050 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.049141 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.049281 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.049370 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.049517 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.049593 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.049747 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.049823 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.049983 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.050067 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.050223 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.050299 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.050465 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.050542 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.050698 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.050781 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.050935 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.051011 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.051178 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.051254 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.051409 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.051494 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.051648 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.051725 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.051876 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.051953 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.052113 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.052188 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.052347 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.052414 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.052586 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.052662 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.052814 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.052898 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.053075 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.053154 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.053331 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.053410 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.053559 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.053647 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.053786 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.053862 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.054016 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.054092 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.054263 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.054347 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.054507 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.054584 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.054737 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.054812 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.054967 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.055051 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.055197 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.055273 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.055426 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.user = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.055503 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.055662 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.055747 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.055896 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.055972 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.056132 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.056208 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.056363 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.056448 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.056615 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.056702 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.056843 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.056918 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.057103 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.057231 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.057340 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.057429 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.057574 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.057651 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.057806 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.057892 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.058041 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.058118 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.058292 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.058367 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.058528 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.058606 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.058763 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.058840 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.059039 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.059115 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.059314 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.059393 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.059564 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.059665 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.059813 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.059931 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.060060 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.060215 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.060311 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.060489 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.060566 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.060764 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.060849 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.061021 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.061100 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.061275 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.061351 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.061514 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.061603 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.061754 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.061912 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.062015 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.062191 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.062312 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.062507 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.062584 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.062747 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.062824 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.063003 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.063080 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.063234 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.063313 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.063479 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.063556 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.063717 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.063794 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.063955 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.064133 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.064210 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.064428 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.064504 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.064671 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.064824 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.064899 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.065046 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.065150 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.065296 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] resource.caching = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.065387 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] resource.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.065552 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.065645 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.065809 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.065899 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.066047 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.066138 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.066298 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.066389 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.066547 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.066638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.066780 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.066869 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.067026 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.067114 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.067264 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.067354 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.067501 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.067589 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.067733 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] role.caching = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.067821 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] role.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.067979 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] role.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.068068 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] role.driver = sql {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.068206 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.068294 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.068452 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.068541 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.068696 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.068784 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.068941 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.069045 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.069212 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.069302 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.069458 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.069546 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.069701 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.069790 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.069945 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.070034 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.070192 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.070280 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.070422 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.070510 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.070668 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.070756 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.070914 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.071001 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.071158 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.071254 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.071401 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.071490 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.071789 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.071877 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.072026 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.072123 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.072287 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.072375 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.072536 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.072624 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.072787 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.072892 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.073053 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.073142 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.073292 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.073369 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.073545 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.073635 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.073798 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.073874 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.074035 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.074110 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.074266 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.074349 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.074493 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.074569 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.074724 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.074800 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.074972 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.075056 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.075226 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.075303 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.075470 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.075546 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.075704 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.075788 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.075940 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.076017 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.076167 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.076242 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.076402 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] token.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.076490 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] token.caching = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.076634 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.076754 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.076880 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.076956 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.077136 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.077226 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.077395 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.077974 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.078149 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.078225 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.078381 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.078465 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.078625 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.078703 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.078866 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.078942 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.079111 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.079188 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.079346 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.079422 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.079579 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.079655 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.079813 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.079891 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.080055 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.080131 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.080301 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.080377 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.080527 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.080604 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.080768 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.080845 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.081080 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.081161 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.081341 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] database.connection = **** {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.081427 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.connection = **** {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.081585 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.081674 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.081829 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.081906 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.082065 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.082140 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.082301 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.082385 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.082534 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.082610 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.082766 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.082842 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.083000 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.083084 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.083233 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.083326 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.083474 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.083549 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.083705 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.083788 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.083946 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.084022 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.084177 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.084253 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.084426 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.084581 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.084656 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.084725 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.084890 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.084968 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.085419 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.085511 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.085511 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.085633 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.085703 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.085773 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 09 04:26:50.085843 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79177) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 09 04:26:50.085921 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79176) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 09 04:26:50.117259 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.117405 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.117499 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.117580 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.117736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.117819 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.126779 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.126874 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.155407 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.155677 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.155793 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.156028 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.208515 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.208883 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.259010 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.259242 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.259683 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.259923 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.324676 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.324801 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.324909 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.325079 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.325212 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.325295 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.325358 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.325486 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.325569 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.325704 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.325787 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.325917 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.350698 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.350948 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.351160 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.351244 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.351385 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.351468 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.351605 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.351693 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.351823 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.351904 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.352038 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.352127 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.352253 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.352467 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.363405 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.363581 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.376597 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.376702 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.376828 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.376910 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.377067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.377151 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.377289 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.377372 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.377510 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.377590 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.377719 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.377808 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.377932 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79176) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.378013 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79177) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 09 04:26:50.395658 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.395871 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 09 04:26:50.396031 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.396210 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.396292 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 09 04:26:50.396414 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 09 04:26:50.396556 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.396688 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.396778 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 09 04:26:50.396955 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.397065 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.397239 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.397319 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.397498 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.397580 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.397772 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.408350 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.408585 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.408667 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.408861 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.408943 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.409153 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.409237 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.409434 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.417411 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.417705 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.420628 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.420907 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.420999 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.421233 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.421317 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.421514 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.421596 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.421793 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.421910 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.422074 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.422179 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.422332 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.422455 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.422708 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.422797 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.422981 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.423062 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.423252 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.423332 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.423521 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.423602 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.423787 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.450192 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.450694 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.451806 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.452088 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.452992 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.453305 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.457871 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.458148 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.458428 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.458555 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.458761 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.459039 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.465680 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.465965 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.466264 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.466544 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.470621 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.470909 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.471018 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.471193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.471424 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.471506 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.471708 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.471789 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.471996 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.472079 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.472281 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.472362 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.472549 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.472636 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.472816 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.473106 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.491574 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.491851 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.491935 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.492178 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.496374 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.496941 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.500493 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.500798 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.501075 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.501371 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.505764 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.506304 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.509331 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.509836 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.513056 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.513369 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.513541 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.513656 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.513842 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.513952 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.514129 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.514232 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.514411 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.514521 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.514688 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.515007 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.533255 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.533543 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.533636 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.533907 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.533988 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.534170 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.534357 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.534494 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.542154 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.543089 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.543853 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.544127 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.544779 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.545072 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.547911 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.548204 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.548464 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.548603 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.548740 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.548870 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.549037 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.549169 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.549415 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.549713 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.562743 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.563023 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.563307 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.563455 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.563587 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.563710 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.563865 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.563990 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.564146 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.564272 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.564430 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.564554 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.564702 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.564976 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.582113 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.582701 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.585346 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.585917 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.588571 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.589168 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.590182 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.590745 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.591773 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.592053 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.592334 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.592417 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.592611 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.592900 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.600891 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.601433 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.602507 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.603026 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.605675 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.605966 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.606184 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.606277 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.606473 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.606554 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.606755 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.607031 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.616487 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.616782 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.714727 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.714952 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.715237 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.716658 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.723050 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79177) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.723327 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.723603 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.723876 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.724158 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.724439 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.724684 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79176) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 09 04:26:50.724768 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.724966 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.725077 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.725260 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.725358 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.725531 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.725621 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.725797 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.725888 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.726074 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.726156 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.726340 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.726420 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.726611 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.726772 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79177) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.726877 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.727152 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.727420 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.727701 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.727963 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.728360 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79176) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 09 04:26:50.764734 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5654c2e689c0 pid: 79177 (default app) Feb 09 04:26:50.766499 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5654c2e689c0 pid: 79176 (default app) Feb 09 04:26:50.768145 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837f29a-e8fa-4460-8ead-c144e2e5553e None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:26:50.768441 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837f29a-e8fa-4460-8ead-c144e2e5553e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:26:50.768723 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837f29a-e8fa-4460-8ead-c144e2e5553e None None] PATH_INFO: `/v3` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:26:50.772912 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Wed Feb 9 04:26:50 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:26:59.007549 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9afe7-3b78-4f08-80d6-1f689d6ce408 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:26:59.008091 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9afe7-3b78-4f08-80d6-1f689d6ce408 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:26:59.008091 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9afe7-3b78-4f08-80d6-1f689d6ce408 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:26:59.013160 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:26:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:26:59.018825 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf6cae-bab8-43df-ab93-e1f298cff4c6 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:26:59.019298 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf6cae-bab8-43df-ab93-e1f298cff4c6 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:26:59.019387 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf6cae-bab8-43df-ab93-e1f298cff4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:26:59.049614 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG oslo_db.sqlalchemy.engines [None req-c7cf6cae-bab8-43df-ab93-e1f298cff4c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79177) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 09 04:26:59.231017 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG passlib.handlers.bcrypt [None req-c7cf6cae-bab8-43df-ab93-e1f298cff4c6 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79177) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 09 04:26:59.231437 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG passlib.handlers.bcrypt [None req-c7cf6cae-bab8-43df-ab93-e1f298cff4c6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79177) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 09 04:26:59.286283 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-c7cf6cae-bab8-43df-ab93-e1f298cff4c6 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:26:59.287812 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c7cf6cae-bab8-43df-ab93-e1f298cff4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:26:59.408362 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:26:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:26:59.544482 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9afe7-3b78-4f08-80d6-1f689d6ce408 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:26:59.578183 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG oslo_db.sqlalchemy.engines [None req-fed9afe7-3b78-4f08-80d6-1f689d6ce408 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79176) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 09 04:26:59.702622 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9afe7-3b78-4f08-80d6-1f689d6ce408 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:26:59.711291 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf42e0-6e13-482c-a005-3ba894459ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:26:59.711954 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf42e0-6e13-482c-a005-3ba894459ffe admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:26:59.712239 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf42e0-6e13-482c-a005-3ba894459ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:26:59.712519 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf42e0-6e13-482c-a005-3ba894459ffe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:26:59.726449 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf42e0-6e13-482c-a005-3ba894459ffe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:26:59.783697 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.common.rbac_enforcer.enforcer [None req-90cf42e0-6e13-482c-a005-3ba894459ffe admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 09 04:26:59.784036 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf42e0-6e13-482c-a005-3ba894459ffe admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:26:59.793911 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:26:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:26:59.800573 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf6cae-bab8-43df-ab93-e1f298cff4c6 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:26:59.815114 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf6cae-bab8-43df-ab93-e1f298cff4c6 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:26:59.819638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21635ab4-8c1e-41c9-84ad-3fa5d7b28705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:26:59.820725 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21635ab4-8c1e-41c9-84ad-3fa5d7b28705 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:26:59.821021 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21635ab4-8c1e-41c9-84ad-3fa5d7b28705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:26:59.821326 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21635ab4-8c1e-41c9-84ad-3fa5d7b28705 admin admin] PATH_INFO: `/v3/projects/583a6798f0f24da3a88ba3f8de9474df` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:26:59.822863 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21635ab4-8c1e-41c9-84ad-3fa5d7b28705 admin admin] RBAC: Authorizing `identity:get_project(project_id=583a6798f0f24da3a88ba3f8de9474df)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:26:59.873305 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.common.rbac_enforcer.enforcer [None req-21635ab4-8c1e-41c9-84ad-3fa5d7b28705 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 09 04:26:59.873657 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21635ab4-8c1e-41c9-84ad-3fa5d7b28705 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:26:59.878924 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:26:59 2022] GET /identity/v3/projects/583a6798f0f24da3a88ba3f8de9474df => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:02.062057 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782547e4-6de8-4e47-a195-ce873fedcbbd None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:02.062596 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782547e4-6de8-4e47-a195-ce873fedcbbd None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:02.062596 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782547e4-6de8-4e47-a195-ce873fedcbbd None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:02.067167 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:02.072724 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49cf75-67c9-4a6d-b119-8fa4050d8593 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:02.073216 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49cf75-67c9-4a6d-b119-8fa4050d8593 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:02.073300 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49cf75-67c9-4a6d-b119-8fa4050d8593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:02.092277 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-5d49cf75-67c9-4a6d-b119-8fa4050d8593 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:02.094442 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5d49cf75-67c9-4a6d-b119-8fa4050d8593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:02.102265 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:02.124183 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782547e4-6de8-4e47-a195-ce873fedcbbd None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:02.136593 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782547e4-6de8-4e47-a195-ce873fedcbbd None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:02.141458 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f379d-09e9-448e-83ee-7bae349f591c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:02.142073 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f379d-09e9-448e-83ee-7bae349f591c admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:02.142356 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f379d-09e9-448e-83ee-7bae349f591c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:02.142637 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f379d-09e9-448e-83ee-7bae349f591c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:02.150438 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f379d-09e9-448e-83ee-7bae349f591c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:02.152224 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f379d-09e9-448e-83ee-7bae349f591c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:02.160798 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:02.166013 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49cf75-67c9-4a6d-b119-8fa4050d8593 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:02.174685 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49cf75-67c9-4a6d-b119-8fa4050d8593 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:02.179065 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc1d64-b51d-4281-b290-64eb956d9238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:02.179904 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc1d64-b51d-4281-b290-64eb956d9238 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:02.180187 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc1d64-b51d-4281-b290-64eb956d9238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:02.180461 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc1d64-b51d-4281-b290-64eb956d9238 admin admin] PATH_INFO: `/v3/users/149f2cba29a24507ab7090c3c8fa1691` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:02.181882 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc1d64-b51d-4281-b290-64eb956d9238 admin admin] RBAC: Authorizing `identity:get_user(user_id=149f2cba29a24507ab7090c3c8fa1691)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:02.183724 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc1d64-b51d-4281-b290-64eb956d9238 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:02.185373 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:02 2022] GET /identity/v3/users/149f2cba29a24507ab7090c3c8fa1691 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:04.443087 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0340aa-4232-4844-8edf-0b20020dbb11 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:04.443632 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0340aa-4232-4844-8edf-0b20020dbb11 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:04.443632 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0340aa-4232-4844-8edf-0b20020dbb11 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:04.445424 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:27:04.450776 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75a416-03a8-492e-9bfd-17288e95b868 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:04.451180 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75a416-03a8-492e-9bfd-17288e95b868 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:04.451456 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75a416-03a8-492e-9bfd-17288e95b868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:04.469358 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ad75a416-03a8-492e-9bfd-17288e95b868 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:04.470527 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ad75a416-03a8-492e-9bfd-17288e95b868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:04.477987 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 6/11] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:04.489675 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced5477-0665-4c2b-a48b-9330ce254d6c None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:04.490038 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced5477-0665-4c2b-a48b-9330ce254d6c None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:04.490386 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced5477-0665-4c2b-a48b-9330ce254d6c None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:04.492673 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 6/12] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:04.498387 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fc41f-4a44-4d38-b3f8-835ca0ee0867 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:04.498673 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fc41f-4a44-4d38-b3f8-835ca0ee0867 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:04.498952 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fc41f-4a44-4d38-b3f8-835ca0ee0867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:04.502520 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced5477-0665-4c2b-a48b-9330ce254d6c None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:04.514486 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced5477-0665-4c2b-a48b-9330ce254d6c None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:04.519199 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec63ec-95c6-4646-85e5-1d3f8fd77ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:04.519970 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec63ec-95c6-4646-85e5-1d3f8fd77ada admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:04.520251 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec63ec-95c6-4646-85e5-1d3f8fd77ada admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:04.520521 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec63ec-95c6-4646-85e5-1d3f8fd77ada admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:04.527280 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-983fc41f-4a44-4d38-b3f8-835ca0ee0867 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:04.528503 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-983fc41f-4a44-4d38-b3f8-835ca0ee0867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:04.536045 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec63ec-95c6-4646-85e5-1d3f8fd77ada admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:04.536151 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:04.543388 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-25ec63ec-95c6-4646-85e5-1d3f8fd77ada admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:27:04.544829 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 7/14] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:27:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:27:04.550488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fc41f-4a44-4d38-b3f8-835ca0ee0867 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:04.558480 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec63ec-95c6-4646-85e5-1d3f8fd77ada admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:04.559916 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fc41f-4a44-4d38-b3f8-835ca0ee0867 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:04.564728 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1f510-f5ca-451c-b9d8-54e933baa0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:04.565411 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1f510-f5ca-451c-b9d8-54e933baa0ec admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:04.565694 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1f510-f5ca-451c-b9d8-54e933baa0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:04.565967 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1f510-f5ca-451c-b9d8-54e933baa0ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:04.566724 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1f510-f5ca-451c-b9d8-54e933baa0ec admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:04.567088 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1f510-f5ca-451c-b9d8-54e933baa0ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:04.568853 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-29b1f510-f5ca-451c-b9d8-54e933baa0ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:27:04.568853 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 09 04:27:04.568853 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: Feb 09 04:27:04.569083 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec63ec-95c6-4646-85e5-1d3f8fd77ada admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:04.571950 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1f510-f5ca-451c-b9d8-54e933baa0ec admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:04.573298 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4739f0-d515-47a7-b574-11dc83b953da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:04.573934 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4739f0-d515-47a7-b574-11dc83b953da admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:04.574221 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4739f0-d515-47a7-b574-11dc83b953da admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:04.574499 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4739f0-d515-47a7-b574-11dc83b953da admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:04.583072 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4739f0-d515-47a7-b574-11dc83b953da admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:04.584854 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4739f0-d515-47a7-b574-11dc83b953da admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:04.585454 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 8/15] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:04.590853 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1f510-f5ca-451c-b9d8-54e933baa0ec admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:04.593751 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 09 04:27:04.598908 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4739f0-d515-47a7-b574-11dc83b953da admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:04.600555 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1f510-f5ca-451c-b9d8-54e933baa0ec admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:04.604822 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc429c6-fb44-4420-8a83-1a4618124e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:04.605677 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc429c6-fb44-4420-8a83-1a4618124e38 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:04.605956 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc429c6-fb44-4420-8a83-1a4618124e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:04.606510 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc429c6-fb44-4420-8a83-1a4618124e38 admin admin] PATH_INFO: `/v3/users/149f2cba29a24507ab7090c3c8fa1691` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:04.607119 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4739f0-d515-47a7-b574-11dc83b953da admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:04.607718 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc429c6-fb44-4420-8a83-1a4618124e38 admin admin] RBAC: Authorizing `identity:get_user(user_id=149f2cba29a24507ab7090c3c8fa1691)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:04.609597 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc429c6-fb44-4420-8a83-1a4618124e38 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:04.611115 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 9/17] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:04 2022] GET /identity/v3/users/149f2cba29a24507ab7090c3c8fa1691 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:04.611459 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81936e1-5fb5-4bb3-8294-2aabc5fb58f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:04.612200 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81936e1-5fb5-4bb3-8294-2aabc5fb58f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:04.612483 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81936e1-5fb5-4bb3-8294-2aabc5fb58f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:04.612757 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81936e1-5fb5-4bb3-8294-2aabc5fb58f9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:04.614271 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81936e1-5fb5-4bb3-8294-2aabc5fb58f9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:04.616012 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc429c6-fb44-4420-8a83-1a4618124e38 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:04.616189 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81936e1-5fb5-4bb3-8294-2aabc5fb58f9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:04.617743 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 9/18] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:27:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:04.626237 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc429c6-fb44-4420-8a83-1a4618124e38 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:04.630890 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bd8c6-4bd3-431a-bf99-586337738ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:04.631710 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bd8c6-4bd3-431a-bf99-586337738ebb admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:04.631995 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bd8c6-4bd3-431a-bf99-586337738ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:04.632273 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bd8c6-4bd3-431a-bf99-586337738ebb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:04.633575 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bd8c6-4bd3-431a-bf99-586337738ebb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:04.635386 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bd8c6-4bd3-431a-bf99-586337738ebb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:04.637122 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 10/19] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:27:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:04.643674 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81936e1-5fb5-4bb3-8294-2aabc5fb58f9 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:04.653691 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81936e1-5fb5-4bb3-8294-2aabc5fb58f9 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:04.658242 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67dd654-4962-4367-a96e-ee7b19c71dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:04.658915 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dd654-4962-4367-a96e-ee7b19c71dfc admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:04.659195 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dd654-4962-4367-a96e-ee7b19c71dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:04.659470 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67dd654-4962-4367-a96e-ee7b19c71dfc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:04.660324 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67dd654-4962-4367-a96e-ee7b19c71dfc admin admin] RBAC: Adding query filter params (role.id=05ca9a16ef2a450b8cc73ade47f5c7d0, scope.domain.id=default, user.id=149f2cba29a24507ab7090c3c8fa1691) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:04.660633 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67dd654-4962-4367-a96e-ee7b19c71dfc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:04.662478 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING py.warnings [None req-b67dd654-4962-4367-a96e-ee7b19c71dfc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:27:04.662478 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: warnings.warn(msg) Feb 09 04:27:04.662478 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: Feb 09 04:27:04.663923 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67dd654-4962-4367-a96e-ee7b19c71dfc admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:04.673888 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 10/20] 10.222.0.36 () {56 vars in 1343 bytes} [Wed Feb 9 04:27:04 2022] GET /identity/v3/role_assignments?user.id=149f2cba29a24507ab7090c3c8fa1691&scope.domain.id=default&role.id=05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 233 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:07.140911 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0019d61-e38e-4a6b-bf20-f31bcaff8f32 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:07.142224 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0019d61-e38e-4a6b-bf20-f31bcaff8f32 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:07.142881 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0019d61-e38e-4a6b-bf20-f31bcaff8f32 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:07.147038 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 11/21] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:07.152421 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06e689-c042-40d8-a922-899d0049c59b None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:07.153415 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06e689-c042-40d8-a922-899d0049c59b None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:07.154053 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06e689-c042-40d8-a922-899d0049c59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:07.217761 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG passlib.handlers.bcrypt [None req-4a06e689-c042-40d8-a922-899d0049c59b None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79176) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 09 04:27:07.219097 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG passlib.handlers.bcrypt [None req-4a06e689-c042-40d8-a922-899d0049c59b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79176) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 09 04:27:07.278104 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-4a06e689-c042-40d8-a922-899d0049c59b None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:07.280096 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-4a06e689-c042-40d8-a922-899d0049c59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:07.308780 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 11/22] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:07.354492 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0019d61-e38e-4a6b-bf20-f31bcaff8f32 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:07.371616 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0019d61-e38e-4a6b-bf20-f31bcaff8f32 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:07.377659 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a331174-e688-4168-9206-528db5c15308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:07.378463 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a331174-e688-4168-9206-528db5c15308 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:07.378746 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a331174-e688-4168-9206-528db5c15308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:07.379023 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a331174-e688-4168-9206-528db5c15308 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:07.391999 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a331174-e688-4168-9206-528db5c15308 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:07.398835 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-9a331174-e688-4168-9206-528db5c15308 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:27:07.400419 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 12/23] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:27:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:07.406271 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06e689-c042-40d8-a922-899d0049c59b None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:07.416339 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06e689-c042-40d8-a922-899d0049c59b None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:07.425594 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b887d-999a-48d4-9855-7999d8383a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:07.426993 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b887d-999a-48d4-9855-7999d8383a16 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:07.427487 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b887d-999a-48d4-9855-7999d8383a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:07.427963 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b887d-999a-48d4-9855-7999d8383a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:07.429170 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b887d-999a-48d4-9855-7999d8383a16 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:07.429699 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b887d-999a-48d4-9855-7999d8383a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:07.430968 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING py.warnings [None req-a62b887d-999a-48d4-9855-7999d8383a16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:27:07.430968 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: warnings.warn(msg) Feb 09 04:27:07.430968 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: Feb 09 04:27:07.432245 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62b887d-999a-48d4-9855-7999d8383a16 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:07.449722 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ec030-7c08-4798-b5e3-d09bed085434 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:07.450066 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ec030-7c08-4798-b5e3-d09bed085434 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:07.450286 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ec030-7c08-4798-b5e3-d09bed085434 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:07.452177 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:07.462833 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeecba-0012-4ba8-8bd0-6daa3ce654ef None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:07.463190 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeecba-0012-4ba8-8bd0-6daa3ce654ef None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:07.463433 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eeecba-0012-4ba8-8bd0-6daa3ce654ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:07.465212 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 12/25] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:07.470830 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b887d-999a-48d4-9855-7999d8383a16 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:07.480685 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b887d-999a-48d4-9855-7999d8383a16 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:07.492960 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-36eeecba-0012-4ba8-8bd0-6daa3ce654ef None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:07.502097 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-36eeecba-0012-4ba8-8bd0-6daa3ce654ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:07.502967 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693c28a-028c-4cea-a66a-b9e06c907428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:07.503861 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693c28a-028c-4cea-a66a-b9e06c907428 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:07.504146 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693c28a-028c-4cea-a66a-b9e06c907428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:07.504419 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693c28a-028c-4cea-a66a-b9e06c907428 admin admin] PATH_INFO: `/v3/users/149f2cba29a24507ab7090c3c8fa1691` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:07.510313 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693c28a-028c-4cea-a66a-b9e06c907428 admin admin] RBAC: Authorizing `identity:get_user(user_id=149f2cba29a24507ab7090c3c8fa1691)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:07.512424 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693c28a-028c-4cea-a66a-b9e06c907428 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:07.514522 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 13/26] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:07 2022] GET /identity/v3/users/149f2cba29a24507ab7090c3c8fa1691 => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:07.516384 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 14/27] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 09 04:27:07.520862 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693c28a-028c-4cea-a66a-b9e06c907428 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:07.534751 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693c28a-028c-4cea-a66a-b9e06c907428 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:07.555451 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660629fc-758e-4fb1-acf3-ea80f0f6c138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:07.556374 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660629fc-758e-4fb1-acf3-ea80f0f6c138 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:07.556657 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660629fc-758e-4fb1-acf3-ea80f0f6c138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:07.556934 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660629fc-758e-4fb1-acf3-ea80f0f6c138 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:07.557479 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeecba-0012-4ba8-8bd0-6daa3ce654ef None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:07.562347 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660629fc-758e-4fb1-acf3-ea80f0f6c138 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:07.564122 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660629fc-758e-4fb1-acf3-ea80f0f6c138 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:07.565893 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 14/28] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:27:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:07.572112 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eeecba-0012-4ba8-8bd0-6daa3ce654ef None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:07.576881 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660629fc-758e-4fb1-acf3-ea80f0f6c138 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:07.586365 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20557b55-d0b1-4933-bb1b-d9523ac883ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:07.587178 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20557b55-d0b1-4933-bb1b-d9523ac883ae admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:07.587458 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20557b55-d0b1-4933-bb1b-d9523ac883ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:07.587729 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20557b55-d0b1-4933-bb1b-d9523ac883ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:07.590960 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660629fc-758e-4fb1-acf3-ea80f0f6c138 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:07.606245 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea081261-b0aa-426c-bb45-2641c84413db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:07.607139 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea081261-b0aa-426c-bb45-2641c84413db admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:07.607421 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea081261-b0aa-426c-bb45-2641c84413db admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:07.607707 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea081261-b0aa-426c-bb45-2641c84413db admin admin] PATH_INFO: `/v3/domains/default/users/149f2cba29a24507ab7090c3c8fa1691/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:07.613932 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20557b55-d0b1-4933-bb1b-d9523ac883ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:07.614597 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea081261-b0aa-426c-bb45-2641c84413db admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=149f2cba29a24507ab7090c3c8fa1691, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:07.615630 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING py.warnings [None req-ea081261-b0aa-426c-bb45-2641c84413db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:27:07.615630 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: warnings.warn(msg) Feb 09 04:27:07.615630 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: Feb 09 04:27:07.616065 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20557b55-d0b1-4933-bb1b-d9523ac883ae admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:07.617644 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea081261-b0aa-426c-bb45-2641c84413db admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:07.654083 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-20557b55-d0b1-4933-bb1b-d9523ac883ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:27:07.659989 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 15/29] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:07.661029 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20557b55-d0b1-4933-bb1b-d9523ac883ae admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:07.675752 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20557b55-d0b1-4933-bb1b-d9523ac883ae admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:07.762241 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addde0e6-795a-403f-9732-5572bd8a34dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:07.762910 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addde0e6-795a-403f-9732-5572bd8a34dd admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:07.763191 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addde0e6-795a-403f-9732-5572bd8a34dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:07.763464 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addde0e6-795a-403f-9732-5572bd8a34dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:07.764211 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addde0e6-795a-403f-9732-5572bd8a34dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:07.764567 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addde0e6-795a-403f-9732-5572bd8a34dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:07.765649 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-addde0e6-795a-403f-9732-5572bd8a34dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:27:07.765649 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 09 04:27:07.765649 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: Feb 09 04:27:07.766558 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addde0e6-795a-403f-9732-5572bd8a34dd admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:07.767945 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 15/30] 10.222.0.36 () {58 vars in 1382 bytes} [Wed Feb 9 04:27:07 2022] PUT /identity/v3/domains/default/users/149f2cba29a24507ab7090c3c8fa1691/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:27:07.799021 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 16/31] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:07.805268 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea081261-b0aa-426c-bb45-2641c84413db admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:07.820649 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea081261-b0aa-426c-bb45-2641c84413db admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:07.832252 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b80bc-9b26-41f0-95cb-110fe6e50768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:07.833386 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b80bc-9b26-41f0-95cb-110fe6e50768 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:07.833886 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b80bc-9b26-41f0-95cb-110fe6e50768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:07.834575 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b80bc-9b26-41f0-95cb-110fe6e50768 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:07.835564 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b80bc-9b26-41f0-95cb-110fe6e50768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:07.837127 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING py.warnings [None req-0f0b80bc-9b26-41f0-95cb-110fe6e50768 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:27:07.837127 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: warnings.warn(msg) Feb 09 04:27:07.837127 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: Feb 09 04:27:07.838761 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b80bc-9b26-41f0-95cb-110fe6e50768 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:07.846982 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258371d-54d4-4259-bd33-8bd1cd480352 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:07.847313 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258371d-54d4-4259-bd33-8bd1cd480352 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:07.847548 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f258371d-54d4-4259-bd33-8bd1cd480352 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:07.849386 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 17/32] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:27:07.861298 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af942610-a2d0-4bfc-84a7-74db0a3f1749 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:07.861585 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af942610-a2d0-4bfc-84a7-74db0a3f1749 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:07.862020 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af942610-a2d0-4bfc-84a7-74db0a3f1749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:07.890447 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 16/33] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Feb 9 04:27:07 2022] POST /identity/v3/projects => generated 301 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:27:07.900054 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-af942610-a2d0-4bfc-84a7-74db0a3f1749 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:07.900786 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-af942610-a2d0-4bfc-84a7-74db0a3f1749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:07.982795 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 18/34] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:08.026297 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2591e8-1e26-40b0-bb27-f13a47fd3009 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:08.026634 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af942610-a2d0-4bfc-84a7-74db0a3f1749 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:08.027123 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2591e8-1e26-40b0-bb27-f13a47fd3009 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:08.027594 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2591e8-1e26-40b0-bb27-f13a47fd3009 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:08.030060 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 17/35] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:08.037283 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502f2c0-87b2-49a7-9961-a69e7c1107b0 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:08.037491 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af942610-a2d0-4bfc-84a7-74db0a3f1749 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:08.038329 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502f2c0-87b2-49a7-9961-a69e7c1107b0 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:08.038804 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502f2c0-87b2-49a7-9961-a69e7c1107b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:08.044844 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926f2de-bd46-4e31-8b47-e07429da972d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:08.045628 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926f2de-bd46-4e31-8b47-e07429da972d admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:08.046453 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926f2de-bd46-4e31-8b47-e07429da972d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:08.046731 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926f2de-bd46-4e31-8b47-e07429da972d admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:08.047516 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926f2de-bd46-4e31-8b47-e07429da972d admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:08.049188 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-d926f2de-bd46-4e31-8b47-e07429da972d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:27:08.049188 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 09 04:27:08.049188 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: Feb 09 04:27:08.049624 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926f2de-bd46-4e31-8b47-e07429da972d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:08.062430 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-f502f2c0-87b2-49a7-9961-a69e7c1107b0 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:08.064334 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-f502f2c0-87b2-49a7-9961-a69e7c1107b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:08.072892 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 18/36] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 09 04:27:08.097131 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502f2c0-87b2-49a7-9961-a69e7c1107b0 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:08.107972 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502f2c0-87b2-49a7-9961-a69e7c1107b0 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:08.114281 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba74b9-3871-4740-82d6-237338859b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:08.115241 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba74b9-3871-4740-82d6-237338859b8e admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:08.115723 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba74b9-3871-4740-82d6-237338859b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:08.116285 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba74b9-3871-4740-82d6-237338859b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:08.117295 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba74b9-3871-4740-82d6-237338859b8e admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:08.118512 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING py.warnings [None req-16ba74b9-3871-4740-82d6-237338859b8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:27:08.118512 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: warnings.warn(msg) Feb 09 04:27:08.118512 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: Feb 09 04:27:08.119758 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba74b9-3871-4740-82d6-237338859b8e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:08.143232 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 19/37] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:27:08 2022] POST /identity/v3/roles => generated 225 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:27:08.190113 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 19/38] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:27:08 2022] POST /identity/v3/roles => generated 219 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:27:08.898019 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163b6e0-00c4-4fc3-a48c-d99b88da2fa2 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:08.898499 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163b6e0-00c4-4fc3-a48c-d99b88da2fa2 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:08.898499 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163b6e0-00c4-4fc3-a48c-d99b88da2fa2 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:08.900277 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 20/39] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:08.906621 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d06c15-1ee7-43da-9668-4c7ca4658bfa None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:08.906917 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d06c15-1ee7-43da-9668-4c7ca4658bfa None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:08.907197 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d06c15-1ee7-43da-9668-4c7ca4658bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:08.927174 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a1d06c15-1ee7-43da-9668-4c7ca4658bfa None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:08.928683 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a1d06c15-1ee7-43da-9668-4c7ca4658bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:08.936745 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 20/40] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:08.959313 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163b6e0-00c4-4fc3-a48c-d99b88da2fa2 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:08.972339 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163b6e0-00c4-4fc3-a48c-d99b88da2fa2 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:08.976891 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94d095-bb20-4c6b-94ba-ffbdbd0437bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:08.977937 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94d095-bb20-4c6b-94ba-ffbdbd0437bf admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:08.978426 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94d095-bb20-4c6b-94ba-ffbdbd0437bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:08.978907 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94d095-bb20-4c6b-94ba-ffbdbd0437bf admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:08.980319 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94d095-bb20-4c6b-94ba-ffbdbd0437bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:08.982273 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94d095-bb20-4c6b-94ba-ffbdbd0437bf admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:08.984909 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 21/41] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:27:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:08.990074 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d06c15-1ee7-43da-9668-4c7ca4658bfa None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:08.999101 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d06c15-1ee7-43da-9668-4c7ca4658bfa None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:09.003396 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21f7e5-7069-4e62-8e85-f2d80bf700b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:09.004046 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21f7e5-7069-4e62-8e85-f2d80bf700b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:09.004329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21f7e5-7069-4e62-8e85-f2d80bf700b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:09.004604 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21f7e5-7069-4e62-8e85-f2d80bf700b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:09.005380 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21f7e5-7069-4e62-8e85-f2d80bf700b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:09.006581 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-5f21f7e5-7069-4e62-8e85-f2d80bf700b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:27:09.006581 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 09 04:27:09.006581 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: Feb 09 04:27:09.007807 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21f7e5-7069-4e62-8e85-f2d80bf700b9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:09.036469 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 21/42] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Feb 9 04:27:08 2022] POST /identity/v3/projects => generated 312 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:27:09.052387 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f66d8-c705-41ba-9b8a-0da04f951b0d None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:09.052700 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f66d8-c705-41ba-9b8a-0da04f951b0d None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:09.053021 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f66d8-c705-41ba-9b8a-0da04f951b0d None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:09.055217 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 22/43] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:09.061295 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8e104-9c6b-4917-aa9d-2092d4862cbf None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:09.061618 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8e104-9c6b-4917-aa9d-2092d4862cbf None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:09.061876 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8e104-9c6b-4917-aa9d-2092d4862cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:09.080913 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-cfa8e104-9c6b-4917-aa9d-2092d4862cbf None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:09.082361 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-cfa8e104-9c6b-4917-aa9d-2092d4862cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:09.144669 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 22/44] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:09.168743 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f66d8-c705-41ba-9b8a-0da04f951b0d None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:09.181821 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f66d8-c705-41ba-9b8a-0da04f951b0d None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:09.187291 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d0dd6-7e5c-495b-851a-958f37a6a88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:09.188104 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d0dd6-7e5c-495b-851a-958f37a6a88c admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:09.188384 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d0dd6-7e5c-495b-851a-958f37a6a88c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:09.188756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d0dd6-7e5c-495b-851a-958f37a6a88c admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:09.189811 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d0dd6-7e5c-495b-851a-958f37a6a88c admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:09.191789 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d0dd6-7e5c-495b-851a-958f37a6a88c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:09.206689 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 23/45] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:27:09 2022] POST /identity/v3/roles => generated 223 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:27:10.370963 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3845e-d84c-404f-8b28-2728a2767846 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:10.371476 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3845e-d84c-404f-8b28-2728a2767846 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:10.371557 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3845e-d84c-404f-8b28-2728a2767846 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:10.373351 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 23/46] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:10.379169 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda2456-2c65-4213-b90b-324398736de6 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:10.379578 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda2456-2c65-4213-b90b-324398736de6 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:10.379733 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda2456-2c65-4213-b90b-324398736de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:10.397547 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-3dda2456-2c65-4213-b90b-324398736de6 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:10.398726 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-3dda2456-2c65-4213-b90b-324398736de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:10.406201 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 24/47] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:10.429309 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3845e-d84c-404f-8b28-2728a2767846 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:10.441758 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3845e-d84c-404f-8b28-2728a2767846 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:10.446223 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd141b20-d0cd-4971-be04-31de637fb628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:10.447004 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd141b20-d0cd-4971-be04-31de637fb628 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:10.447291 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd141b20-d0cd-4971-be04-31de637fb628 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:10.447570 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd141b20-d0cd-4971-be04-31de637fb628 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:10.458067 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd141b20-d0cd-4971-be04-31de637fb628 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:10.464873 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-dd141b20-d0cd-4971-be04-31de637fb628 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:27:10.466084 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 24/48] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:27:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:10.471414 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda2456-2c65-4213-b90b-324398736de6 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:10.480089 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda2456-2c65-4213-b90b-324398736de6 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:10.484383 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade1803-9322-4c04-8fe0-68a64d15aa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:10.485043 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade1803-9322-4c04-8fe0-68a64d15aa38 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:10.485334 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade1803-9322-4c04-8fe0-68a64d15aa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:10.485614 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade1803-9322-4c04-8fe0-68a64d15aa38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:10.486376 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade1803-9322-4c04-8fe0-68a64d15aa38 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:10.486682 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade1803-9322-4c04-8fe0-68a64d15aa38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:10.488274 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade1803-9322-4c04-8fe0-68a64d15aa38 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:10.496320 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 25/49] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:10.502101 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd141b20-d0cd-4971-be04-31de637fb628 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:10.511995 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd141b20-d0cd-4971-be04-31de637fb628 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:10.516831 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dfc06-10da-43b0-b6d3-af0054c0e8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:10.517692 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dfc06-10da-43b0-b6d3-af0054c0e8bc admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:10.517978 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dfc06-10da-43b0-b6d3-af0054c0e8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:10.518253 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055dfc06-10da-43b0-b6d3-af0054c0e8bc admin admin] PATH_INFO: `/v3/users/149f2cba29a24507ab7090c3c8fa1691` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:10.519451 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055dfc06-10da-43b0-b6d3-af0054c0e8bc admin admin] RBAC: Authorizing `identity:get_user(user_id=149f2cba29a24507ab7090c3c8fa1691)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:10.521313 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055dfc06-10da-43b0-b6d3-af0054c0e8bc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:10.522867 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 25/50] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:10 2022] GET /identity/v3/users/149f2cba29a24507ab7090c3c8fa1691 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:10.527762 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade1803-9322-4c04-8fe0-68a64d15aa38 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:10.537173 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade1803-9322-4c04-8fe0-68a64d15aa38 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:10.541880 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c6032-e92d-4c30-b377-0b95ffac2031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:10.542646 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c6032-e92d-4c30-b377-0b95ffac2031 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:10.542959 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c6032-e92d-4c30-b377-0b95ffac2031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:10.543268 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c6032-e92d-4c30-b377-0b95ffac2031 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:10.547032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c6032-e92d-4c30-b377-0b95ffac2031 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:10.548750 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c6032-e92d-4c30-b377-0b95ffac2031 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:10.550374 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 26/51] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:27:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:10.555623 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dfc06-10da-43b0-b6d3-af0054c0e8bc admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:10.565727 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055dfc06-10da-43b0-b6d3-af0054c0e8bc admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:10.571859 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad1508-002e-41c2-bee5-841b5dcfc772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:10.571859 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad1508-002e-41c2-bee5-841b5dcfc772 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:10.571859 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad1508-002e-41c2-bee5-841b5dcfc772 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:10.571859 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad1508-002e-41c2-bee5-841b5dcfc772 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:10.572167 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad1508-002e-41c2-bee5-841b5dcfc772 admin admin] RBAC: Adding query filter params (role.id=05ca9a16ef2a450b8cc73ade47f5c7d0, scope.domain.id=default, user.id=149f2cba29a24507ab7090c3c8fa1691) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:10.572454 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad1508-002e-41c2-bee5-841b5dcfc772 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:10.573520 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-4fad1508-002e-41c2-bee5-841b5dcfc772 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:27:10.573520 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 09 04:27:10.573520 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: Feb 09 04:27:10.574699 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad1508-002e-41c2-bee5-841b5dcfc772 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:10.582230 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 26/52] 10.222.0.36 () {56 vars in 1343 bytes} [Wed Feb 9 04:27:10 2022] GET /identity/v3/role_assignments?user.id=149f2cba29a24507ab7090c3c8fa1691&scope.domain.id=default&role.id=05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 530 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:11.275844 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd4caa-6259-436b-9690-bdcb1a874f6e None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:11.276135 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd4caa-6259-436b-9690-bdcb1a874f6e None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:11.276416 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd4caa-6259-436b-9690-bdcb1a874f6e None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:11.278222 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 27/53] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:11.283329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5432f4-1141-4c4a-8388-d8f13abcb163 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:11.283627 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5432f4-1141-4c4a-8388-d8f13abcb163 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:11.283914 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5432f4-1141-4c4a-8388-d8f13abcb163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:11.301421 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ec5432f4-1141-4c4a-8388-d8f13abcb163 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:11.302617 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ec5432f4-1141-4c4a-8388-d8f13abcb163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:11.310004 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 27/54] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:11.333802 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd4caa-6259-436b-9690-bdcb1a874f6e None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:11.345572 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd4caa-6259-436b-9690-bdcb1a874f6e None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:11.349701 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88983d5-0d87-45e5-ad37-e9db20baaefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:11.350456 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88983d5-0d87-45e5-ad37-e9db20baaefb admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:11.350736 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88983d5-0d87-45e5-ad37-e9db20baaefb admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:11.351011 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88983d5-0d87-45e5-ad37-e9db20baaefb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:11.352155 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88983d5-0d87-45e5-ad37-e9db20baaefb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:11.353864 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88983d5-0d87-45e5-ad37-e9db20baaefb admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:11.355387 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 28/55] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:27:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:11.360316 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5432f4-1141-4c4a-8388-d8f13abcb163 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:11.368870 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5432f4-1141-4c4a-8388-d8f13abcb163 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:11.373232 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a417f2-be53-42cc-ab37-c5fbc081e98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:11.373862 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a417f2-be53-42cc-ab37-c5fbc081e98d admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:11.374678 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a417f2-be53-42cc-ab37-c5fbc081e98d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:11.374955 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a417f2-be53-42cc-ab37-c5fbc081e98d admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:11.375668 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a417f2-be53-42cc-ab37-c5fbc081e98d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:11.377633 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a417f2-be53-42cc-ab37-c5fbc081e98d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:11.401793 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 28/56] 10.222.0.36 () {60 vars in 1161 bytes} [Wed Feb 9 04:27:11 2022] POST /identity/v3/projects => generated 298 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:27:13.612972 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e0e13-ebec-4d40-a645-1c828ff53da5 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:13.613464 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e0e13-ebec-4d40-a645-1c828ff53da5 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:13.613551 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e0e13-ebec-4d40-a645-1c828ff53da5 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:13.615314 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 29/57] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:13.620498 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ac3d5-3353-4781-8f05-5960266ac11d None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:13.620902 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ac3d5-3353-4781-8f05-5960266ac11d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:13.621086 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ac3d5-3353-4781-8f05-5960266ac11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:13.638697 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-385ac3d5-3353-4781-8f05-5960266ac11d None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:13.640448 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-385ac3d5-3353-4781-8f05-5960266ac11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:13.694102 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 29/58] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:13.718839 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e0e13-ebec-4d40-a645-1c828ff53da5 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:13.730462 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e0e13-ebec-4d40-a645-1c828ff53da5 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:13.735070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796e937-00b4-403e-ba35-56c9bee3b79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:13.735828 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796e937-00b4-403e-ba35-56c9bee3b79c admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:13.736109 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796e937-00b4-403e-ba35-56c9bee3b79c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:13.736384 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796e937-00b4-403e-ba35-56c9bee3b79c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:13.737562 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796e937-00b4-403e-ba35-56c9bee3b79c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:13.739223 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796e937-00b4-403e-ba35-56c9bee3b79c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:13.740749 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 30/59] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:27:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:13.745685 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ac3d5-3353-4781-8f05-5960266ac11d None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:13.754667 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ac3d5-3353-4781-8f05-5960266ac11d None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:13.758939 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27499348-c5ce-4714-a9bb-751ac4bbde8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:13.759575 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27499348-c5ce-4714-a9bb-751ac4bbde8c admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:13.759860 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27499348-c5ce-4714-a9bb-751ac4bbde8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:13.760136 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27499348-c5ce-4714-a9bb-751ac4bbde8c admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:13.760850 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27499348-c5ce-4714-a9bb-751ac4bbde8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:13.761890 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-27499348-c5ce-4714-a9bb-751ac4bbde8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:27:13.761890 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 09 04:27:13.761890 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: Feb 09 04:27:13.763445 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27499348-c5ce-4714-a9bb-751ac4bbde8c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:13.788980 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 30/60] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Feb 9 04:27:13 2022] POST /identity/v3/users => generated 275 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:27:17.040848 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacc2bb-c6fc-4dc8-b748-b34e35b49849 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.041376 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacc2bb-c6fc-4dc8-b748-b34e35b49849 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.041447 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacc2bb-c6fc-4dc8-b748-b34e35b49849 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.043355 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 31/61] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:17.063220 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7cfba-94ba-4f49-b06a-a6af4db5fe36 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.064150 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7cfba-94ba-4f49-b06a-a6af4db5fe36 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.064623 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7cfba-94ba-4f49-b06a-a6af4db5fe36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.088433 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-1cc7cfba-94ba-4f49-b06a-a6af4db5fe36 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:17.089664 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1cc7cfba-94ba-4f49-b06a-a6af4db5fe36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:17.100172 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 31/62] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:17.145430 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacc2bb-c6fc-4dc8-b748-b34e35b49849 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.163247 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacc2bb-c6fc-4dc8-b748-b34e35b49849 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.170139 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc202aa-7337-4c5d-bcd6-8cd1b559a796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.171479 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc202aa-7337-4c5d-bcd6-8cd1b559a796 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.171777 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc202aa-7337-4c5d-bcd6-8cd1b559a796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.172057 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc202aa-7337-4c5d-bcd6-8cd1b559a796 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.183155 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc202aa-7337-4c5d-bcd6-8cd1b559a796 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:17.194297 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-dcc202aa-7337-4c5d-bcd6-8cd1b559a796 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 09 04:27:17.195834 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 32/63] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:17.201201 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7cfba-94ba-4f49-b06a-a6af4db5fe36 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.210431 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7cfba-94ba-4f49-b06a-a6af4db5fe36 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.222369 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dba32d-e1ac-46ce-a4b1-8c4af6ac5693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.223051 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dba32d-e1ac-46ce-a4b1-8c4af6ac5693 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.223339 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dba32d-e1ac-46ce-a4b1-8c4af6ac5693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.223622 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dba32d-e1ac-46ce-a4b1-8c4af6ac5693 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.224397 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dba32d-e1ac-46ce-a4b1-8c4af6ac5693 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:17.224706 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dba32d-e1ac-46ce-a4b1-8c4af6ac5693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:17.226392 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dba32d-e1ac-46ce-a4b1-8c4af6ac5693 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:17.242889 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94767e-6cb0-48d2-89b9-ccf9d21a4604 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.243489 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94767e-6cb0-48d2-89b9-ccf9d21a4604 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.243609 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 32/64] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:17.244143 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94767e-6cb0-48d2-89b9-ccf9d21a4604 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.246369 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 33/65] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:27:17.250407 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dba32d-e1ac-46ce-a4b1-8c4af6ac5693 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.251853 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0b3f1-d94a-4e52-855f-17e4285f3d2e None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.252338 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0b3f1-d94a-4e52-855f-17e4285f3d2e None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.252827 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0b3f1-d94a-4e52-855f-17e4285f3d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.266576 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dba32d-e1ac-46ce-a4b1-8c4af6ac5693 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.281233 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfaaa5-6653-4dd4-a3b5-b2e4cd4cbd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.282407 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfaaa5-6653-4dd4-a3b5-b2e4cd4cbd95 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.282921 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfaaa5-6653-4dd4-a3b5-b2e4cd4cbd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.283386 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcfaaa5-6653-4dd4-a3b5-b2e4cd4cbd95 admin admin] PATH_INFO: `/v3/users/635fa93bb3a84f3faefdeefe04d60128` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.284911 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-d5c0b3f1-d94a-4e52-855f-17e4285f3d2e None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:17.286508 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-d5c0b3f1-d94a-4e52-855f-17e4285f3d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:17.305824 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 34/66] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:17.306102 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfaaa5-6653-4dd4-a3b5-b2e4cd4cbd95 admin admin] RBAC: Authorizing `identity:get_user(user_id=635fa93bb3a84f3faefdeefe04d60128)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:17.307591 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7214f5-9722-42a7-b108-636098faa535 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.310252 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7214f5-9722-42a7-b108-636098faa535 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.310416 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcfaaa5-6653-4dd4-a3b5-b2e4cd4cbd95 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:17.310416 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 33/67] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/users/635fa93bb3a84f3faefdeefe04d60128 => generated 275 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:17.314489 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7214f5-9722-42a7-b108-636098faa535 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.315443 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 35/68] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:17.316011 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfaaa5-6653-4dd4-a3b5-b2e4cd4cbd95 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.320438 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf2781-dbae-4be5-8add-c94cc040f9ec None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.320727 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf2781-dbae-4be5-8add-c94cc040f9ec None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.321022 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf2781-dbae-4be5-8add-c94cc040f9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.327863 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcfaaa5-6653-4dd4-a3b5-b2e4cd4cbd95 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.339702 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03768b-52eb-47ef-b153-f9ecf81238c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.340758 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03768b-52eb-47ef-b153-f9ecf81238c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.341301 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03768b-52eb-47ef-b153-f9ecf81238c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.341810 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03768b-52eb-47ef-b153-f9ecf81238c4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.347750 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-dfbf2781-dbae-4be5-8add-c94cc040f9ec None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:17.349641 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-dfbf2781-dbae-4be5-8add-c94cc040f9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:17.357941 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03768b-52eb-47ef-b153-f9ecf81238c4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:17.359614 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 36/69] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 09 04:27:17.360539 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf2781-dbae-4be5-8add-c94cc040f9ec None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.361735 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03768b-52eb-47ef-b153-f9ecf81238c4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:17.371015 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf2781-dbae-4be5-8add-c94cc040f9ec None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.372574 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 34/70] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:17.378481 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03768b-52eb-47ef-b153-f9ecf81238c4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.385663 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef450f1-62fc-40cb-b4a1-6a99d64a715d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.386778 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef450f1-62fc-40cb-b4a1-6a99d64a715d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.387265 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef450f1-62fc-40cb-b4a1-6a99d64a715d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.387743 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef450f1-62fc-40cb-b4a1-6a99d64a715d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.388993 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03768b-52eb-47ef-b153-f9ecf81238c4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.393516 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa877a3c-2c43-478b-b35b-b668ffc083bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.394362 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa877a3c-2c43-478b-b35b-b668ffc083bf admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.394635 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa877a3c-2c43-478b-b35b-b668ffc083bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.394911 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa877a3c-2c43-478b-b35b-b668ffc083bf admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.396107 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa877a3c-2c43-478b-b35b-b668ffc083bf admin admin] RBAC: Authorizing `identity:get_project(project_id=635df70d95a247b1a0a172cbb183ba9b)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:17.398254 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa877a3c-2c43-478b-b35b-b668ffc083bf admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:17.399969 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 35/71] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:17.400652 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa877a3c-2c43-478b-b35b-b668ffc083bf admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.401264 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef450f1-62fc-40cb-b4a1-6a99d64a715d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:17.409621 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-9ef450f1-62fc-40cb-b4a1-6a99d64a715d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 09 04:27:17.410714 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa877a3c-2c43-478b-b35b-b668ffc083bf admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.411571 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 37/72] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:17.416596 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef450f1-62fc-40cb-b4a1-6a99d64a715d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.424427 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3f339-7cd9-49e1-9804-02e679728860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.425221 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3f339-7cd9-49e1-9804-02e679728860 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.425507 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3f339-7cd9-49e1-9804-02e679728860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.425784 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3f339-7cd9-49e1-9804-02e679728860 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.427694 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef450f1-62fc-40cb-b4a1-6a99d64a715d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.432614 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618893a9-9596-4015-92b8-3597f56f8bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.433531 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618893a9-9596-4015-92b8-3597f56f8bdd admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.434034 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618893a9-9596-4015-92b8-3597f56f8bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.434518 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618893a9-9596-4015-92b8-3597f56f8bdd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.435555 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618893a9-9596-4015-92b8-3597f56f8bdd admin admin] RBAC: Adding query filter params (role.id=102f883957d846419d33ce22fdec0cce, scope.project.id=635df70d95a247b1a0a172cbb183ba9b, user.id=635fa93bb3a84f3faefdeefe04d60128) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:17.436066 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618893a9-9596-4015-92b8-3597f56f8bdd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:17.436277 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3f339-7cd9-49e1-9804-02e679728860 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:17.438461 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618893a9-9596-4015-92b8-3597f56f8bdd admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:17.443319 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-1ad3f339-7cd9-49e1-9804-02e679728860 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:27:17.449184 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 36/73] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:17.449184 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3f339-7cd9-49e1-9804-02e679728860 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.450009 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 38/74] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/role_assignments?user.id=635fa93bb3a84f3faefdeefe04d60128&scope.project.id=635df70d95a247b1a0a172cbb183ba9b&role.id=102f883957d846419d33ce22fdec0cce => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:17.450448 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618893a9-9596-4015-92b8-3597f56f8bdd admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.460629 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618893a9-9596-4015-92b8-3597f56f8bdd admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.471536 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3f339-7cd9-49e1-9804-02e679728860 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.473499 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b465e3-7e92-4c69-bcca-cd88e4e1dfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.474190 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b465e3-7e92-4c69-bcca-cd88e4e1dfa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.474471 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b465e3-7e92-4c69-bcca-cd88e4e1dfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.474747 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b465e3-7e92-4c69-bcca-cd88e4e1dfa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.475525 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b465e3-7e92-4c69-bcca-cd88e4e1dfa5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:17.475835 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b465e3-7e92-4c69-bcca-cd88e4e1dfa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:17.478081 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b465e3-7e92-4c69-bcca-cd88e4e1dfa5 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:17.489052 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078824a1-7c84-4c4e-afff-8a529faf48fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.489746 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078824a1-7c84-4c4e-afff-8a529faf48fe admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.490044 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078824a1-7c84-4c4e-afff-8a529faf48fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.490312 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078824a1-7c84-4c4e-afff-8a529faf48fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.491096 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078824a1-7c84-4c4e-afff-8a529faf48fe admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:17.491401 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078824a1-7c84-4c4e-afff-8a529faf48fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:17.493098 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078824a1-7c84-4c4e-afff-8a529faf48fe admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:17.499599 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 39/75] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:17.506421 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 37/76] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:17.507318 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b465e3-7e92-4c69-bcca-cd88e4e1dfa5 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.513534 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078824a1-7c84-4c4e-afff-8a529faf48fe admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.524589 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b465e3-7e92-4c69-bcca-cd88e4e1dfa5 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.532755 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078824a1-7c84-4c4e-afff-8a529faf48fe admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.536591 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f1e3e-e3a6-470b-b032-7fcb799e39aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.537528 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f1e3e-e3a6-470b-b032-7fcb799e39aa admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.538057 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f1e3e-e3a6-470b-b032-7fcb799e39aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.538341 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f1e3e-e3a6-470b-b032-7fcb799e39aa admin admin] PATH_INFO: `/v3/users/149f2cba29a24507ab7090c3c8fa1691` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.540014 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f1e3e-e3a6-470b-b032-7fcb799e39aa admin admin] RBAC: Authorizing `identity:get_user(user_id=149f2cba29a24507ab7090c3c8fa1691)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:17.541909 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f1e3e-e3a6-470b-b032-7fcb799e39aa admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:17.544795 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 40/77] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/users/149f2cba29a24507ab7090c3c8fa1691 => generated 247 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:17.546897 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817c143-173a-492f-bc8a-b94d98a80c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.547788 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817c143-173a-492f-bc8a-b94d98a80c05 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.548067 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817c143-173a-492f-bc8a-b94d98a80c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.548345 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817c143-173a-492f-bc8a-b94d98a80c05 admin admin] PATH_INFO: `/v3/users/635fa93bb3a84f3faefdeefe04d60128` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.549600 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817c143-173a-492f-bc8a-b94d98a80c05 admin admin] RBAC: Authorizing `identity:get_user(user_id=635fa93bb3a84f3faefdeefe04d60128)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:17.551836 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817c143-173a-492f-bc8a-b94d98a80c05 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:17.554231 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f1e3e-e3a6-470b-b032-7fcb799e39aa admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.555364 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 38/78] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/users/635fa93bb3a84f3faefdeefe04d60128 => generated 275 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:17.562125 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817c143-173a-492f-bc8a-b94d98a80c05 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.568090 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f1e3e-e3a6-470b-b032-7fcb799e39aa admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.579935 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817c143-173a-492f-bc8a-b94d98a80c05 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.581820 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee754c-6c6c-4e1f-b4c5-23843623a930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.582492 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee754c-6c6c-4e1f-b4c5-23843623a930 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.582775 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee754c-6c6c-4e1f-b4c5-23843623a930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.583052 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee754c-6c6c-4e1f-b4c5-23843623a930 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.595150 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a1f34-5b1e-4504-8dbd-912d78009cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.595817 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a1f34-5b1e-4504-8dbd-912d78009cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.596099 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a1f34-5b1e-4504-8dbd-912d78009cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.596374 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a1f34-5b1e-4504-8dbd-912d78009cb7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.602564 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee754c-6c6c-4e1f-b4c5-23843623a930 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:17.604389 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee754c-6c6c-4e1f-b4c5-23843623a930 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:17.613149 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a1f34-5b1e-4504-8dbd-912d78009cb7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:17.614969 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a1f34-5b1e-4504-8dbd-912d78009cb7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:17.625716 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 41/79] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 09 04:27:17.631339 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee754c-6c6c-4e1f-b4c5-23843623a930 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.633886 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 39/80] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:17.635265 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a6078-0028-4d88-b3df-b7388bc167f7 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.635562 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a6078-0028-4d88-b3df-b7388bc167f7 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.635848 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a6078-0028-4d88-b3df-b7388bc167f7 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.637613 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 40/81] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:17.641058 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee754c-6c6c-4e1f-b4c5-23843623a930 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.641193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a6078-0028-4d88-b3df-b7388bc167f7 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.646238 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadaf2b-3c75-40cc-87d4-0685f123604f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.647637 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadaf2b-3c75-40cc-87d4-0685f123604f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.648138 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadaf2b-3c75-40cc-87d4-0685f123604f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.648631 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadaf2b-3c75-40cc-87d4-0685f123604f admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.650455 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadaf2b-3c75-40cc-87d4-0685f123604f admin admin] RBAC: Authorizing `identity:get_project(project_id=635df70d95a247b1a0a172cbb183ba9b)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:17.653469 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadaf2b-3c75-40cc-87d4-0685f123604f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:17.656420 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 42/82] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:17.657899 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5474d30-76dc-4f7d-aed3-a82cb7786972 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.658393 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5474d30-76dc-4f7d-aed3-a82cb7786972 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.658869 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5474d30-76dc-4f7d-aed3-a82cb7786972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.663072 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a6078-0028-4d88-b3df-b7388bc167f7 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.668198 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a208efa-2370-44ae-be91-7c23367816d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.668650 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a208efa-2370-44ae-be91-7c23367816d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.668936 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a208efa-2370-44ae-be91-7c23367816d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.669317 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a208efa-2370-44ae-be91-7c23367816d2 admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.670516 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a208efa-2370-44ae-be91-7c23367816d2 admin admin] RBAC: Authorizing `identity:get_project(project_id=635df70d95a247b1a0a172cbb183ba9b)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:17.673191 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a208efa-2370-44ae-be91-7c23367816d2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:17.675259 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 41/83] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:17.680406 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a208efa-2370-44ae-be91-7c23367816d2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.681289 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-c5474d30-76dc-4f7d-aed3-a82cb7786972 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:17.682654 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-c5474d30-76dc-4f7d-aed3-a82cb7786972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:17.691152 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a208efa-2370-44ae-be91-7c23367816d2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.691751 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 43/84] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:17.697093 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5474d30-76dc-4f7d-aed3-a82cb7786972 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.704785 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec18c51-54c3-4058-96e3-2f86dfe9f48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.705485 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec18c51-54c3-4058-96e3-2f86dfe9f48a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.705775 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec18c51-54c3-4058-96e3-2f86dfe9f48a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.706058 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec18c51-54c3-4058-96e3-2f86dfe9f48a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.706917 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec18c51-54c3-4058-96e3-2f86dfe9f48a admin admin] RBAC: Adding query filter params (role.id=05ca9a16ef2a450b8cc73ade47f5c7d0, scope.project.id=635df70d95a247b1a0a172cbb183ba9b, user.id=149f2cba29a24507ab7090c3c8fa1691) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:17.707233 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec18c51-54c3-4058-96e3-2f86dfe9f48a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:17.709158 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec18c51-54c3-4058-96e3-2f86dfe9f48a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:17.713166 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5474d30-76dc-4f7d-aed3-a82cb7786972 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.719096 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 42/85] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/role_assignments?user.id=149f2cba29a24507ab7090c3c8fa1691&scope.project.id=635df70d95a247b1a0a172cbb183ba9b&role.id=05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:17.721648 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec18c51-54c3-4058-96e3-2f86dfe9f48a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.722536 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d004a5-b81c-4428-8a15-2ba067d8e51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.723192 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d004a5-b81c-4428-8a15-2ba067d8e51d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.723476 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d004a5-b81c-4428-8a15-2ba067d8e51d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.723753 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d004a5-b81c-4428-8a15-2ba067d8e51d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.724609 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d004a5-b81c-4428-8a15-2ba067d8e51d admin admin] RBAC: Adding query filter params (role.id=850547f4dcf34a76a710ddaae9dc30de, scope.project.id=635df70d95a247b1a0a172cbb183ba9b, user.id=635fa93bb3a84f3faefdeefe04d60128) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:17.724930 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d004a5-b81c-4428-8a15-2ba067d8e51d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:17.726863 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d004a5-b81c-4428-8a15-2ba067d8e51d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:17.741368 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 44/86] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/role_assignments?user.id=635fa93bb3a84f3faefdeefe04d60128&scope.project.id=635df70d95a247b1a0a172cbb183ba9b&role.id=850547f4dcf34a76a710ddaae9dc30de => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:17.743685 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec18c51-54c3-4058-96e3-2f86dfe9f48a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.748829 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b75fc-aef8-4582-ba5d-efbb33f1367e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.749738 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b75fc-aef8-4582-ba5d-efbb33f1367e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.750109 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b75fc-aef8-4582-ba5d-efbb33f1367e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.750395 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b75fc-aef8-4582-ba5d-efbb33f1367e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.763422 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00b75fc-aef8-4582-ba5d-efbb33f1367e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:17.771226 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-c00b75fc-aef8-4582-ba5d-efbb33f1367e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 09 04:27:17.772803 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 43/87] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:17.779032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d004a5-b81c-4428-8a15-2ba067d8e51d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.789914 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d004a5-b81c-4428-8a15-2ba067d8e51d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.794724 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa63f72-3ca2-4f00-818d-4b034edeb8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.795411 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa63f72-3ca2-4f00-818d-4b034edeb8ec admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.796246 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa63f72-3ca2-4f00-818d-4b034edeb8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.796527 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa63f72-3ca2-4f00-818d-4b034edeb8ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.797374 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa63f72-3ca2-4f00-818d-4b034edeb8ec admin admin] RBAC: Adding query filter params (name=member) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:17.797686 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa63f72-3ca2-4f00-818d-4b034edeb8ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:17.799350 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa63f72-3ca2-4f00-818d-4b034edeb8ec admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:17.813231 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 45/88] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:17.815617 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b75fc-aef8-4582-ba5d-efbb33f1367e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.826439 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00b75fc-aef8-4582-ba5d-efbb33f1367e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.831259 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac500e5-78c4-4dbc-8e97-fa99b31e2bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.832158 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac500e5-78c4-4dbc-8e97-fa99b31e2bcd admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.832448 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac500e5-78c4-4dbc-8e97-fa99b31e2bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.832728 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac500e5-78c4-4dbc-8e97-fa99b31e2bcd admin admin] PATH_INFO: `/v3/users/635fa93bb3a84f3faefdeefe04d60128` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.834038 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac500e5-78c4-4dbc-8e97-fa99b31e2bcd admin admin] RBAC: Authorizing `identity:get_user(user_id=635fa93bb3a84f3faefdeefe04d60128)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:17.836588 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac500e5-78c4-4dbc-8e97-fa99b31e2bcd admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:17.838558 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 44/89] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/users/635fa93bb3a84f3faefdeefe04d60128 => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:17.844234 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa63f72-3ca2-4f00-818d-4b034edeb8ec admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.854774 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa63f72-3ca2-4f00-818d-4b034edeb8ec admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.859952 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d5b00-87a0-4cf2-8038-8a7658fcc5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.860619 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d5b00-87a0-4cf2-8038-8a7658fcc5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.860906 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d5b00-87a0-4cf2-8038-8a7658fcc5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.861223 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d5b00-87a0-4cf2-8038-8a7658fcc5f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.870242 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d5b00-87a0-4cf2-8038-8a7658fcc5f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:17.872098 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d5b00-87a0-4cf2-8038-8a7658fcc5f8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:17.883096 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 46/90] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:17.888751 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac500e5-78c4-4dbc-8e97-fa99b31e2bcd admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.898907 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac500e5-78c4-4dbc-8e97-fa99b31e2bcd admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.903549 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f39a3-efb2-4775-93db-2c344b5b2000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.904432 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f39a3-efb2-4775-93db-2c344b5b2000 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.904720 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f39a3-efb2-4775-93db-2c344b5b2000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.905019 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f39a3-efb2-4775-93db-2c344b5b2000 admin admin] PATH_INFO: `/v3/projects/bf1eb255931b467b8295cb9132e8092e` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.906797 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f39a3-efb2-4775-93db-2c344b5b2000 admin admin] RBAC: Authorizing `identity:get_project(project_id=bf1eb255931b467b8295cb9132e8092e)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:17.909063 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f39a3-efb2-4775-93db-2c344b5b2000 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:17.911030 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 45/91] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/projects/bf1eb255931b467b8295cb9132e8092e => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:17.917381 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d5b00-87a0-4cf2-8038-8a7658fcc5f8 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:17.927444 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d5b00-87a0-4cf2-8038-8a7658fcc5f8 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:17.932138 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30296c6-461e-4e34-98a4-f1b75f1f0d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:17.932829 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30296c6-461e-4e34-98a4-f1b75f1f0d08 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:17.933125 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30296c6-461e-4e34-98a4-f1b75f1f0d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:17.933405 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30296c6-461e-4e34-98a4-f1b75f1f0d08 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:17.934263 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30296c6-461e-4e34-98a4-f1b75f1f0d08 admin admin] RBAC: Adding query filter params (role.id=102f883957d846419d33ce22fdec0cce, scope.project.id=bf1eb255931b467b8295cb9132e8092e, user.id=635fa93bb3a84f3faefdeefe04d60128) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:17.934576 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30296c6-461e-4e34-98a4-f1b75f1f0d08 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:17.936497 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30296c6-461e-4e34-98a4-f1b75f1f0d08 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:17.942821 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 47/92] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:27:17 2022] GET /identity/v3/role_assignments?user.id=635fa93bb3a84f3faefdeefe04d60128&scope.project.id=bf1eb255931b467b8295cb9132e8092e&role.id=102f883957d846419d33ce22fdec0cce => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:18.041672 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e855e-47fd-43f7-b637-3e5f137e620b None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:18.042012 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e855e-47fd-43f7-b637-3e5f137e620b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:18.042243 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e855e-47fd-43f7-b637-3e5f137e620b None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:18.044482 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 46/93] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:18.050707 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e3f6e-8fc6-4f8d-92c7-807a1aa87bbc None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:18.051350 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e3f6e-8fc6-4f8d-92c7-807a1aa87bbc None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:18.051561 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e3f6e-8fc6-4f8d-92c7-807a1aa87bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:18.076461 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-b99e3f6e-8fc6-4f8d-92c7-807a1aa87bbc None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:18.076461 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-b99e3f6e-8fc6-4f8d-92c7-807a1aa87bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:18.086182 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 48/94] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:18.112977 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e855e-47fd-43f7-b637-3e5f137e620b None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:18.133841 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e855e-47fd-43f7-b637-3e5f137e620b None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:18.141143 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ba563-c7f0-40ff-aa16-df7114946f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:18.141963 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ba563-c7f0-40ff-aa16-df7114946f4a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:18.142252 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ba563-c7f0-40ff-aa16-df7114946f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:18.142531 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ba563-c7f0-40ff-aa16-df7114946f4a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:18.143754 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ba563-c7f0-40ff-aa16-df7114946f4a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:18.145523 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63ba563-c7f0-40ff-aa16-df7114946f4a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:18.147136 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 47/95] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:27:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:18.152898 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e3f6e-8fc6-4f8d-92c7-807a1aa87bbc None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:18.166858 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e3f6e-8fc6-4f8d-92c7-807a1aa87bbc None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:18.175165 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883461d7-88c0-40e3-b752-2aaff4aac28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:18.175852 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883461d7-88c0-40e3-b752-2aaff4aac28b admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:18.176142 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883461d7-88c0-40e3-b752-2aaff4aac28b admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:18.176425 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883461d7-88c0-40e3-b752-2aaff4aac28b admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:18.177206 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883461d7-88c0-40e3-b752-2aaff4aac28b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:18.178226 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING py.warnings [None req-883461d7-88c0-40e3-b752-2aaff4aac28b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:27:18.178226 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: warnings.warn(msg) Feb 09 04:27:18.178226 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: Feb 09 04:27:18.179468 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883461d7-88c0-40e3-b752-2aaff4aac28b admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:18.209842 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 49/96] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Feb 9 04:27:18 2022] POST /identity/v3/users => generated 289 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:27:20.075102 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01619a9-f03f-450f-9eae-825c0769a036 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:20.075613 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01619a9-f03f-450f-9eae-825c0769a036 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:20.075685 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01619a9-f03f-450f-9eae-825c0769a036 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:20.078140 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 48/97] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:20.083529 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98141b-c312-48a6-b078-6892ef9091c4 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:20.083933 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98141b-c312-48a6-b078-6892ef9091c4 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:20.084123 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98141b-c312-48a6-b078-6892ef9091c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:20.108996 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-4d98141b-c312-48a6-b078-6892ef9091c4 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:20.110836 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-4d98141b-c312-48a6-b078-6892ef9091c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:20.118957 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 50/98] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:20.146218 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01619a9-f03f-450f-9eae-825c0769a036 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:20.163076 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01619a9-f03f-450f-9eae-825c0769a036 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:20.167528 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5aca6-3d1e-4c4a-a560-49171fdbef6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:20.168329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5aca6-3d1e-4c4a-a560-49171fdbef6c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:20.168616 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5aca6-3d1e-4c4a-a560-49171fdbef6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:20.168896 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5aca6-3d1e-4c4a-a560-49171fdbef6c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:20.185677 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5aca6-3d1e-4c4a-a560-49171fdbef6c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:20.193521 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-cef5aca6-3d1e-4c4a-a560-49171fdbef6c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 09 04:27:20.194931 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 49/99] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:20.200449 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98141b-c312-48a6-b078-6892ef9091c4 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:20.209715 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98141b-c312-48a6-b078-6892ef9091c4 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:20.216636 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d7943-ee03-415c-927c-b612c46d14e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:20.217392 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d7943-ee03-415c-927c-b612c46d14e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:20.218205 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d7943-ee03-415c-927c-b612c46d14e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:20.218487 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d7943-ee03-415c-927c-b612c46d14e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:20.219253 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d7943-ee03-415c-927c-b612c46d14e3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:20.219559 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d7943-ee03-415c-927c-b612c46d14e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:20.221233 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d7943-ee03-415c-927c-b612c46d14e3 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:20.234209 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 51/100] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:20.239492 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5aca6-3d1e-4c4a-a560-49171fdbef6c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:20.250307 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5aca6-3d1e-4c4a-a560-49171fdbef6c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:20.254869 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c9e8d-3183-46e8-84b5-f9ea90efccd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:20.255746 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c9e8d-3183-46e8-84b5-f9ea90efccd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:20.256032 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c9e8d-3183-46e8-84b5-f9ea90efccd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:20.256311 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c9e8d-3183-46e8-84b5-f9ea90efccd8 admin admin] PATH_INFO: `/v3/users/635fa93bb3a84f3faefdeefe04d60128` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:20.257549 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c9e8d-3183-46e8-84b5-f9ea90efccd8 admin admin] RBAC: Authorizing `identity:get_user(user_id=635fa93bb3a84f3faefdeefe04d60128)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:20.259710 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c9e8d-3183-46e8-84b5-f9ea90efccd8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:20.261671 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 50/101] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:20 2022] GET /identity/v3/users/635fa93bb3a84f3faefdeefe04d60128 => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:20.270097 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d7943-ee03-415c-927c-b612c46d14e3 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:20.280291 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d7943-ee03-415c-927c-b612c46d14e3 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:20.289126 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331d07a-2d19-4dbe-9f13-6ce1417266ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:20.290053 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331d07a-2d19-4dbe-9f13-6ce1417266ed admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:20.290339 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331d07a-2d19-4dbe-9f13-6ce1417266ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:20.290613 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331d07a-2d19-4dbe-9f13-6ce1417266ed admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:20.291840 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331d07a-2d19-4dbe-9f13-6ce1417266ed admin admin] RBAC: Authorizing `identity:get_project(project_id=635df70d95a247b1a0a172cbb183ba9b)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:20.293957 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331d07a-2d19-4dbe-9f13-6ce1417266ed admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:20.295720 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 52/102] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:20 2022] GET /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:20.301748 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c9e8d-3183-46e8-84b5-f9ea90efccd8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:20.312713 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c9e8d-3183-46e8-84b5-f9ea90efccd8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:20.319826 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01b2dc-884c-482c-8488-beced9c32fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:20.320778 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01b2dc-884c-482c-8488-beced9c32fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:20.321099 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01b2dc-884c-482c-8488-beced9c32fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:20.321388 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01b2dc-884c-482c-8488-beced9c32fc0 admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b/users/635fa93bb3a84f3faefdeefe04d60128/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:20.323778 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01b2dc-884c-482c-8488-beced9c32fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=635df70d95a247b1a0a172cbb183ba9b, user_id=635fa93bb3a84f3faefdeefe04d60128, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:20.324873 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-3c01b2dc-884c-482c-8488-beced9c32fc0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:27:20.324873 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 09 04:27:20.324873 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: Feb 09 04:27:20.327126 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c01b2dc-884c-482c-8488-beced9c32fc0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:20.350057 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 51/103] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:27:20 2022] PUT /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b/users/635fa93bb3a84f3faefdeefe04d60128/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:27:20.607890 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d97af-d47b-4d12-a57e-b88ac8124f55 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:20.608730 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d97af-d47b-4d12-a57e-b88ac8124f55 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:20.608891 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d97af-d47b-4d12-a57e-b88ac8124f55 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:20.610857 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 53/104] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:20.620931 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb5850-f146-4219-982a-22d54dc52643 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:20.621249 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb5850-f146-4219-982a-22d54dc52643 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:20.621543 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb5850-f146-4219-982a-22d54dc52643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:20.640545 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-5adb5850-f146-4219-982a-22d54dc52643 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:20.641791 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5adb5850-f146-4219-982a-22d54dc52643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:20.709998 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 52/105] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:20.747878 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d97af-d47b-4d12-a57e-b88ac8124f55 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:20.762439 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d97af-d47b-4d12-a57e-b88ac8124f55 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:20.770564 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50cb1c-0662-45bd-a8a3-804a0ff3d9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:20.771625 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50cb1c-0662-45bd-a8a3-804a0ff3d9ba admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:20.772110 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50cb1c-0662-45bd-a8a3-804a0ff3d9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:20.772583 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50cb1c-0662-45bd-a8a3-804a0ff3d9ba admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:20.781477 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33adcd6-9563-474a-89f6-f72dad6e3dc3 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:20.781772 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33adcd6-9563-474a-89f6-f72dad6e3dc3 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:20.782059 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33adcd6-9563-474a-89f6-f72dad6e3dc3 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:20.783874 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 53/106] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:27:20.785945 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50cb1c-0662-45bd-a8a3-804a0ff3d9ba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:20.789827 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3081c-41c1-4d8a-992d-30a6a60045bc None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:20.789827 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3081c-41c1-4d8a-992d-30a6a60045bc None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:20.789827 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3081c-41c1-4d8a-992d-30a6a60045bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:20.794857 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-4a50cb1c-0662-45bd-a8a3-804a0ff3d9ba admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:27:20.796854 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 54/107] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:27:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:20.809451 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a687e2-24fd-4805-9093-b73ff25c28fe None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:20.810042 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a687e2-24fd-4805-9093-b73ff25c28fe None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:20.810521 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a687e2-24fd-4805-9093-b73ff25c28fe None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:20.812579 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 55/108] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:27:20.813523 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a687e2-24fd-4805-9093-b73ff25c28fe None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:20.817552 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-26f3081c-41c1-4d8a-992d-30a6a60045bc None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:20.818857 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-26f3081c-41c1-4d8a-992d-30a6a60045bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:20.829027 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 54/109] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 09 04:27:20.829027 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9b4ea-e784-406f-ad95-1a2d1ce13b9d None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:20.829027 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9b4ea-e784-406f-ad95-1a2d1ce13b9d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:20.829305 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9b4ea-e784-406f-ad95-1a2d1ce13b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:20.837820 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a687e2-24fd-4805-9093-b73ff25c28fe None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:20.842533 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d1e21-de94-4f18-87c1-7b40a5fda3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:20.843923 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d1e21-de94-4f18-87c1-7b40a5fda3fb admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:20.844364 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d1e21-de94-4f18-87c1-7b40a5fda3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:20.844802 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d1e21-de94-4f18-87c1-7b40a5fda3fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:20.846141 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d1e21-de94-4f18-87c1-7b40a5fda3fb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:20.846590 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d1e21-de94-4f18-87c1-7b40a5fda3fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:20.848372 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d1e21-de94-4f18-87c1-7b40a5fda3fb admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:20.849753 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-03d9b4ea-e784-406f-ad95-1a2d1ce13b9d None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:20.851097 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-03d9b4ea-e784-406f-ad95-1a2d1ce13b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:20.860015 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 55/110] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:20.860792 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 56/111] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:20.865225 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9b4ea-e784-406f-ad95-1a2d1ce13b9d None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:20.872159 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d1e21-de94-4f18-87c1-7b40a5fda3fb admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:20.875749 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9b4ea-e784-406f-ad95-1a2d1ce13b9d None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:20.887512 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d1e21-de94-4f18-87c1-7b40a5fda3fb admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:20.888606 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f12bd8-61da-4336-8535-1c5d0c5b6cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:20.889542 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f12bd8-61da-4336-8535-1c5d0c5b6cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:20.889829 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f12bd8-61da-4336-8535-1c5d0c5b6cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:20.890106 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f12bd8-61da-4336-8535-1c5d0c5b6cd7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:20.899982 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaf0ea-6e20-437a-aafc-aab00eb692bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:20.901107 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f12bd8-61da-4336-8535-1c5d0c5b6cd7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:20.901681 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaf0ea-6e20-437a-aafc-aab00eb692bd admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:20.902206 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaf0ea-6e20-437a-aafc-aab00eb692bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:20.902695 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaf0ea-6e20-437a-aafc-aab00eb692bd admin admin] PATH_INFO: `/v3/users/149f2cba29a24507ab7090c3c8fa1691` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:20.904317 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfaf0ea-6e20-437a-aafc-aab00eb692bd admin admin] RBAC: Authorizing `identity:get_user(user_id=149f2cba29a24507ab7090c3c8fa1691)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:20.906957 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfaf0ea-6e20-437a-aafc-aab00eb692bd admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:20.908868 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 57/112] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:20 2022] GET /identity/v3/users/149f2cba29a24507ab7090c3c8fa1691 => generated 247 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:20.908970 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-07f12bd8-61da-4336-8535-1c5d0c5b6cd7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 09 04:27:20.910009 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaf0ea-6e20-437a-aafc-aab00eb692bd admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:20.914355 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 56/113] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Feb 9 04:27:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:20.916062 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f12bd8-61da-4336-8535-1c5d0c5b6cd7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:20.921680 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaf0ea-6e20-437a-aafc-aab00eb692bd admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:20.926616 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f12bd8-61da-4336-8535-1c5d0c5b6cd7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:20.927322 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da2065-b5e2-4cfc-a738-d6dacb1ff137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:20.928585 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da2065-b5e2-4cfc-a738-d6dacb1ff137 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:20.929179 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da2065-b5e2-4cfc-a738-d6dacb1ff137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:20.929709 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da2065-b5e2-4cfc-a738-d6dacb1ff137 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:20.931351 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735bbc11-85bd-4741-a027-ed12801645c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:20.932296 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bbc11-85bd-4741-a027-ed12801645c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:20.932642 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bbc11-85bd-4741-a027-ed12801645c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:20.932929 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bbc11-85bd-4741-a027-ed12801645c2 admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:20.934323 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735bbc11-85bd-4741-a027-ed12801645c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=635df70d95a247b1a0a172cbb183ba9b)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:20.937140 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735bbc11-85bd-4741-a027-ed12801645c2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:20.939194 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 57/114] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:20 2022] GET /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:20.942948 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da2065-b5e2-4cfc-a738-d6dacb1ff137 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:20.944389 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735bbc11-85bd-4741-a027-ed12801645c2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:20.950852 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-b4da2065-b5e2-4cfc-a738-d6dacb1ff137 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 09 04:27:20.953320 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 58/115] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:20.954248 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da2065-b5e2-4cfc-a738-d6dacb1ff137 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:20.955186 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735bbc11-85bd-4741-a027-ed12801645c2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:20.964287 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8804a2e-4cb8-4c1c-b328-f62af1448d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:20.965152 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8804a2e-4cb8-4c1c-b328-f62af1448d84 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:20.965603 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8804a2e-4cb8-4c1c-b328-f62af1448d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:20.965954 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8804a2e-4cb8-4c1c-b328-f62af1448d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:20.966870 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8804a2e-4cb8-4c1c-b328-f62af1448d84 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:20.967247 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8804a2e-4cb8-4c1c-b328-f62af1448d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:20.969522 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8804a2e-4cb8-4c1c-b328-f62af1448d84 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:20.972681 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da2065-b5e2-4cfc-a738-d6dacb1ff137 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:20.978643 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde1cc7-edf8-40bc-9a1f-3a724b63fac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:20.979253 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 58/116] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:27:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:20.980052 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde1cc7-edf8-40bc-9a1f-3a724b63fac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:20.980540 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde1cc7-edf8-40bc-9a1f-3a724b63fac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:20.980738 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8804a2e-4cb8-4c1c-b328-f62af1448d84 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:20.981347 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde1cc7-edf8-40bc-9a1f-3a724b63fac8 admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b/users/149f2cba29a24507ab7090c3c8fa1691/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:20.983850 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde1cc7-edf8-40bc-9a1f-3a724b63fac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=635df70d95a247b1a0a172cbb183ba9b, user_id=149f2cba29a24507ab7090c3c8fa1691, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:20.987139 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde1cc7-edf8-40bc-9a1f-3a724b63fac8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:20.991486 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8804a2e-4cb8-4c1c-b328-f62af1448d84 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:20.997890 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecbe97-7142-4eae-a680-1d09cb94904f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:20.999455 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecbe97-7142-4eae-a680-1d09cb94904f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:20.999894 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecbe97-7142-4eae-a680-1d09cb94904f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:21.000247 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecbe97-7142-4eae-a680-1d09cb94904f admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:21.001193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecbe97-7142-4eae-a680-1d09cb94904f admin admin] RBAC: Adding query filter params (name=member) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:21.001572 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecbe97-7142-4eae-a680-1d09cb94904f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:21.003725 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecbe97-7142-4eae-a680-1d09cb94904f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:21.005854 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 59/117] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:27:20 2022] PUT /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b/users/149f2cba29a24507ab7090c3c8fa1691/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:27:21.006961 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde1cc7-edf8-40bc-9a1f-3a724b63fac8 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:21.027611 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 59/118] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:21.032469 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecbe97-7142-4eae-a680-1d09cb94904f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:21.059562 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecbe97-7142-4eae-a680-1d09cb94904f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:21.117516 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde1cc7-edf8-40bc-9a1f-3a724b63fac8 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:21.123587 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34058e78-d4d8-4a23-acc3-02f3bbc4f90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:21.125484 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34058e78-d4d8-4a23-acc3-02f3bbc4f90c admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:21.126000 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34058e78-d4d8-4a23-acc3-02f3bbc4f90c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:21.126579 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34058e78-d4d8-4a23-acc3-02f3bbc4f90c admin admin] PATH_INFO: `/v3/users/635fa93bb3a84f3faefdeefe04d60128` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:21.134747 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34058e78-d4d8-4a23-acc3-02f3bbc4f90c admin admin] RBAC: Authorizing `identity:get_user(user_id=635fa93bb3a84f3faefdeefe04d60128)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:21.137722 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34058e78-d4d8-4a23-acc3-02f3bbc4f90c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:21.139865 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 60/119] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:21 2022] GET /identity/v3/users/635fa93bb3a84f3faefdeefe04d60128 => generated 275 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:21.145985 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34058e78-d4d8-4a23-acc3-02f3bbc4f90c admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:21.158596 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34058e78-d4d8-4a23-acc3-02f3bbc4f90c admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:21.164559 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0a6cd-b88f-4e81-91d0-7d7e94f3bc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:21.165876 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0a6cd-b88f-4e81-91d0-7d7e94f3bc1f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:21.166402 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0a6cd-b88f-4e81-91d0-7d7e94f3bc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:21.167408 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0a6cd-b88f-4e81-91d0-7d7e94f3bc1f admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:21.169150 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0a6cd-b88f-4e81-91d0-7d7e94f3bc1f admin admin] RBAC: Authorizing `identity:get_project(project_id=635df70d95a247b1a0a172cbb183ba9b)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:21.171704 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0a6cd-b88f-4e81-91d0-7d7e94f3bc1f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:21.173938 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 61/120] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:21 2022] GET /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:21.182448 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0a6cd-b88f-4e81-91d0-7d7e94f3bc1f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:21.198688 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0a6cd-b88f-4e81-91d0-7d7e94f3bc1f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:21.208024 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456203d-93ea-403c-b0e5-5bb4efbdb186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:21.209318 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456203d-93ea-403c-b0e5-5bb4efbdb186 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:21.209800 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456203d-93ea-403c-b0e5-5bb4efbdb186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:21.210324 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456203d-93ea-403c-b0e5-5bb4efbdb186 admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b/users/635fa93bb3a84f3faefdeefe04d60128/roles/850547f4dcf34a76a710ddaae9dc30de` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:21.212875 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456203d-93ea-403c-b0e5-5bb4efbdb186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=635df70d95a247b1a0a172cbb183ba9b, user_id=635fa93bb3a84f3faefdeefe04d60128, role_id=850547f4dcf34a76a710ddaae9dc30de)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:21.216063 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456203d-93ea-403c-b0e5-5bb4efbdb186 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:21.226467 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f928fa-d25e-44f6-9c34-c15521719c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:21.227439 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f928fa-d25e-44f6-9c34-c15521719c32 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:21.227766 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f928fa-d25e-44f6-9c34-c15521719c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:21.228086 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f928fa-d25e-44f6-9c34-c15521719c32 admin admin] PATH_INFO: `/v3/users/635fa93bb3a84f3faefdeefe04d60128` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:21.231274 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f928fa-d25e-44f6-9c34-c15521719c32 admin admin] RBAC: Authorizing `identity:get_user(user_id=635fa93bb3a84f3faefdeefe04d60128)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:21.233816 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f928fa-d25e-44f6-9c34-c15521719c32 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:21.240087 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 62/122] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:27:21 2022] PUT /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b/users/635fa93bb3a84f3faefdeefe04d60128/roles/850547f4dcf34a76a710ddaae9dc30de => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:27:21.240368 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 60/122] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:21 2022] GET /identity/v3/users/635fa93bb3a84f3faefdeefe04d60128 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:21.250205 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f928fa-d25e-44f6-9c34-c15521719c32 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:21.271654 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f928fa-d25e-44f6-9c34-c15521719c32 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:21.345255 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b6b8d-2015-4df5-864d-227f18a66415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:21.346203 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b6b8d-2015-4df5-864d-227f18a66415 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:21.346493 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b6b8d-2015-4df5-864d-227f18a66415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:21.346775 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b6b8d-2015-4df5-864d-227f18a66415 admin admin] PATH_INFO: `/v3/projects/bf1eb255931b467b8295cb9132e8092e` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:21.348136 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b6b8d-2015-4df5-864d-227f18a66415 admin admin] RBAC: Authorizing `identity:get_project(project_id=bf1eb255931b467b8295cb9132e8092e)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:21.350570 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b6b8d-2015-4df5-864d-227f18a66415 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:21.352489 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 61/123] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:21 2022] GET /identity/v3/projects/bf1eb255931b467b8295cb9132e8092e => generated 312 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:21.359169 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456203d-93ea-403c-b0e5-5bb4efbdb186 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:21.369899 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456203d-93ea-403c-b0e5-5bb4efbdb186 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:21.374733 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e94de1-156e-4290-ab6a-13b73a1f9c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:21.375740 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e94de1-156e-4290-ab6a-13b73a1f9c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:21.376084 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e94de1-156e-4290-ab6a-13b73a1f9c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:21.376364 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e94de1-156e-4290-ab6a-13b73a1f9c71 admin admin] PATH_INFO: `/v3/projects/bf1eb255931b467b8295cb9132e8092e/users/635fa93bb3a84f3faefdeefe04d60128/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:21.378420 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e94de1-156e-4290-ab6a-13b73a1f9c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf1eb255931b467b8295cb9132e8092e, user_id=635fa93bb3a84f3faefdeefe04d60128, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:21.381335 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e94de1-156e-4290-ab6a-13b73a1f9c71 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:21.399695 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 63/124] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:27:21 2022] PUT /identity/v3/projects/bf1eb255931b467b8295cb9132e8092e/users/635fa93bb3a84f3faefdeefe04d60128/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:27:22.389683 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5ddc6-f44f-4fdc-9cf7-4d7d89aa825c None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:22.390200 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5ddc6-f44f-4fdc-9cf7-4d7d89aa825c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:22.390284 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5ddc6-f44f-4fdc-9cf7-4d7d89aa825c None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:22.392379 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 62/125] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:22.397247 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2248d5-715d-4b45-8b2f-6ab3fd3ea70d None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:22.397683 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2248d5-715d-4b45-8b2f-6ab3fd3ea70d None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:22.397809 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2248d5-715d-4b45-8b2f-6ab3fd3ea70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:22.422005 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-1d2248d5-715d-4b45-8b2f-6ab3fd3ea70d None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:22.424083 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c65ca-b37a-4cf6-9a3f-998f06ecee63 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:22.424373 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c65ca-b37a-4cf6-9a3f-998f06ecee63 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:22.424653 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0c65ca-b37a-4cf6-9a3f-998f06ecee63 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:22.426435 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 63/126] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:27:22.427339 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-1d2248d5-715d-4b45-8b2f-6ab3fd3ea70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:22.431462 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6705bd-38b4-41d0-9f25-2b6c16e88d9e None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:22.431755 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6705bd-38b4-41d0-9f25-2b6c16e88d9e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:22.432038 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6705bd-38b4-41d0-9f25-2b6c16e88d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:22.466361 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2a6705bd-38b4-41d0-9f25-2b6c16e88d9e None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:22.468111 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2a6705bd-38b4-41d0-9f25-2b6c16e88d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:22.559245 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 64/127] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:22.562386 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 64/128] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 09 04:27:22.594501 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2248d5-715d-4b45-8b2f-6ab3fd3ea70d None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:22.607196 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6705bd-38b4-41d0-9f25-2b6c16e88d9e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:22.608210 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2248d5-715d-4b45-8b2f-6ab3fd3ea70d None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:22.622202 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24b712-cde1-43d2-b401-269857d9e6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:22.623066 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24b712-cde1-43d2-b401-269857d9e6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:22.623358 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24b712-cde1-43d2-b401-269857d9e6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:22.623637 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24b712-cde1-43d2-b401-269857d9e6c0 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:22.627404 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6705bd-38b4-41d0-9f25-2b6c16e88d9e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:22.639816 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc904a4c-3f31-40db-b19e-ef3fd078966d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:22.640558 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc904a4c-3f31-40db-b19e-ef3fd078966d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:22.640849 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc904a4c-3f31-40db-b19e-ef3fd078966d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:22.641148 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc904a4c-3f31-40db-b19e-ef3fd078966d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:22.646662 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc904a4c-3f31-40db-b19e-ef3fd078966d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:22.649090 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc904a4c-3f31-40db-b19e-ef3fd078966d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:22.651077 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 65/129] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:27:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:22.657295 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc904a4c-3f31-40db-b19e-ef3fd078966d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:22.658311 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc24b712-cde1-43d2-b401-269857d9e6c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:22.679481 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc904a4c-3f31-40db-b19e-ef3fd078966d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:22.686032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-cc24b712-cde1-43d2-b401-269857d9e6c0 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 09 04:27:22.687986 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 65/130] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:22.693168 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fee5c-d0df-4437-868a-cae9a1464cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:22.693855 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fee5c-d0df-4437-868a-cae9a1464cff admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:22.693952 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24b712-cde1-43d2-b401-269857d9e6c0 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:22.694145 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fee5c-d0df-4437-868a-cae9a1464cff admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:22.694426 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280fee5c-d0df-4437-868a-cae9a1464cff admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:22.695168 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280fee5c-d0df-4437-868a-cae9a1464cff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:22.699536 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280fee5c-d0df-4437-868a-cae9a1464cff admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:22.710887 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24b712-cde1-43d2-b401-269857d9e6c0 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:22.716659 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772d8df-97d9-4cc5-8b6d-77da50e4d63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:22.718166 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772d8df-97d9-4cc5-8b6d-77da50e4d63e admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:22.718665 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772d8df-97d9-4cc5-8b6d-77da50e4d63e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:22.719133 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772d8df-97d9-4cc5-8b6d-77da50e4d63e admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:22.720091 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772d8df-97d9-4cc5-8b6d-77da50e4d63e admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:22.720609 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772d8df-97d9-4cc5-8b6d-77da50e4d63e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:22.722456 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772d8df-97d9-4cc5-8b6d-77da50e4d63e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:22.740605 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 66/131] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:22.746017 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772d8df-97d9-4cc5-8b6d-77da50e4d63e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:22.759830 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 66/132] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Feb 9 04:27:22 2022] POST /identity/v3/projects => generated 302 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:27:22.762989 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772d8df-97d9-4cc5-8b6d-77da50e4d63e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:22.847776 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0285e2-1703-479c-bf68-e7192dcbdd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:22.849056 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0285e2-1703-479c-bf68-e7192dcbdd97 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:22.849562 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0285e2-1703-479c-bf68-e7192dcbdd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:22.850029 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0285e2-1703-479c-bf68-e7192dcbdd97 admin admin] PATH_INFO: `/v3/users/ed6161643e37428fbbdcfd020d36c823` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:22.873086 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0285e2-1703-479c-bf68-e7192dcbdd97 admin admin] RBAC: Authorizing `identity:get_user(user_id=ed6161643e37428fbbdcfd020d36c823)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:22.875745 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0285e2-1703-479c-bf68-e7192dcbdd97 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:22.878459 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 67/133] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:22 2022] GET /identity/v3/users/ed6161643e37428fbbdcfd020d36c823 => generated 289 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:22.883850 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fee5c-d0df-4437-868a-cae9a1464cff admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:22.906413 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280fee5c-d0df-4437-868a-cae9a1464cff admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:22.911695 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166c0d8-b92c-4e5c-b002-d280a72cad6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:22.912364 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166c0d8-b92c-4e5c-b002-d280a72cad6a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:22.912655 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166c0d8-b92c-4e5c-b002-d280a72cad6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:22.913241 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166c0d8-b92c-4e5c-b002-d280a72cad6a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:22.925835 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166c0d8-b92c-4e5c-b002-d280a72cad6a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:22.927690 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166c0d8-b92c-4e5c-b002-d280a72cad6a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:22.941429 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 67/134] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:22.947166 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0285e2-1703-479c-bf68-e7192dcbdd97 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:22.962384 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0285e2-1703-479c-bf68-e7192dcbdd97 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:22.967295 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce34b16-9498-479d-88ff-68eed46cf9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:22.968539 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce34b16-9498-479d-88ff-68eed46cf9aa admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:22.969049 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce34b16-9498-479d-88ff-68eed46cf9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:22.969520 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce34b16-9498-479d-88ff-68eed46cf9aa admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:22.970972 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce34b16-9498-479d-88ff-68eed46cf9aa admin admin] RBAC: Authorizing `identity:get_project(project_id=635df70d95a247b1a0a172cbb183ba9b)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:22.977429 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce34b16-9498-479d-88ff-68eed46cf9aa admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:22.979697 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 68/135] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:22 2022] GET /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:22.986269 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166c0d8-b92c-4e5c-b002-d280a72cad6a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:22.996091 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166c0d8-b92c-4e5c-b002-d280a72cad6a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:23.010886 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12075511-012e-4c1c-b377-8ab889dec371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:23.011578 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12075511-012e-4c1c-b377-8ab889dec371 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:23.011866 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12075511-012e-4c1c-b377-8ab889dec371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:23.012147 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12075511-012e-4c1c-b377-8ab889dec371 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:23.013035 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12075511-012e-4c1c-b377-8ab889dec371 admin admin] RBAC: Adding query filter params (role.id=25d1ad8b112c4326a3a8e579f24a6d75, scope.project.id=635df70d95a247b1a0a172cbb183ba9b, user.id=ed6161643e37428fbbdcfd020d36c823) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:23.013358 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12075511-012e-4c1c-b377-8ab889dec371 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:23.015370 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12075511-012e-4c1c-b377-8ab889dec371 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:23.021812 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 68/136] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:27:22 2022] GET /identity/v3/role_assignments?user.id=ed6161643e37428fbbdcfd020d36c823&scope.project.id=635df70d95a247b1a0a172cbb183ba9b&role.id=25d1ad8b112c4326a3a8e579f24a6d75 => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:23.998049 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481f0ee-523f-4d4c-a83e-bff6c0d05e98 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:23.999200 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481f0ee-523f-4d4c-a83e-bff6c0d05e98 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:23.999200 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481f0ee-523f-4d4c-a83e-bff6c0d05e98 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.001027 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 69/137] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:24.006994 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327b324-dd8c-4fe3-ac2f-f67632ed2b04 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.007468 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327b324-dd8c-4fe3-ac2f-f67632ed2b04 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.007549 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327b324-dd8c-4fe3-ac2f-f67632ed2b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.034278 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-3327b324-dd8c-4fe3-ac2f-f67632ed2b04 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:24.035517 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3327b324-dd8c-4fe3-ac2f-f67632ed2b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:24.047666 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 69/138] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:24.092979 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481f0ee-523f-4d4c-a83e-bff6c0d05e98 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:24.110534 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481f0ee-523f-4d4c-a83e-bff6c0d05e98 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:24.115300 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c505a8-c60d-4214-83f0-226ce9605a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:24.116094 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c505a8-c60d-4214-83f0-226ce9605a82 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.116411 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c505a8-c60d-4214-83f0-226ce9605a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.116659 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c505a8-c60d-4214-83f0-226ce9605a82 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.134603 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c505a8-c60d-4214-83f0-226ce9605a82 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:24.142488 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-13c505a8-c60d-4214-83f0-226ce9605a82 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 09 04:27:24.144107 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 70/139] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:24.149993 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327b324-dd8c-4fe3-ac2f-f67632ed2b04 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:24.159677 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327b324-dd8c-4fe3-ac2f-f67632ed2b04 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:24.172362 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad188e-6a91-41e8-9de2-93f21e8682d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:24.173406 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad188e-6a91-41e8-9de2-93f21e8682d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.173701 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad188e-6a91-41e8-9de2-93f21e8682d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.173985 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad188e-6a91-41e8-9de2-93f21e8682d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.174777 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad188e-6a91-41e8-9de2-93f21e8682d7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:24.175088 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad188e-6a91-41e8-9de2-93f21e8682d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:24.176756 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad188e-6a91-41e8-9de2-93f21e8682d7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:24.191932 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 70/140] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:24.197507 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c505a8-c60d-4214-83f0-226ce9605a82 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:24.214064 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c505a8-c60d-4214-83f0-226ce9605a82 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:24.221104 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d952050-18a5-4cd9-b0ba-3dfa2b1e48c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:24.221980 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d952050-18a5-4cd9-b0ba-3dfa2b1e48c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.222268 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d952050-18a5-4cd9-b0ba-3dfa2b1e48c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.222556 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d952050-18a5-4cd9-b0ba-3dfa2b1e48c0 admin admin] PATH_INFO: `/v3/users/635fa93bb3a84f3faefdeefe04d60128` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.223784 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d952050-18a5-4cd9-b0ba-3dfa2b1e48c0 admin admin] RBAC: Authorizing `identity:get_user(user_id=635fa93bb3a84f3faefdeefe04d60128)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:24.225997 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d952050-18a5-4cd9-b0ba-3dfa2b1e48c0 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:24.227921 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 71/141] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:24 2022] GET /identity/v3/users/635fa93bb3a84f3faefdeefe04d60128 => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:24.233735 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad188e-6a91-41e8-9de2-93f21e8682d7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:24.243512 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad188e-6a91-41e8-9de2-93f21e8682d7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:24.253548 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd808a-8640-4955-a38a-da64e61924d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:24.254146 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd808a-8640-4955-a38a-da64e61924d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.254441 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd808a-8640-4955-a38a-da64e61924d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.254721 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd808a-8640-4955-a38a-da64e61924d7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.265284 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd808a-8640-4955-a38a-da64e61924d7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:24.267081 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd808a-8640-4955-a38a-da64e61924d7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:24.282683 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 71/142] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:24.288694 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d952050-18a5-4cd9-b0ba-3dfa2b1e48c0 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:24.305981 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d952050-18a5-4cd9-b0ba-3dfa2b1e48c0 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:24.313114 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7c640-b22f-4896-89e3-b6a4ab2bfcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:24.313977 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7c640-b22f-4896-89e3-b6a4ab2bfcd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.314267 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7c640-b22f-4896-89e3-b6a4ab2bfcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.314547 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7c640-b22f-4896-89e3-b6a4ab2bfcd4 admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.315757 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7c640-b22f-4896-89e3-b6a4ab2bfcd4 admin admin] RBAC: Authorizing `identity:get_project(project_id=635df70d95a247b1a0a172cbb183ba9b)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:24.317882 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f7c640-b22f-4896-89e3-b6a4ab2bfcd4 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:24.319574 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 72/143] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:24 2022] GET /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:24.325488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd808a-8640-4955-a38a-da64e61924d7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:24.339457 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd808a-8640-4955-a38a-da64e61924d7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:24.344708 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efcc75-e3f7-4eae-9d97-f07d7a440838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:24.345410 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efcc75-e3f7-4eae-9d97-f07d7a440838 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.345698 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efcc75-e3f7-4eae-9d97-f07d7a440838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.345988 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efcc75-e3f7-4eae-9d97-f07d7a440838 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.346833 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efcc75-e3f7-4eae-9d97-f07d7a440838 admin admin] RBAC: Adding query filter params (role.id=102f883957d846419d33ce22fdec0cce, scope.project.id=635df70d95a247b1a0a172cbb183ba9b, user.id=635fa93bb3a84f3faefdeefe04d60128) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:24.347150 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efcc75-e3f7-4eae-9d97-f07d7a440838 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:24.349056 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efcc75-e3f7-4eae-9d97-f07d7a440838 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:24.359665 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 72/144] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:27:24 2022] GET /identity/v3/role_assignments?user.id=635fa93bb3a84f3faefdeefe04d60128&scope.project.id=635df70d95a247b1a0a172cbb183ba9b&role.id=102f883957d846419d33ce22fdec0cce => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:24.453582 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f1e60-bf14-4fd5-a44b-497fc4228f4c None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.453916 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f1e60-bf14-4fd5-a44b-497fc4228f4c None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.454146 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f1e60-bf14-4fd5-a44b-497fc4228f4c None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.455972 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 73/145] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:24.461998 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5210ac-be13-4ca9-81b1-b74d5d0cc21c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.462277 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5210ac-be13-4ca9-81b1-b74d5d0cc21c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.462563 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5210ac-be13-4ca9-81b1-b74d5d0cc21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.490300 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-8a5210ac-be13-4ca9-81b1-b74d5d0cc21c None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:24.491535 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8a5210ac-be13-4ca9-81b1-b74d5d0cc21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:24.499556 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 73/146] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:24.530410 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f1e60-bf14-4fd5-a44b-497fc4228f4c None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:24.547777 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f1e60-bf14-4fd5-a44b-497fc4228f4c None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:24.554592 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b990e-c056-450b-a595-40da17805220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:24.555440 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b990e-c056-450b-a595-40da17805220 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.555726 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b990e-c056-450b-a595-40da17805220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.556010 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b990e-c056-450b-a595-40da17805220 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.581756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b990e-c056-450b-a595-40da17805220 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:24.589457 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-739b990e-c056-450b-a595-40da17805220 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 09 04:27:24.590749 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 74/147] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Feb 9 04:27:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:24.597430 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5210ac-be13-4ca9-81b1-b74d5d0cc21c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:24.607132 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5210ac-be13-4ca9-81b1-b74d5d0cc21c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:24.615751 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b19bf5-aa96-4898-82e2-0876c84a7950 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.616102 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b19bf5-aa96-4898-82e2-0876c84a7950 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.616424 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b19bf5-aa96-4898-82e2-0876c84a7950 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.617898 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a2f81-4b53-4329-b885-514f56d0cdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:24.618525 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 75/148] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:27:24.618691 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a2f81-4b53-4329-b885-514f56d0cdbe admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.618936 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a2f81-4b53-4329-b885-514f56d0cdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.619224 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a2f81-4b53-4329-b885-514f56d0cdbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.620139 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a2f81-4b53-4329-b885-514f56d0cdbe admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:24.620455 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a2f81-4b53-4329-b885-514f56d0cdbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:24.622162 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a2f81-4b53-4329-b885-514f56d0cdbe admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:24.624559 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e6e90-73f5-44d6-b220-77a083153a1a None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.624851 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e6e90-73f5-44d6-b220-77a083153a1a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.625164 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e6e90-73f5-44d6-b220-77a083153a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.638913 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 74/149] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:27:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:24.641395 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a2f81-4b53-4329-b885-514f56d0cdbe admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:24.652608 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a2f81-4b53-4329-b885-514f56d0cdbe admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:24.660776 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-680e6e90-73f5-44d6-b220-77a083153a1a None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:24.662062 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-680e6e90-73f5-44d6-b220-77a083153a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:24.670449 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfcd1f5-70ab-407d-ac52-ffcd6123a733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:24.671392 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcd1f5-70ab-407d-ac52-ffcd6123a733 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.671776 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcd1f5-70ab-407d-ac52-ffcd6123a733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.672061 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfcd1f5-70ab-407d-ac52-ffcd6123a733 admin admin] PATH_INFO: `/v3/users/635fa93bb3a84f3faefdeefe04d60128` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.673316 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfcd1f5-70ab-407d-ac52-ffcd6123a733 admin admin] RBAC: Authorizing `identity:get_user(user_id=635fa93bb3a84f3faefdeefe04d60128)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:24.675488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfcd1f5-70ab-407d-ac52-ffcd6123a733 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:24.677307 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 75/150] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:24 2022] GET /identity/v3/users/635fa93bb3a84f3faefdeefe04d60128 => generated 275 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:24.684374 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfcd1f5-70ab-407d-ac52-ffcd6123a733 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:24.685916 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 76/151] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 09 04:27:24.699918 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfcd1f5-70ab-407d-ac52-ffcd6123a733 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:24.706529 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bacad5-0946-4346-9302-09ba43c76c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:24.707175 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bacad5-0946-4346-9302-09ba43c76c03 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.707509 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bacad5-0946-4346-9302-09ba43c76c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.707786 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bacad5-0946-4346-9302-09ba43c76c03 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.711446 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e6e90-73f5-44d6-b220-77a083153a1a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:24.725884 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e6e90-73f5-44d6-b220-77a083153a1a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:24.727241 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bacad5-0946-4346-9302-09ba43c76c03 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:24.729063 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bacad5-0946-4346-9302-09ba43c76c03 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:24.739022 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc5d29-6bae-4377-9dd3-ac36580e3022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:24.739831 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc5d29-6bae-4377-9dd3-ac36580e3022 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.740291 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc5d29-6bae-4377-9dd3-ac36580e3022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.740583 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc5d29-6bae-4377-9dd3-ac36580e3022 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.745465 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 76/152] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:24.757484 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc5d29-6bae-4377-9dd3-ac36580e3022 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:24.764962 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-4dfc5d29-6bae-4377-9dd3-ac36580e3022 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:27:24.766211 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 77/153] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:27:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:24.770080 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bacad5-0946-4346-9302-09ba43c76c03 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:24.777443 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc5d29-6bae-4377-9dd3-ac36580e3022 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:24.781946 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bacad5-0946-4346-9302-09ba43c76c03 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:24.787517 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc5d29-6bae-4377-9dd3-ac36580e3022 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:24.788527 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f5bdc-055e-4d43-9b40-8e11ed77ca0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:24.789409 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f5bdc-055e-4d43-9b40-8e11ed77ca0d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.789693 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f5bdc-055e-4d43-9b40-8e11ed77ca0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.789972 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f5bdc-055e-4d43-9b40-8e11ed77ca0d admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.791536 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f5bdc-055e-4d43-9b40-8e11ed77ca0d admin admin] RBAC: Authorizing `identity:get_project(project_id=635df70d95a247b1a0a172cbb183ba9b)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:24.794101 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f5bdc-055e-4d43-9b40-8e11ed77ca0d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:24.795977 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 77/154] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:24 2022] GET /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:24.802557 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed40ce0-85eb-4978-ab1e-b0d21661613e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:24.803229 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed40ce0-85eb-4978-ab1e-b0d21661613e admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.803517 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed40ce0-85eb-4978-ab1e-b0d21661613e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.803792 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed40ce0-85eb-4978-ab1e-b0d21661613e admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.804567 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed40ce0-85eb-4978-ab1e-b0d21661613e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:24.804873 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed40ce0-85eb-4978-ab1e-b0d21661613e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:24.806546 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed40ce0-85eb-4978-ab1e-b0d21661613e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:24.810220 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f5bdc-055e-4d43-9b40-8e11ed77ca0d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:24.818251 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 78/155] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:24.824190 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed40ce0-85eb-4978-ab1e-b0d21661613e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:24.831767 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f5bdc-055e-4d43-9b40-8e11ed77ca0d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:24.841407 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454d973-646e-402b-875a-2168fbd8c973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:24.842442 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed40ce0-85eb-4978-ab1e-b0d21661613e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:24.843218 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454d973-646e-402b-875a-2168fbd8c973 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.843573 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454d973-646e-402b-875a-2168fbd8c973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.844130 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454d973-646e-402b-875a-2168fbd8c973 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.845973 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454d973-646e-402b-875a-2168fbd8c973 admin admin] RBAC: Adding query filter params (role.id=850547f4dcf34a76a710ddaae9dc30de, scope.project.id=635df70d95a247b1a0a172cbb183ba9b, user.id=635fa93bb3a84f3faefdeefe04d60128) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:24.847089 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454d973-646e-402b-875a-2168fbd8c973 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:24.851389 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454d973-646e-402b-875a-2168fbd8c973 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:24.852516 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7ddec-709e-40f0-a961-97420106845e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:24.854180 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7ddec-709e-40f0-a961-97420106845e admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.854796 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7ddec-709e-40f0-a961-97420106845e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.855526 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7ddec-709e-40f0-a961-97420106845e admin admin] PATH_INFO: `/v3/users/149f2cba29a24507ab7090c3c8fa1691` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.859857 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7ddec-709e-40f0-a961-97420106845e admin admin] RBAC: Authorizing `identity:get_user(user_id=149f2cba29a24507ab7090c3c8fa1691)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:24.863340 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 78/156] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:27:24 2022] GET /identity/v3/role_assignments?user.id=635fa93bb3a84f3faefdeefe04d60128&scope.project.id=635df70d95a247b1a0a172cbb183ba9b&role.id=850547f4dcf34a76a710ddaae9dc30de => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:24.864117 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7ddec-709e-40f0-a961-97420106845e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:24.865876 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 79/157] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:24 2022] GET /identity/v3/users/149f2cba29a24507ab7090c3c8fa1691 => generated 247 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:24.874792 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454d973-646e-402b-875a-2168fbd8c973 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:24.885732 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454d973-646e-402b-875a-2168fbd8c973 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:24.894043 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d982e-24cc-40ba-8ca5-ab5ab7ca0020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:24.894794 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d982e-24cc-40ba-8ca5-ab5ab7ca0020 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.895077 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d982e-24cc-40ba-8ca5-ab5ab7ca0020 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.895357 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d982e-24cc-40ba-8ca5-ab5ab7ca0020 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.907176 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d982e-24cc-40ba-8ca5-ab5ab7ca0020 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:24.909559 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d982e-24cc-40ba-8ca5-ab5ab7ca0020 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:24.919869 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 79/158] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:24.926375 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7ddec-709e-40f0-a961-97420106845e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:24.936857 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf95c3-3b2a-4e08-9fa2-f2d5a3f370f9 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.936857 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf95c3-3b2a-4e08-9fa2-f2d5a3f370f9 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.936857 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf95c3-3b2a-4e08-9fa2-f2d5a3f370f9 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.936857 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 80/159] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:24.941742 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7ddec-709e-40f0-a961-97420106845e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:24.944239 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f921a1-34b6-4b09-8352-cf6e9583ab9f None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.944239 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f921a1-34b6-4b09-8352-cf6e9583ab9f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.944239 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f921a1-34b6-4b09-8352-cf6e9583ab9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.951718 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51258daa-e15f-4073-a10c-445d9946e0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:24.952693 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51258daa-e15f-4073-a10c-445d9946e0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.953055 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51258daa-e15f-4073-a10c-445d9946e0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.953345 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51258daa-e15f-4073-a10c-445d9946e0d3 admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.956534 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51258daa-e15f-4073-a10c-445d9946e0d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=635df70d95a247b1a0a172cbb183ba9b)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:24.959998 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51258daa-e15f-4073-a10c-445d9946e0d3 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:24.962076 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 80/160] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:24 2022] GET /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:24.969731 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51258daa-e15f-4073-a10c-445d9946e0d3 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:24.978160 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-c8f921a1-34b6-4b09-8352-cf6e9583ab9f None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:24.979752 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c8f921a1-34b6-4b09-8352-cf6e9583ab9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:24.983136 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51258daa-e15f-4073-a10c-445d9946e0d3 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:24.991134 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cba77-f06b-47c6-8d73-1994944ea040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:24.991865 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cba77-f06b-47c6-8d73-1994944ea040 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:24.992174 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cba77-f06b-47c6-8d73-1994944ea040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:24.992482 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cba77-f06b-47c6-8d73-1994944ea040 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:24.993450 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7cba77-f06b-47c6-8d73-1994944ea040 admin admin] RBAC: Adding query filter params (role.id=05ca9a16ef2a450b8cc73ade47f5c7d0, scope.project.id=635df70d95a247b1a0a172cbb183ba9b, user.id=149f2cba29a24507ab7090c3c8fa1691) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:24.993817 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7cba77-f06b-47c6-8d73-1994944ea040 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:24.995891 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7cba77-f06b-47c6-8d73-1994944ea040 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:25.003169 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 81/161] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 09 04:27:25.003724 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 81/162] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:27:24 2022] GET /identity/v3/role_assignments?user.id=149f2cba29a24507ab7090c3c8fa1691&scope.project.id=635df70d95a247b1a0a172cbb183ba9b&role.id=05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:25.043619 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f921a1-34b6-4b09-8352-cf6e9583ab9f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:25.064250 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f921a1-34b6-4b09-8352-cf6e9583ab9f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:25.075941 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c33b23-1a4f-4760-9766-d808a2fcd421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:25.077347 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c33b23-1a4f-4760-9766-d808a2fcd421 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:25.077638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c33b23-1a4f-4760-9766-d808a2fcd421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:25.077916 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c33b23-1a4f-4760-9766-d808a2fcd421 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:25.092116 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c33b23-1a4f-4760-9766-d808a2fcd421 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:25.100771 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-a3c33b23-1a4f-4760-9766-d808a2fcd421 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 09 04:27:25.100771 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 82/163] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:25.109097 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cba77-f06b-47c6-8d73-1994944ea040 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:25.119422 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cba77-f06b-47c6-8d73-1994944ea040 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:25.126138 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d4d39-38b1-4e49-9c3a-80aacea18070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:25.127158 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d4d39-38b1-4e49-9c3a-80aacea18070 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:25.127642 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d4d39-38b1-4e49-9c3a-80aacea18070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:25.128138 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d4d39-38b1-4e49-9c3a-80aacea18070 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:25.129199 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d4d39-38b1-4e49-9c3a-80aacea18070 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:25.129709 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d4d39-38b1-4e49-9c3a-80aacea18070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:25.132730 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d4d39-38b1-4e49-9c3a-80aacea18070 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:25.143300 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 82/164] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:25.150898 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c33b23-1a4f-4760-9766-d808a2fcd421 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:25.170817 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c33b23-1a4f-4760-9766-d808a2fcd421 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:25.183524 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a383db3-7d04-4bee-bc20-724807d6170c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:25.184435 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a383db3-7d04-4bee-bc20-724807d6170c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:25.184720 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a383db3-7d04-4bee-bc20-724807d6170c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:25.185232 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a383db3-7d04-4bee-bc20-724807d6170c admin admin] PATH_INFO: `/v3/users/635fa93bb3a84f3faefdeefe04d60128` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:25.187955 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a383db3-7d04-4bee-bc20-724807d6170c admin admin] RBAC: Authorizing `identity:get_user(user_id=635fa93bb3a84f3faefdeefe04d60128)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:25.191499 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a383db3-7d04-4bee-bc20-724807d6170c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:25.193331 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 83/165] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:25 2022] GET /identity/v3/users/635fa93bb3a84f3faefdeefe04d60128 => generated 275 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:25.203201 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d4d39-38b1-4e49-9c3a-80aacea18070 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:25.215287 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d4d39-38b1-4e49-9c3a-80aacea18070 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:25.222835 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ce075-d0f9-4a22-8930-5dc3911b4a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:25.223486 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce075-d0f9-4a22-8930-5dc3911b4a38 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:25.223821 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce075-d0f9-4a22-8930-5dc3911b4a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:25.224099 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ce075-d0f9-4a22-8930-5dc3911b4a38 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:25.235430 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ce075-d0f9-4a22-8930-5dc3911b4a38 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:25.237344 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ce075-d0f9-4a22-8930-5dc3911b4a38 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:25.247451 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 83/166] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:25.253185 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a383db3-7d04-4bee-bc20-724807d6170c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:25.266176 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a383db3-7d04-4bee-bc20-724807d6170c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:25.271137 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62d68a-7185-4fc0-9711-6f1a13b2f8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:25.272005 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62d68a-7185-4fc0-9711-6f1a13b2f8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:25.272287 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62d68a-7185-4fc0-9711-6f1a13b2f8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:25.272562 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62d68a-7185-4fc0-9711-6f1a13b2f8f7 admin admin] PATH_INFO: `/v3/projects/bf1eb255931b467b8295cb9132e8092e` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:25.273779 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62d68a-7185-4fc0-9711-6f1a13b2f8f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=bf1eb255931b467b8295cb9132e8092e)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:25.275867 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62d68a-7185-4fc0-9711-6f1a13b2f8f7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:25.277576 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 84/167] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:25 2022] GET /identity/v3/projects/bf1eb255931b467b8295cb9132e8092e => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:25.284066 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ce075-d0f9-4a22-8930-5dc3911b4a38 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:25.295616 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ce075-d0f9-4a22-8930-5dc3911b4a38 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:25.300758 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c7aad-bd2f-4828-a907-0be42d77ffe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:25.301445 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c7aad-bd2f-4828-a907-0be42d77ffe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:25.301731 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c7aad-bd2f-4828-a907-0be42d77ffe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:25.302015 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c7aad-bd2f-4828-a907-0be42d77ffe8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:25.302864 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c7aad-bd2f-4828-a907-0be42d77ffe8 admin admin] RBAC: Adding query filter params (role.id=102f883957d846419d33ce22fdec0cce, scope.project.id=bf1eb255931b467b8295cb9132e8092e, user.id=635fa93bb3a84f3faefdeefe04d60128) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:25.303178 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c7aad-bd2f-4828-a907-0be42d77ffe8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:25.305074 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c7aad-bd2f-4828-a907-0be42d77ffe8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:25.314984 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 84/168] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:27:25 2022] GET /identity/v3/role_assignments?user.id=635fa93bb3a84f3faefdeefe04d60128&scope.project.id=bf1eb255931b467b8295cb9132e8092e&role.id=102f883957d846419d33ce22fdec0cce => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:26.161642 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cfbfe-6001-4a76-848c-3b2af8826c56 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:26.162153 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cfbfe-6001-4a76-848c-3b2af8826c56 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:26.162258 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cfbfe-6001-4a76-848c-3b2af8826c56 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:26.164189 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 85/169] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:26.169463 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d26241-b86c-4bb4-bbd1-dba8d89918fb None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:26.169853 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d26241-b86c-4bb4-bbd1-dba8d89918fb None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:26.170020 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d26241-b86c-4bb4-bbd1-dba8d89918fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:26.189261 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-31d26241-b86c-4bb4-bbd1-dba8d89918fb None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:26.190433 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-31d26241-b86c-4bb4-bbd1-dba8d89918fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:26.197791 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 85/170] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:26.220957 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cfbfe-6001-4a76-848c-3b2af8826c56 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:26.232808 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cfbfe-6001-4a76-848c-3b2af8826c56 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:26.237778 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b9e2f-7b67-4bac-86f5-08ae97e9a381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:26.238546 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b9e2f-7b67-4bac-86f5-08ae97e9a381 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:26.238822 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b9e2f-7b67-4bac-86f5-08ae97e9a381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:26.239091 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b9e2f-7b67-4bac-86f5-08ae97e9a381 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:26.249126 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b9e2f-7b67-4bac-86f5-08ae97e9a381 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:26.255877 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-1d3b9e2f-7b67-4bac-86f5-08ae97e9a381 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 09 04:27:26.257048 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 86/171] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:26.262561 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d26241-b86c-4bb4-bbd1-dba8d89918fb None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:26.271280 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d26241-b86c-4bb4-bbd1-dba8d89918fb None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:26.275557 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5a1d4-a680-4b6b-91f7-95130e012b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:26.276268 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5a1d4-a680-4b6b-91f7-95130e012b55 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:26.276637 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5a1d4-a680-4b6b-91f7-95130e012b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:26.276911 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5a1d4-a680-4b6b-91f7-95130e012b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:26.277699 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5a1d4-a680-4b6b-91f7-95130e012b55 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:26.278000 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5a1d4-a680-4b6b-91f7-95130e012b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:26.279587 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5a1d4-a680-4b6b-91f7-95130e012b55 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:26.288363 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 86/172] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:26.293478 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b9e2f-7b67-4bac-86f5-08ae97e9a381 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:26.302807 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b9e2f-7b67-4bac-86f5-08ae97e9a381 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:26.306963 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bf64a-e5f6-4045-945d-761b46c766e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:26.307794 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bf64a-e5f6-4045-945d-761b46c766e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:26.308072 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bf64a-e5f6-4045-945d-761b46c766e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:26.308340 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bf64a-e5f6-4045-945d-761b46c766e9 admin admin] PATH_INFO: `/v3/users/ed6161643e37428fbbdcfd020d36c823` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:26.309576 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bf64a-e5f6-4045-945d-761b46c766e9 admin admin] RBAC: Authorizing `identity:get_user(user_id=ed6161643e37428fbbdcfd020d36c823)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:26.312231 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979bf64a-e5f6-4045-945d-761b46c766e9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:26.313806 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 87/173] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:26 2022] GET /identity/v3/users/ed6161643e37428fbbdcfd020d36c823 => generated 289 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:26.318951 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5a1d4-a680-4b6b-91f7-95130e012b55 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:26.328804 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5a1d4-a680-4b6b-91f7-95130e012b55 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:26.332944 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841ba2b-1ea4-4bce-b90c-2296a976d3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:26.333808 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841ba2b-1ea4-4bce-b90c-2296a976d3fe admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:26.334085 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841ba2b-1ea4-4bce-b90c-2296a976d3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:26.334350 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841ba2b-1ea4-4bce-b90c-2296a976d3fe admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:26.335546 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841ba2b-1ea4-4bce-b90c-2296a976d3fe admin admin] RBAC: Authorizing `identity:get_project(project_id=635df70d95a247b1a0a172cbb183ba9b)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:26.336724 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef98d54-0c95-49d4-8102-8d7e8971c525 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:26.337032 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef98d54-0c95-49d4-8102-8d7e8971c525 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:26.337331 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef98d54-0c95-49d4-8102-8d7e8971c525 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:26.337591 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841ba2b-1ea4-4bce-b90c-2296a976d3fe admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:26.339063 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 88/174] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:27:26.339253 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 87/175] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:26 2022] GET /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:26.344275 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fbd11-3cf5-4432-be6c-cdb3092d7a39 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:26.344566 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fbd11-3cf5-4432-be6c-cdb3092d7a39 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:26.344843 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841ba2b-1ea4-4bce-b90c-2296a976d3fe admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:26.344941 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fbd11-3cf5-4432-be6c-cdb3092d7a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:26.354070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841ba2b-1ea4-4bce-b90c-2296a976d3fe admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:26.358835 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf44496-88e5-4f15-a132-dda0c8e9759d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:26.359670 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf44496-88e5-4f15-a132-dda0c8e9759d admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:26.359949 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf44496-88e5-4f15-a132-dda0c8e9759d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:26.360220 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf44496-88e5-4f15-a132-dda0c8e9759d admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b/users/ed6161643e37428fbbdcfd020d36c823/roles/25d1ad8b112c4326a3a8e579f24a6d75` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:26.362175 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf44496-88e5-4f15-a132-dda0c8e9759d admin admin] RBAC: Authorizing `identity:create_grant(project_id=635df70d95a247b1a0a172cbb183ba9b, user_id=ed6161643e37428fbbdcfd020d36c823, role_id=25d1ad8b112c4326a3a8e579f24a6d75)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:26.362631 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-5e8fbd11-3cf5-4432-be6c-cdb3092d7a39 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:26.363802 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5e8fbd11-3cf5-4432-be6c-cdb3092d7a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:26.364794 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf44496-88e5-4f15-a132-dda0c8e9759d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:26.371615 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 89/176] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:26.378325 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 88/177] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:27:26 2022] PUT /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b/users/ed6161643e37428fbbdcfd020d36c823/roles/25d1ad8b112c4326a3a8e579f24a6d75 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:27:26.399810 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fbd11-3cf5-4432-be6c-cdb3092d7a39 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:26.409894 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fbd11-3cf5-4432-be6c-cdb3092d7a39 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:26.466715 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a269f1-671a-4b3a-9a59-4305cd92b4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:26.467923 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a269f1-671a-4b3a-9a59-4305cd92b4ad admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:26.468202 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a269f1-671a-4b3a-9a59-4305cd92b4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:26.468474 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a269f1-671a-4b3a-9a59-4305cd92b4ad admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:26.469702 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a269f1-671a-4b3a-9a59-4305cd92b4ad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:26.471451 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a269f1-671a-4b3a-9a59-4305cd92b4ad admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:26.473117 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 90/178] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:27:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:26.478731 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf44496-88e5-4f15-a132-dda0c8e9759d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:26.489506 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf44496-88e5-4f15-a132-dda0c8e9759d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:26.493844 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd9938-f8e4-4946-862a-f073d842b6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:26.494521 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd9938-f8e4-4946-862a-f073d842b6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:26.494802 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd9938-f8e4-4946-862a-f073d842b6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:26.495071 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd9938-f8e4-4946-862a-f073d842b6d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:26.495822 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd9938-f8e4-4946-862a-f073d842b6d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:26.497803 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd9938-f8e4-4946-862a-f073d842b6d0 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:26.518545 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 89/179] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Feb 9 04:27:26 2022] POST /identity/v3/users => generated 283 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:27:28.594441 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6e2a1-3e55-4522-9cc7-6f4bb02dc738 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:28.594978 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6e2a1-3e55-4522-9cc7-6f4bb02dc738 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:28.594978 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6e2a1-3e55-4522-9cc7-6f4bb02dc738 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:28.596864 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 91/180] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:28.602931 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c62408-d33a-4e3a-a465-bcc2d4f7c2b7 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:28.603919 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c62408-d33a-4e3a-a465-bcc2d4f7c2b7 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:28.604389 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c62408-d33a-4e3a-a465-bcc2d4f7c2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:28.622977 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-b4c62408-d33a-4e3a-a465-bcc2d4f7c2b7 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:28.625029 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-b4c62408-d33a-4e3a-a465-bcc2d4f7c2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:28.632784 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 90/181] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:28.656557 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6e2a1-3e55-4522-9cc7-6f4bb02dc738 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:28.669253 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6e2a1-3e55-4522-9cc7-6f4bb02dc738 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:28.673886 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e87c0-7a56-4abd-9928-68e17cd49225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:28.674914 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e87c0-7a56-4abd-9928-68e17cd49225 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:28.675405 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e87c0-7a56-4abd-9928-68e17cd49225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:28.675885 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e87c0-7a56-4abd-9928-68e17cd49225 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:28.688551 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e87c0-7a56-4abd-9928-68e17cd49225 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:28.696030 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-b84e87c0-7a56-4abd-9928-68e17cd49225 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 09 04:27:28.698002 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 92/182] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:28.704039 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c62408-d33a-4e3a-a465-bcc2d4f7c2b7 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:28.713746 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c62408-d33a-4e3a-a465-bcc2d4f7c2b7 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:28.719045 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c605aa-b800-43bb-a62b-49ead4ab425b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:28.719916 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c605aa-b800-43bb-a62b-49ead4ab425b admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:28.720383 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c605aa-b800-43bb-a62b-49ead4ab425b admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:28.720836 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c605aa-b800-43bb-a62b-49ead4ab425b admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:28.721835 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c605aa-b800-43bb-a62b-49ead4ab425b admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:28.722340 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c605aa-b800-43bb-a62b-49ead4ab425b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:28.724107 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c605aa-b800-43bb-a62b-49ead4ab425b admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:28.732890 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 91/183] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:28.739056 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e87c0-7a56-4abd-9928-68e17cd49225 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:28.749053 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e87c0-7a56-4abd-9928-68e17cd49225 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:28.753969 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5652d2-0369-4cd1-995c-3dd90f5998ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:28.755185 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5652d2-0369-4cd1-995c-3dd90f5998ed admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:28.755664 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5652d2-0369-4cd1-995c-3dd90f5998ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:28.756133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5652d2-0369-4cd1-995c-3dd90f5998ed admin admin] PATH_INFO: `/v3/users/ed6161643e37428fbbdcfd020d36c823` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:28.757832 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5652d2-0369-4cd1-995c-3dd90f5998ed admin admin] RBAC: Authorizing `identity:get_user(user_id=ed6161643e37428fbbdcfd020d36c823)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:28.760311 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5652d2-0369-4cd1-995c-3dd90f5998ed admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:28.762466 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 93/184] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:28 2022] GET /identity/v3/users/ed6161643e37428fbbdcfd020d36c823 => generated 289 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:28.768880 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c605aa-b800-43bb-a62b-49ead4ab425b admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:28.779237 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c605aa-b800-43bb-a62b-49ead4ab425b admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:28.784702 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27738b-8993-480c-b105-763393b43da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:28.785642 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27738b-8993-480c-b105-763393b43da6 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:28.786118 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27738b-8993-480c-b105-763393b43da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:28.786601 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27738b-8993-480c-b105-763393b43da6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:28.797037 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27738b-8993-480c-b105-763393b43da6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:28.801097 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce27738b-8993-480c-b105-763393b43da6 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:28.806323 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 92/185] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:28.812097 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5652d2-0369-4cd1-995c-3dd90f5998ed admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:28.822493 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5652d2-0369-4cd1-995c-3dd90f5998ed admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:28.827467 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35cfe0-6d62-4f45-aa83-70ec39a755a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:28.828379 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35cfe0-6d62-4f45-aa83-70ec39a755a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:28.828728 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35cfe0-6d62-4f45-aa83-70ec39a755a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:28.829117 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35cfe0-6d62-4f45-aa83-70ec39a755a2 admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:28.830370 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35cfe0-6d62-4f45-aa83-70ec39a755a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=635df70d95a247b1a0a172cbb183ba9b)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:28.832484 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35cfe0-6d62-4f45-aa83-70ec39a755a2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:28.834553 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 94/186] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:28 2022] GET /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:28.840576 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27738b-8993-480c-b105-763393b43da6 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:28.850083 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27738b-8993-480c-b105-763393b43da6 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:28.854572 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e25c3d-ee76-4132-82b5-a62307d305c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:28.855281 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e25c3d-ee76-4132-82b5-a62307d305c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:28.855561 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e25c3d-ee76-4132-82b5-a62307d305c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:28.855830 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e25c3d-ee76-4132-82b5-a62307d305c5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:28.856670 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e25c3d-ee76-4132-82b5-a62307d305c5 admin admin] RBAC: Adding query filter params (role.id=25d1ad8b112c4326a3a8e579f24a6d75, scope.project.id=635df70d95a247b1a0a172cbb183ba9b, user.id=ed6161643e37428fbbdcfd020d36c823) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:28.856977 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e25c3d-ee76-4132-82b5-a62307d305c5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:28.858879 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e25c3d-ee76-4132-82b5-a62307d305c5 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:28.865914 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c3ac8-e9bd-4bce-816a-da32005a4709 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:28.866054 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 93/187] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:27:28 2022] GET /identity/v3/role_assignments?user.id=ed6161643e37428fbbdcfd020d36c823&scope.project.id=635df70d95a247b1a0a172cbb183ba9b&role.id=25d1ad8b112c4326a3a8e579f24a6d75 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:28.866195 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c3ac8-e9bd-4bce-816a-da32005a4709 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:28.866471 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c3ac8-e9bd-4bce-816a-da32005a4709 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:28.868196 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 95/188] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:27:28.879043 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37fc69-e493-40e5-ae44-466d62b2edff None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:28.879404 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37fc69-e493-40e5-ae44-466d62b2edff None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:28.879753 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37fc69-e493-40e5-ae44-466d62b2edff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:28.899590 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-df37fc69-e493-40e5-ae44-466d62b2edff None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:28.900810 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-df37fc69-e493-40e5-ae44-466d62b2edff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:28.909923 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 94/189] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:28.933957 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c3ac8-e9bd-4bce-816a-da32005a4709 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:28.947179 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c3ac8-e9bd-4bce-816a-da32005a4709 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:28.952395 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fda98c-b6d9-420e-bf8f-537be0943e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:28.953463 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fda98c-b6d9-420e-bf8f-537be0943e16 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:28.953796 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fda98c-b6d9-420e-bf8f-537be0943e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:28.954072 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fda98c-b6d9-420e-bf8f-537be0943e16 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:28.966736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fda98c-b6d9-420e-bf8f-537be0943e16 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:28.969553 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb53edc-060f-497c-924c-1483ed95c37c None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:28.969836 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb53edc-060f-497c-924c-1483ed95c37c None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:28.970110 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb53edc-060f-497c-924c-1483ed95c37c None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:28.971970 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 95/190] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:27:28.974689 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-31fda98c-b6d9-420e-bf8f-537be0943e16 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:27:28.976353 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 96/191] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:27:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:28.977777 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ad242-9fc5-473f-8d80-211d96c63412 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:28.978064 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ad242-9fc5-473f-8d80-211d96c63412 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:28.978339 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ad242-9fc5-473f-8d80-211d96c63412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:28.982308 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fda98c-b6d9-420e-bf8f-537be0943e16 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:28.992604 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fda98c-b6d9-420e-bf8f-537be0943e16 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:28.997216 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545b1c8-1b22-435d-bcca-e807f6e6d934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:28.997909 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545b1c8-1b22-435d-bcca-e807f6e6d934 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:28.998189 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545b1c8-1b22-435d-bcca-e807f6e6d934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:28.998436 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-1f9ad242-9fc5-473f-8d80-211d96c63412 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:28.998667 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545b1c8-1b22-435d-bcca-e807f6e6d934 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:28.999809 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545b1c8-1b22-435d-bcca-e807f6e6d934 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:29.000124 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545b1c8-1b22-435d-bcca-e807f6e6d934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:29.000345 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-1f9ad242-9fc5-473f-8d80-211d96c63412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:29.001828 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545b1c8-1b22-435d-bcca-e807f6e6d934 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:29.012452 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 97/192] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:29.017339 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 96/193] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 09 04:27:29.018754 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545b1c8-1b22-435d-bcca-e807f6e6d934 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:29.032999 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545b1c8-1b22-435d-bcca-e807f6e6d934 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:29.037442 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa720154-50ed-4671-bbbe-148ea9dce315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:29.038570 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa720154-50ed-4671-bbbe-148ea9dce315 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:29.038848 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa720154-50ed-4671-bbbe-148ea9dce315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:29.039124 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa720154-50ed-4671-bbbe-148ea9dce315 admin admin] PATH_INFO: `/v3/users/c69c4d84dba242b8898fdb096a3bcc94` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:29.047823 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ad242-9fc5-473f-8d80-211d96c63412 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:29.053971 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa720154-50ed-4671-bbbe-148ea9dce315 admin admin] RBAC: Authorizing `identity:get_user(user_id=c69c4d84dba242b8898fdb096a3bcc94)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:29.056383 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa720154-50ed-4671-bbbe-148ea9dce315 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:29.057592 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ad242-9fc5-473f-8d80-211d96c63412 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:29.058620 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 98/194] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:29 2022] GET /identity/v3/users/c69c4d84dba242b8898fdb096a3bcc94 => generated 283 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:29.063149 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e33475-ec14-4976-91fb-2576a8ae0afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:29.064089 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e33475-ec14-4976-91fb-2576a8ae0afc admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:29.064368 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e33475-ec14-4976-91fb-2576a8ae0afc admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:29.064479 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa720154-50ed-4671-bbbe-148ea9dce315 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:29.064986 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e33475-ec14-4976-91fb-2576a8ae0afc admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:29.073844 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa720154-50ed-4671-bbbe-148ea9dce315 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:29.077166 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e33475-ec14-4976-91fb-2576a8ae0afc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:29.078237 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db0c5a0-6c41-4a41-a142-e1bfb18da49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:29.079384 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0c5a0-6c41-4a41-a142-e1bfb18da49e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:29.079384 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0c5a0-6c41-4a41-a142-e1bfb18da49e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:29.079384 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0c5a0-6c41-4a41-a142-e1bfb18da49e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:29.084519 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-29e33475-ec14-4976-91fb-2576a8ae0afc admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 09 04:27:29.090312 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 97/195] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Feb 9 04:27:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:29.090312 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94689bb-0371-43af-b663-7b294ce9f399 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:29.090312 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94689bb-0371-43af-b663-7b294ce9f399 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:29.090312 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94689bb-0371-43af-b663-7b294ce9f399 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:29.090312 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 98/196] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:29.091240 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0c5a0-6c41-4a41-a142-e1bfb18da49e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:29.094341 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db0c5a0-6c41-4a41-a142-e1bfb18da49e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:29.095119 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94689bb-0371-43af-b663-7b294ce9f399 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:29.102755 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 99/197] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 09 04:27:29.103909 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bc012-8f65-4ef7-a553-99a877d8c6fb None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:29.104125 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bc012-8f65-4ef7-a553-99a877d8c6fb None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:29.104404 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bc012-8f65-4ef7-a553-99a877d8c6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:29.108988 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94689bb-0371-43af-b663-7b294ce9f399 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:29.115526 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de230f0a-6dd0-4346-8a9f-c5c5c6011abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:29.116313 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de230f0a-6dd0-4346-8a9f-c5c5c6011abe admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:29.116659 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de230f0a-6dd0-4346-8a9f-c5c5c6011abe admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:29.116998 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de230f0a-6dd0-4346-8a9f-c5c5c6011abe admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:29.117849 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de230f0a-6dd0-4346-8a9f-c5c5c6011abe admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:29.118156 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de230f0a-6dd0-4346-8a9f-c5c5c6011abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:29.119766 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de230f0a-6dd0-4346-8a9f-c5c5c6011abe admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:29.125519 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-3f0bc012-8f65-4ef7-a553-99a877d8c6fb None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:29.129776 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 99/198] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:27:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:29.130212 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de230f0a-6dd0-4346-8a9f-c5c5c6011abe admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:29.134998 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3f0bc012-8f65-4ef7-a553-99a877d8c6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:29.139914 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de230f0a-6dd0-4346-8a9f-c5c5c6011abe admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:29.143706 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 100/199] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:29.144493 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bc012-8f65-4ef7-a553-99a877d8c6fb None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:29.145517 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328b520-bfdc-43d3-a225-3eabe0634320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:29.146359 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328b520-bfdc-43d3-a225-3eabe0634320 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:29.146643 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328b520-bfdc-43d3-a225-3eabe0634320 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:29.146898 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f328b520-bfdc-43d3-a225-3eabe0634320 admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:29.148065 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328b520-bfdc-43d3-a225-3eabe0634320 admin admin] RBAC: Authorizing `identity:get_project(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:29.150163 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f328b520-bfdc-43d3-a225-3eabe0634320 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:29.151833 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 100/200] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:29 2022] GET /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:29.153727 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bc012-8f65-4ef7-a553-99a877d8c6fb None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:29.157916 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328b520-bfdc-43d3-a225-3eabe0634320 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:29.158663 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22effd-fd25-4e44-91e7-31ea896c988e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:29.159509 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22effd-fd25-4e44-91e7-31ea896c988e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:29.159790 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22effd-fd25-4e44-91e7-31ea896c988e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:29.160065 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22effd-fd25-4e44-91e7-31ea896c988e admin admin] PATH_INFO: `/v3/users/c69c4d84dba242b8898fdb096a3bcc94` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:29.161280 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22effd-fd25-4e44-91e7-31ea896c988e admin admin] RBAC: Authorizing `identity:get_user(user_id=c69c4d84dba242b8898fdb096a3bcc94)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:29.163658 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22effd-fd25-4e44-91e7-31ea896c988e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:29.165438 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 101/201] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:29 2022] GET /identity/v3/users/c69c4d84dba242b8898fdb096a3bcc94 => generated 283 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:29.167836 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f328b520-bfdc-43d3-a225-3eabe0634320 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:29.170394 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22effd-fd25-4e44-91e7-31ea896c988e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:29.173091 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feedd4e-4183-491d-880f-c85ccf1b55fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:29.173720 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feedd4e-4183-491d-880f-c85ccf1b55fc admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:29.174000 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feedd4e-4183-491d-880f-c85ccf1b55fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:29.174275 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feedd4e-4183-491d-880f-c85ccf1b55fc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:29.175113 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feedd4e-4183-491d-880f-c85ccf1b55fc admin admin] RBAC: Adding query filter params (role.id=05ca9a16ef2a450b8cc73ade47f5c7d0, scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6, user.id=c69c4d84dba242b8898fdb096a3bcc94) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:29.175425 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feedd4e-4183-491d-880f-c85ccf1b55fc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:29.177272 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feedd4e-4183-491d-880f-c85ccf1b55fc admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:29.180103 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22effd-fd25-4e44-91e7-31ea896c988e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:29.190671 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 101/202] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:27:29 2022] GET /identity/v3/role_assignments?user.id=c69c4d84dba242b8898fdb096a3bcc94&scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6&role.id=05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:29.190671 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feedd4e-4183-491d-880f-c85ccf1b55fc admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:29.190980 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec59f9-51a0-41fc-8863-6a6566977900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:29.190980 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec59f9-51a0-41fc-8863-6a6566977900 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:29.190980 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec59f9-51a0-41fc-8863-6a6566977900 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:29.190980 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec59f9-51a0-41fc-8863-6a6566977900 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:29.191277 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec59f9-51a0-41fc-8863-6a6566977900 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:29.191277 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec59f9-51a0-41fc-8863-6a6566977900 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:29.191277 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 102/203] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:27:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:29.194054 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feedd4e-4183-491d-880f-c85ccf1b55fc admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:29.197760 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec59f9-51a0-41fc-8863-6a6566977900 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:29.200030 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb1d39-3cab-4544-911a-a42fe45fe559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:29.200701 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb1d39-3cab-4544-911a-a42fe45fe559 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:29.200984 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb1d39-3cab-4544-911a-a42fe45fe559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:29.201352 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb1d39-3cab-4544-911a-a42fe45fe559 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:29.208781 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec59f9-51a0-41fc-8863-6a6566977900 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:29.210335 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb1d39-3cab-4544-911a-a42fe45fe559 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:29.212123 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb1d39-3cab-4544-911a-a42fe45fe559 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:29.213413 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfeb0f7-13d3-4974-b700-267c82689452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:29.214105 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfeb0f7-13d3-4974-b700-267c82689452 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:29.214386 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfeb0f7-13d3-4974-b700-267c82689452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:29.214685 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfeb0f7-13d3-4974-b700-267c82689452 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:29.215424 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfeb0f7-13d3-4974-b700-267c82689452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:29.217983 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfeb0f7-13d3-4974-b700-267c82689452 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:29.222723 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 102/204] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:29.228325 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb1d39-3cab-4544-911a-a42fe45fe559 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:29.239934 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb1d39-3cab-4544-911a-a42fe45fe559 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:29.244615 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec84de-5c9c-4deb-aa2a-2f19ea79c783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:29.245282 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 103/205] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Feb 9 04:27:29 2022] POST /identity/v3/users => generated 297 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:27:29.245526 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec84de-5c9c-4deb-aa2a-2f19ea79c783 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:29.245798 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec84de-5c9c-4deb-aa2a-2f19ea79c783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:29.246115 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec84de-5c9c-4deb-aa2a-2f19ea79c783 admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:29.247488 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec84de-5c9c-4deb-aa2a-2f19ea79c783 admin admin] RBAC: Authorizing `identity:get_project(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:29.249820 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec84de-5c9c-4deb-aa2a-2f19ea79c783 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:29.251976 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 103/206] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:29 2022] GET /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:29.258051 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfeb0f7-13d3-4974-b700-267c82689452 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:29.269050 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfeb0f7-13d3-4974-b700-267c82689452 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:29.273702 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b9e92-6868-439a-acd0-d9fa69ed74c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:29.274392 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b9e92-6868-439a-acd0-d9fa69ed74c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:29.274687 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b9e92-6868-439a-acd0-d9fa69ed74c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:29.274957 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b9e92-6868-439a-acd0-d9fa69ed74c0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:29.275833 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b9e92-6868-439a-acd0-d9fa69ed74c0 admin admin] RBAC: Adding query filter params (role.id=850547f4dcf34a76a710ddaae9dc30de, scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6, user.id=c69c4d84dba242b8898fdb096a3bcc94) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:29.276152 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b9e92-6868-439a-acd0-d9fa69ed74c0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:29.278148 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b9e92-6868-439a-acd0-d9fa69ed74c0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:29.285129 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 104/207] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:27:29 2022] GET /identity/v3/role_assignments?user.id=c69c4d84dba242b8898fdb096a3bcc94&scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6&role.id=850547f4dcf34a76a710ddaae9dc30de => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:31.465895 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806db60-2f87-4825-922f-e56fa7ef8aa4 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:31.466402 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806db60-2f87-4825-922f-e56fa7ef8aa4 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:31.466477 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b806db60-2f87-4825-922f-e56fa7ef8aa4 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:31.468405 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 104/208] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:31.475740 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4242d25-3eb4-4c4f-9abc-8d1e0a451a40 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:31.475740 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4242d25-3eb4-4c4f-9abc-8d1e0a451a40 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:31.475740 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4242d25-3eb4-4c4f-9abc-8d1e0a451a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:31.492904 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-e4242d25-3eb4-4c4f-9abc-8d1e0a451a40 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:31.494410 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e4242d25-3eb4-4c4f-9abc-8d1e0a451a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:31.503944 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28028e-cda3-4930-a1dd-358b5eb58c55 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:31.504235 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28028e-cda3-4930-a1dd-358b5eb58c55 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:31.504498 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28028e-cda3-4930-a1dd-358b5eb58c55 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:31.505739 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 105/209] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:31.509721 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 105/210] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:27:31.515609 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab989d8-4b15-4e2e-ac53-c72e19bc7817 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:31.516138 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab989d8-4b15-4e2e-ac53-c72e19bc7817 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:31.516612 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab989d8-4b15-4e2e-ac53-c72e19bc7817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:31.529191 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28028e-cda3-4930-a1dd-358b5eb58c55 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:31.535443 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-8ab989d8-4b15-4e2e-ac53-c72e19bc7817 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:31.536844 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8ab989d8-4b15-4e2e-ac53-c72e19bc7817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:31.544868 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28028e-cda3-4930-a1dd-358b5eb58c55 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:31.545771 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 106/211] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:31.555836 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2245c-653f-48bd-aa18-dea54d9748f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:31.556880 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2245c-653f-48bd-aa18-dea54d9748f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:31.557425 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2245c-653f-48bd-aa18-dea54d9748f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:31.557899 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2245c-653f-48bd-aa18-dea54d9748f9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:31.569755 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab989d8-4b15-4e2e-ac53-c72e19bc7817 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:31.570287 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df2245c-653f-48bd-aa18-dea54d9748f9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:31.577983 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-6df2245c-653f-48bd-aa18-dea54d9748f9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:27:31.579380 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab989d8-4b15-4e2e-ac53-c72e19bc7817 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:31.583856 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 106/212] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:27:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:27:31.585868 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2245c-653f-48bd-aa18-dea54d9748f9 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:31.590253 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155e5a9-e40c-4f39-90b2-0a06646e3f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:31.591511 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155e5a9-e40c-4f39-90b2-0a06646e3f1e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:31.592018 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155e5a9-e40c-4f39-90b2-0a06646e3f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:31.593073 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155e5a9-e40c-4f39-90b2-0a06646e3f1e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:31.597022 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2245c-653f-48bd-aa18-dea54d9748f9 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:31.601831 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c448ff-9c55-4033-b123-aaa7acea7052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:31.602484 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c448ff-9c55-4033-b123-aaa7acea7052 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:31.602766 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c448ff-9c55-4033-b123-aaa7acea7052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:31.603052 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c448ff-9c55-4033-b123-aaa7acea7052 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:31.604098 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c448ff-9c55-4033-b123-aaa7acea7052 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:31.604406 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c448ff-9c55-4033-b123-aaa7acea7052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:31.606413 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c448ff-9c55-4033-b123-aaa7acea7052 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:31.606988 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155e5a9-e40c-4f39-90b2-0a06646e3f1e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:31.614938 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 107/213] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:31.616216 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-f155e5a9-e40c-4f39-90b2-0a06646e3f1e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 09 04:27:31.616332 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe3a9-4b7a-42f3-9886-7b16ef07c38a None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:31.616507 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe3a9-4b7a-42f3-9886-7b16ef07c38a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:31.616781 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbe3a9-4b7a-42f3-9886-7b16ef07c38a None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:31.618011 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 107/214] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Feb 9 04:27:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:27:31.618564 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 108/215] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:31.620736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155e5a9-e40c-4f39-90b2-0a06646e3f1e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:31.624315 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbe3a9-4b7a-42f3-9886-7b16ef07c38a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:31.631650 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155e5a9-e40c-4f39-90b2-0a06646e3f1e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:31.635897 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70534117-7073-4013-8def-c1103c0d0160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:31.636024 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbe3a9-4b7a-42f3-9886-7b16ef07c38a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:31.636738 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70534117-7073-4013-8def-c1103c0d0160 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:31.637041 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70534117-7073-4013-8def-c1103c0d0160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:31.637312 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70534117-7073-4013-8def-c1103c0d0160 admin admin] PATH_INFO: `/v3/users/c69c4d84dba242b8898fdb096a3bcc94` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:31.638499 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70534117-7073-4013-8def-c1103c0d0160 admin admin] RBAC: Authorizing `identity:get_user(user_id=c69c4d84dba242b8898fdb096a3bcc94)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:31.640946 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671cc31-e537-4f0c-94eb-f71817d3516f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:31.641281 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70534117-7073-4013-8def-c1103c0d0160 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:31.641606 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671cc31-e537-4f0c-94eb-f71817d3516f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:31.641886 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671cc31-e537-4f0c-94eb-f71817d3516f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:31.642157 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671cc31-e537-4f0c-94eb-f71817d3516f admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:31.643019 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 108/216] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:31 2022] GET /identity/v3/users/c69c4d84dba242b8898fdb096a3bcc94 => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:31.643116 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671cc31-e537-4f0c-94eb-f71817d3516f admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:31.643192 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671cc31-e537-4f0c-94eb-f71817d3516f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:31.644745 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671cc31-e537-4f0c-94eb-f71817d3516f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:31.646443 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3be1d1-10e6-4db7-b085-f9185ec38012 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:31.647370 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3be1d1-10e6-4db7-b085-f9185ec38012 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:31.647850 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3be1d1-10e6-4db7-b085-f9185ec38012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:31.653168 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 109/217] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:27:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:31.654750 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671cc31-e537-4f0c-94eb-f71817d3516f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:31.664222 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671cc31-e537-4f0c-94eb-f71817d3516f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:31.667754 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-7d3be1d1-10e6-4db7-b085-f9185ec38012 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:31.668440 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7f6a5a-5091-444a-a3c3-8aa527d212d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:31.668928 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7d3be1d1-10e6-4db7-b085-f9185ec38012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:31.669286 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f6a5a-5091-444a-a3c3-8aa527d212d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:31.669562 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f6a5a-5091-444a-a3c3-8aa527d212d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:31.669832 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7f6a5a-5091-444a-a3c3-8aa527d212d8 admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:31.671012 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f6a5a-5091-444a-a3c3-8aa527d212d8 admin admin] RBAC: Authorizing `identity:get_project(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:31.673043 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7f6a5a-5091-444a-a3c3-8aa527d212d8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:31.674672 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 110/218] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:31 2022] GET /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:31.676729 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 109/219] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:31.676837 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3a571-84e8-43af-a43c-7c913a4b6296 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:31.676907 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3a571-84e8-43af-a43c-7c913a4b6296 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:31.677170 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e3a571-84e8-43af-a43c-7c913a4b6296 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:31.677356 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3be1d1-10e6-4db7-b085-f9185ec38012 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:31.678941 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 111/220] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:31.682403 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3a571-84e8-43af-a43c-7c913a4b6296 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:31.690257 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3be1d1-10e6-4db7-b085-f9185ec38012 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:31.694490 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e3a571-84e8-43af-a43c-7c913a4b6296 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:31.694620 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6873a4b-3a56-4eab-8d44-9a8ee9ed2edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:31.695473 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6873a4b-3a56-4eab-8d44-9a8ee9ed2edb admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:31.695761 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6873a4b-3a56-4eab-8d44-9a8ee9ed2edb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:31.696037 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6873a4b-3a56-4eab-8d44-9a8ee9ed2edb admin admin] PATH_INFO: `/v3/users/c69c4d84dba242b8898fdb096a3bcc94` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:31.697262 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6873a4b-3a56-4eab-8d44-9a8ee9ed2edb admin admin] RBAC: Authorizing `identity:get_user(user_id=c69c4d84dba242b8898fdb096a3bcc94)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:31.699511 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6873a4b-3a56-4eab-8d44-9a8ee9ed2edb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:31.699746 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eeec09-7495-4805-8aa7-d5f51cb77aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:31.700587 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eeec09-7495-4805-8aa7-d5f51cb77aae admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:31.700869 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eeec09-7495-4805-8aa7-d5f51cb77aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:31.701129 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 110/221] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:31 2022] GET /identity/v3/users/c69c4d84dba242b8898fdb096a3bcc94 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:31.701289 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eeec09-7495-4805-8aa7-d5f51cb77aae admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6/users/c69c4d84dba242b8898fdb096a3bcc94/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:31.702920 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93ac36-23c7-4b2e-b0bd-52827e437bc8 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:31.703219 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93ac36-23c7-4b2e-b0bd-52827e437bc8 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:31.703500 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93ac36-23c7-4b2e-b0bd-52827e437bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:31.703852 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eeec09-7495-4805-8aa7-d5f51cb77aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6, user_id=c69c4d84dba242b8898fdb096a3bcc94, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:31.706498 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eeec09-7495-4805-8aa7-d5f51cb77aae admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:31.719287 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 112/222] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:27:31 2022] PUT /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6/users/c69c4d84dba242b8898fdb096a3bcc94/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:27:31.720001 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eeec09-7495-4805-8aa7-d5f51cb77aae admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:31.722149 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-de93ac36-23c7-4b2e-b0bd-52827e437bc8 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:31.723353 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-de93ac36-23c7-4b2e-b0bd-52827e437bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:31.784533 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 111/223] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:31.792047 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93ac36-23c7-4b2e-b0bd-52827e437bc8 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:31.793731 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eeec09-7495-4805-8aa7-d5f51cb77aae admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:31.798860 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93ac36-23c7-4b2e-b0bd-52827e437bc8 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:31.799019 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd65c5-dcbe-4c29-bcd3-9461dc5d9c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:31.799706 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd65c5-dcbe-4c29-bcd3-9461dc5d9c9f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:31.799994 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd65c5-dcbe-4c29-bcd3-9461dc5d9c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:31.800384 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd65c5-dcbe-4c29-bcd3-9461dc5d9c9f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:31.805063 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4418a-179d-45c5-9f24-79a63f94e184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:31.806652 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4418a-179d-45c5-9f24-79a63f94e184 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:31.807130 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4418a-179d-45c5-9f24-79a63f94e184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:31.807583 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4418a-179d-45c5-9f24-79a63f94e184 admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:31.809709 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4418a-179d-45c5-9f24-79a63f94e184 admin admin] RBAC: Authorizing `identity:get_project(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:31.813151 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd4418a-179d-45c5-9f24-79a63f94e184 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:31.813500 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd65c5-dcbe-4c29-bcd3-9461dc5d9c9f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:31.815382 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 112/224] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:31 2022] GET /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:31.818003 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4418a-179d-45c5-9f24-79a63f94e184 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:31.821269 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-a2cd65c5-dcbe-4c29-bcd3-9461dc5d9c9f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 09 04:27:31.822548 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 113/225] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:31.827499 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd65c5-dcbe-4c29-bcd3-9461dc5d9c9f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:31.829919 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4418a-179d-45c5-9f24-79a63f94e184 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:31.834333 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c744459-9cdd-4260-a6ca-987ddc65734f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:31.835135 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c744459-9cdd-4260-a6ca-987ddc65734f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:31.835416 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c744459-9cdd-4260-a6ca-987ddc65734f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:31.835690 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c744459-9cdd-4260-a6ca-987ddc65734f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:31.836894 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c744459-9cdd-4260-a6ca-987ddc65734f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:31.838659 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c744459-9cdd-4260-a6ca-987ddc65734f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:31.839478 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd65c5-dcbe-4c29-bcd3-9461dc5d9c9f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:31.840314 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 113/226] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:27:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:31.842060 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c744459-9cdd-4260-a6ca-987ddc65734f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:31.845465 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd7b94-7120-4233-8a6f-7c5e99025213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:31.846382 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd7b94-7120-4233-8a6f-7c5e99025213 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:31.846668 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd7b94-7120-4233-8a6f-7c5e99025213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:31.846947 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd7b94-7120-4233-8a6f-7c5e99025213 admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6/users/c69c4d84dba242b8898fdb096a3bcc94/roles/850547f4dcf34a76a710ddaae9dc30de` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:31.849600 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd7b94-7120-4233-8a6f-7c5e99025213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6, user_id=c69c4d84dba242b8898fdb096a3bcc94, role_id=850547f4dcf34a76a710ddaae9dc30de)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:31.852304 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd7b94-7120-4233-8a6f-7c5e99025213 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:31.852407 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c744459-9cdd-4260-a6ca-987ddc65734f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:31.857073 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8cd00-e7b7-4e1d-ba5c-4dbde4a5e341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:31.857787 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8cd00-e7b7-4e1d-ba5c-4dbde4a5e341 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:31.858563 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8cd00-e7b7-4e1d-ba5c-4dbde4a5e341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:31.858836 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8cd00-e7b7-4e1d-ba5c-4dbde4a5e341 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:31.859622 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8cd00-e7b7-4e1d-ba5c-4dbde4a5e341 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:31.859971 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8cd00-e7b7-4e1d-ba5c-4dbde4a5e341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:31.861583 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8cd00-e7b7-4e1d-ba5c-4dbde4a5e341 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:31.866416 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 114/227] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:27:31 2022] PUT /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6/users/c69c4d84dba242b8898fdb096a3bcc94/roles/850547f4dcf34a76a710ddaae9dc30de => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:27:31.867126 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd7b94-7120-4233-8a6f-7c5e99025213 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:31.876306 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 114/228] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:31.881561 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8cd00-e7b7-4e1d-ba5c-4dbde4a5e341 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:31.891957 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8cd00-e7b7-4e1d-ba5c-4dbde4a5e341 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:31.943803 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd7b94-7120-4233-8a6f-7c5e99025213 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:31.948644 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6da91-b4e5-4752-a558-ffa056fc3919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:31.949664 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6da91-b4e5-4752-a558-ffa056fc3919 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:31.950029 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6da91-b4e5-4752-a558-ffa056fc3919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:31.950297 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc6da91-b4e5-4752-a558-ffa056fc3919 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:31.951101 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6da91-b4e5-4752-a558-ffa056fc3919 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:31.955094 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc6da91-b4e5-4752-a558-ffa056fc3919 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:31.967960 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1aa361-9bb6-4b17-86a1-0bce5a2f0ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:31.968987 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1aa361-9bb6-4b17-86a1-0bce5a2f0ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:31.969363 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1aa361-9bb6-4b17-86a1-0bce5a2f0ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:31.969588 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1aa361-9bb6-4b17-86a1-0bce5a2f0ce3 admin admin] PATH_INFO: `/v3/users/af746bdf81d3438b8c53da19f6dc2c08` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:31.979463 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 115/229] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Feb 9 04:27:31 2022] POST /identity/v3/users => generated 297 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:27:31.993147 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1aa361-9bb6-4b17-86a1-0bce5a2f0ce3 admin admin] RBAC: Authorizing `identity:get_user(user_id=af746bdf81d3438b8c53da19f6dc2c08)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:31.995757 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1aa361-9bb6-4b17-86a1-0bce5a2f0ce3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:31.998403 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 115/230] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:31 2022] GET /identity/v3/users/af746bdf81d3438b8c53da19f6dc2c08 => generated 297 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:32.003799 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6da91-b4e5-4752-a558-ffa056fc3919 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:32.015994 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc6da91-b4e5-4752-a558-ffa056fc3919 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:32.021434 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fbe28-1a04-4352-904f-91c7aff82f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:32.022352 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fbe28-1a04-4352-904f-91c7aff82f5c admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:32.022848 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fbe28-1a04-4352-904f-91c7aff82f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:32.023291 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485fbe28-1a04-4352-904f-91c7aff82f5c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:32.033703 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fbe28-1a04-4352-904f-91c7aff82f5c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:32.035883 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485fbe28-1a04-4352-904f-91c7aff82f5c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:32.047202 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 116/231] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 09 04:27:32.054213 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1aa361-9bb6-4b17-86a1-0bce5a2f0ce3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:32.068989 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1aa361-9bb6-4b17-86a1-0bce5a2f0ce3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:32.076425 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc29db8-85bb-4418-b60c-ed4a33f2cf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:32.077950 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc29db8-85bb-4418-b60c-ed4a33f2cf7d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:32.078259 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc29db8-85bb-4418-b60c-ed4a33f2cf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:32.078542 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc29db8-85bb-4418-b60c-ed4a33f2cf7d admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:32.081636 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc29db8-85bb-4418-b60c-ed4a33f2cf7d admin admin] RBAC: Authorizing `identity:get_project(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:32.083750 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc29db8-85bb-4418-b60c-ed4a33f2cf7d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:32.085772 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 116/232] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:32 2022] GET /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:32.091907 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fbe28-1a04-4352-904f-91c7aff82f5c admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:32.102823 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485fbe28-1a04-4352-904f-91c7aff82f5c admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:32.107395 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f184bde-6239-4b7c-89a3-6477e0dcaf19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:32.108109 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f184bde-6239-4b7c-89a3-6477e0dcaf19 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:32.108393 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f184bde-6239-4b7c-89a3-6477e0dcaf19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:32.108669 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f184bde-6239-4b7c-89a3-6477e0dcaf19 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:32.111070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f184bde-6239-4b7c-89a3-6477e0dcaf19 admin admin] RBAC: Adding query filter params (role.id=102f883957d846419d33ce22fdec0cce, scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6, user.id=af746bdf81d3438b8c53da19f6dc2c08) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:32.111070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f184bde-6239-4b7c-89a3-6477e0dcaf19 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:32.111826 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f184bde-6239-4b7c-89a3-6477e0dcaf19 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:32.118882 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 117/233] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:27:32 2022] GET /identity/v3/role_assignments?user.id=af746bdf81d3438b8c53da19f6dc2c08&scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6&role.id=102f883957d846419d33ce22fdec0cce => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:34.363563 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eaea4-65b2-46c8-8fee-972c2d37d7d8 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:34.364076 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eaea4-65b2-46c8-8fee-972c2d37d7d8 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:34.364151 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eaea4-65b2-46c8-8fee-972c2d37d7d8 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:34.365925 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 117/234] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:34.371363 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7bad6-7904-48d4-837f-ec0cf501ab53 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:34.371778 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7bad6-7904-48d4-837f-ec0cf501ab53 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:34.371969 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7bad6-7904-48d4-837f-ec0cf501ab53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:34.394032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-37b7bad6-7904-48d4-837f-ec0cf501ab53 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:34.395253 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-37b7bad6-7904-48d4-837f-ec0cf501ab53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:34.403102 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 118/235] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:34.447534 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8eaea4-65b2-46c8-8fee-972c2d37d7d8 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:34.462756 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8eaea4-65b2-46c8-8fee-972c2d37d7d8 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:34.467297 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac0106-168f-455b-94e7-f4feb83f3729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:34.468088 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac0106-168f-455b-94e7-f4feb83f3729 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:34.468370 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac0106-168f-455b-94e7-f4feb83f3729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:34.468647 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac0106-168f-455b-94e7-f4feb83f3729 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:34.483666 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac0106-168f-455b-94e7-f4feb83f3729 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:34.490660 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-7aac0106-168f-455b-94e7-f4feb83f3729 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:27:34.492229 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 118/236] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:27:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:34.497582 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7bad6-7904-48d4-837f-ec0cf501ab53 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:34.510536 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7bad6-7904-48d4-837f-ec0cf501ab53 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:34.518483 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be70cb3-949e-47af-8d12-66effb3fdd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:34.519178 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be70cb3-949e-47af-8d12-66effb3fdd46 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:34.519462 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be70cb3-949e-47af-8d12-66effb3fdd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:34.520230 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be70cb3-949e-47af-8d12-66effb3fdd46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:34.521047 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be70cb3-949e-47af-8d12-66effb3fdd46 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:34.521361 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be70cb3-949e-47af-8d12-66effb3fdd46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:34.523028 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be70cb3-949e-47af-8d12-66effb3fdd46 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:34.536991 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 119/237] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:34.542835 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac0106-168f-455b-94e7-f4feb83f3729 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:34.562715 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac0106-168f-455b-94e7-f4feb83f3729 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:34.575965 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11cb9d-6391-4915-8fd4-6e76a998251c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:34.577430 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11cb9d-6391-4915-8fd4-6e76a998251c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:34.577718 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11cb9d-6391-4915-8fd4-6e76a998251c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:34.577999 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11cb9d-6391-4915-8fd4-6e76a998251c admin admin] PATH_INFO: `/v3/users/c69c4d84dba242b8898fdb096a3bcc94` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:34.579237 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11cb9d-6391-4915-8fd4-6e76a998251c admin admin] RBAC: Authorizing `identity:get_user(user_id=c69c4d84dba242b8898fdb096a3bcc94)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:34.581440 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11cb9d-6391-4915-8fd4-6e76a998251c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:34.583061 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 119/238] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:34 2022] GET /identity/v3/users/c69c4d84dba242b8898fdb096a3bcc94 => generated 283 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:34.588407 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be70cb3-949e-47af-8d12-66effb3fdd46 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:34.602222 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be70cb3-949e-47af-8d12-66effb3fdd46 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:34.611349 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c8320-4138-4473-aba9-c1a536d5a3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:34.612021 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c8320-4138-4473-aba9-c1a536d5a3ad admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:34.612306 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c8320-4138-4473-aba9-c1a536d5a3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:34.612581 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c8320-4138-4473-aba9-c1a536d5a3ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:34.625789 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c8320-4138-4473-aba9-c1a536d5a3ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:34.627501 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c8320-4138-4473-aba9-c1a536d5a3ad admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:34.639955 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 120/239] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:34.645206 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11cb9d-6391-4915-8fd4-6e76a998251c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:34.650490 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2061d77-5bbc-43e0-8f2f-f7a6b8d9aa85 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:34.650777 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2061d77-5bbc-43e0-8f2f-f7a6b8d9aa85 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:34.651054 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2061d77-5bbc-43e0-8f2f-f7a6b8d9aa85 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:34.653067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 121/240] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:34.659397 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c64a6-d553-4780-bec8-aa4e7bcb0af7 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:34.659680 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c64a6-d553-4780-bec8-aa4e7bcb0af7 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:34.659957 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c64a6-d553-4780-bec8-aa4e7bcb0af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:34.665541 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11cb9d-6391-4915-8fd4-6e76a998251c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:34.680681 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113764f8-6434-46c8-9c66-e8ff38944ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:34.681573 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113764f8-6434-46c8-9c66-e8ff38944ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:34.681877 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113764f8-6434-46c8-9c66-e8ff38944ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:34.682114 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113764f8-6434-46c8-9c66-e8ff38944ec5 admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:34.683349 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113764f8-6434-46c8-9c66-e8ff38944ec5 admin admin] RBAC: Authorizing `identity:get_project(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:34.685455 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113764f8-6434-46c8-9c66-e8ff38944ec5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:34.687683 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 120/241] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:34 2022] GET /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6 => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:34.693392 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113764f8-6434-46c8-9c66-e8ff38944ec5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:34.702615 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-8f4c64a6-d553-4780-bec8-aa4e7bcb0af7 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:34.703388 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113764f8-6434-46c8-9c66-e8ff38944ec5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:34.703822 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-8f4c64a6-d553-4780-bec8-aa4e7bcb0af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:34.707713 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a84a9-c0e7-4747-8b06-5493731c1d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:34.708355 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a84a9-c0e7-4747-8b06-5493731c1d58 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:34.708621 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a84a9-c0e7-4747-8b06-5493731c1d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:34.708895 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a84a9-c0e7-4747-8b06-5493731c1d58 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:34.709757 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a84a9-c0e7-4747-8b06-5493731c1d58 admin admin] RBAC: Adding query filter params (role.id=05ca9a16ef2a450b8cc73ade47f5c7d0, scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6, user.id=c69c4d84dba242b8898fdb096a3bcc94) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:34.710062 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a84a9-c0e7-4747-8b06-5493731c1d58 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:34.711894 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a84a9-c0e7-4747-8b06-5493731c1d58 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:34.718346 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 121/242] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:27:34 2022] GET /identity/v3/role_assignments?user.id=c69c4d84dba242b8898fdb096a3bcc94&scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6&role.id=05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:34.723341 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 122/243] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:34.766830 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a84a9-c0e7-4747-8b06-5493731c1d58 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:34.777867 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a84a9-c0e7-4747-8b06-5493731c1d58 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:34.785031 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34878b6-b368-4ca5-92aa-6182b93fba21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:34.785848 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34878b6-b368-4ca5-92aa-6182b93fba21 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:34.786124 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34878b6-b368-4ca5-92aa-6182b93fba21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:34.786391 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34878b6-b368-4ca5-92aa-6182b93fba21 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:34.806384 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34878b6-b368-4ca5-92aa-6182b93fba21 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:34.814307 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-b34878b6-b368-4ca5-92aa-6182b93fba21 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 09 04:27:34.815748 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 122/244] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Feb 9 04:27:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:34.821551 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c64a6-d553-4780-bec8-aa4e7bcb0af7 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:34.831086 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c64a6-d553-4780-bec8-aa4e7bcb0af7 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:34.850509 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad423308-e945-4756-ba08-ac9d2d8c6646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:34.851288 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad423308-e945-4756-ba08-ac9d2d8c6646 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:34.851464 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad423308-e945-4756-ba08-ac9d2d8c6646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:34.851743 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad423308-e945-4756-ba08-ac9d2d8c6646 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:34.852528 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad423308-e945-4756-ba08-ac9d2d8c6646 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:34.852839 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad423308-e945-4756-ba08-ac9d2d8c6646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:34.854501 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad423308-e945-4756-ba08-ac9d2d8c6646 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:34.866371 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39d79e-4b3d-480f-bac5-b3b624837f5d None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:34.866678 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39d79e-4b3d-480f-bac5-b3b624837f5d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:34.866980 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 123/245] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:27:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:34.867189 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d39d79e-4b3d-480f-bac5-b3b624837f5d None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:34.869145 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 123/246] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:34.872381 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad423308-e945-4756-ba08-ac9d2d8c6646 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:34.883165 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad423308-e945-4756-ba08-ac9d2d8c6646 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:34.891584 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8e215-1db2-4f2f-8cba-a44f4a870db4 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:34.891584 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8e215-1db2-4f2f-8cba-a44f4a870db4 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:34.891584 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8e215-1db2-4f2f-8cba-a44f4a870db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:34.893322 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103c585-79b5-4926-a857-c4c2261fbde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:34.893322 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103c585-79b5-4926-a857-c4c2261fbde2 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:34.893605 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103c585-79b5-4926-a857-c4c2261fbde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:34.893853 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103c585-79b5-4926-a857-c4c2261fbde2 admin admin] PATH_INFO: `/v3/users/c69c4d84dba242b8898fdb096a3bcc94` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:34.895119 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103c585-79b5-4926-a857-c4c2261fbde2 admin admin] RBAC: Authorizing `identity:get_user(user_id=c69c4d84dba242b8898fdb096a3bcc94)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:34.897325 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103c585-79b5-4926-a857-c4c2261fbde2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:34.899722 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 124/247] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:34 2022] GET /identity/v3/users/c69c4d84dba242b8898fdb096a3bcc94 => generated 283 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:34.904863 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103c585-79b5-4926-a857-c4c2261fbde2 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:34.914934 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103c585-79b5-4926-a857-c4c2261fbde2 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:34.924580 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a0c8e215-1db2-4f2f-8cba-a44f4a870db4 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:34.925832 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a0c8e215-1db2-4f2f-8cba-a44f4a870db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:34.927360 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66457f-ddff-40f4-8644-78bc88b03332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:34.928030 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66457f-ddff-40f4-8644-78bc88b03332 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:34.928313 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66457f-ddff-40f4-8644-78bc88b03332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:34.928587 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66457f-ddff-40f4-8644-78bc88b03332 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:34.938521 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66457f-ddff-40f4-8644-78bc88b03332 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:34.940314 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66457f-ddff-40f4-8644-78bc88b03332 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:34.941412 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 124/248] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:34.942883 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bb34e-b884-49b6-943d-b28d3932f1a1 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:34.943169 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bb34e-b884-49b6-943d-b28d3932f1a1 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:34.943448 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4bb34e-b884-49b6-943d-b28d3932f1a1 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:34.950038 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 125/250] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:34.950265 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 125/250] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:34.956059 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66457f-ddff-40f4-8644-78bc88b03332 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:34.959480 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024497c-4ac0-4f87-998b-15c136c1c491 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:34.959769 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024497c-4ac0-4f87-998b-15c136c1c491 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:34.960050 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024497c-4ac0-4f87-998b-15c136c1c491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:34.965281 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66457f-ddff-40f4-8644-78bc88b03332 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:34.972791 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611f66c-eb64-4351-a0cf-d7a6a5667c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:34.973686 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611f66c-eb64-4351-a0cf-d7a6a5667c9e admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:34.973971 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611f66c-eb64-4351-a0cf-d7a6a5667c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:34.974246 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611f66c-eb64-4351-a0cf-d7a6a5667c9e admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:34.975460 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611f66c-eb64-4351-a0cf-d7a6a5667c9e admin admin] RBAC: Authorizing `identity:get_project(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:34.977544 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611f66c-eb64-4351-a0cf-d7a6a5667c9e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:34.979434 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 126/251] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:34 2022] GET /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:34.982014 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611f66c-eb64-4351-a0cf-d7a6a5667c9e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:34.984861 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-f024497c-4ac0-4f87-998b-15c136c1c491 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:34.986076 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f024497c-4ac0-4f87-998b-15c136c1c491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:34.994710 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 126/252] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 09 04:27:34.995494 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024497c-4ac0-4f87-998b-15c136c1c491 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:34.995895 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611f66c-eb64-4351-a0cf-d7a6a5667c9e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:35.004104 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf9e9b-7c21-414e-b22b-c519254ab871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:35.004988 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf9e9b-7c21-414e-b22b-c519254ab871 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:35.005432 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf9e9b-7c21-414e-b22b-c519254ab871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:35.005596 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf9e9b-7c21-414e-b22b-c519254ab871 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:35.011107 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024497c-4ac0-4f87-998b-15c136c1c491 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:35.020320 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e37741-f102-4115-99cc-a0561d8ab100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:35.020976 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e37741-f102-4115-99cc-a0561d8ab100 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:35.021323 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e37741-f102-4115-99cc-a0561d8ab100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:35.021571 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e37741-f102-4115-99cc-a0561d8ab100 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:35.022431 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e37741-f102-4115-99cc-a0561d8ab100 admin admin] RBAC: Adding query filter params (role.id=850547f4dcf34a76a710ddaae9dc30de, scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6, user.id=c69c4d84dba242b8898fdb096a3bcc94) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:35.022744 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e37741-f102-4115-99cc-a0561d8ab100 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:35.024622 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e37741-f102-4115-99cc-a0561d8ab100 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:35.028539 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf9e9b-7c21-414e-b22b-c519254ab871 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:35.031675 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 127/253] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:27:34 2022] GET /identity/v3/role_assignments?user.id=c69c4d84dba242b8898fdb096a3bcc94&scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6&role.id=850547f4dcf34a76a710ddaae9dc30de => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:35.033147 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da6af7-77a8-4c8d-bca0-03ab43920451 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:35.033603 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da6af7-77a8-4c8d-bca0-03ab43920451 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:35.034024 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da6af7-77a8-4c8d-bca0-03ab43920451 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:35.035860 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-a8cf9e9b-7c21-414e-b22b-c519254ab871 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 09 04:27:35.036217 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 128/254] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:35.037086 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 127/255] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:35.041276 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da6af7-77a8-4c8d-bca0-03ab43920451 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:35.043407 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf9e9b-7c21-414e-b22b-c519254ab871 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:35.055244 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da6af7-77a8-4c8d-bca0-03ab43920451 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:35.055960 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf9e9b-7c21-414e-b22b-c519254ab871 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:35.062757 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd023b7f-4a6a-421f-ad39-3d0d1fd234a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:35.063734 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd023b7f-4a6a-421f-ad39-3d0d1fd234a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:35.063919 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd023b7f-4a6a-421f-ad39-3d0d1fd234a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:35.064250 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd023b7f-4a6a-421f-ad39-3d0d1fd234a5 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:35.064894 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbb64b-eb12-4415-a6c7-5c60d9a30589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:35.065867 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbb64b-eb12-4415-a6c7-5c60d9a30589 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:35.066174 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbb64b-eb12-4415-a6c7-5c60d9a30589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:35.066473 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbb64b-eb12-4415-a6c7-5c60d9a30589 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:35.067262 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbb64b-eb12-4415-a6c7-5c60d9a30589 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:35.067561 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbb64b-eb12-4415-a6c7-5c60d9a30589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:35.069494 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbb64b-eb12-4415-a6c7-5c60d9a30589 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:35.077565 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd023b7f-4a6a-421f-ad39-3d0d1fd234a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:35.078684 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 128/256] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:35.084563 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734535ca-b430-4c43-bbb9-edb28bd797fa None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:35.085163 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734535ca-b430-4c43-bbb9-edb28bd797fa None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:35.085272 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-dd023b7f-4a6a-421f-ad39-3d0d1fd234a5 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 09 04:27:35.085386 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734535ca-b430-4c43-bbb9-edb28bd797fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:35.086555 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 129/257] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:35.087413 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd023b7f-4a6a-421f-ad39-3d0d1fd234a5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:35.101556 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd023b7f-4a6a-421f-ad39-3d0d1fd234a5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:35.105242 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-734535ca-b430-4c43-bbb9-edb28bd797fa None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:35.105971 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77e085-53fb-43f7-8f66-d5f8237bfeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:35.106467 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-734535ca-b430-4c43-bbb9-edb28bd797fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:35.106851 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77e085-53fb-43f7-8f66-d5f8237bfeea admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:35.107133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77e085-53fb-43f7-8f66-d5f8237bfeea admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:35.107410 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77e085-53fb-43f7-8f66-d5f8237bfeea admin admin] PATH_INFO: `/v3/users/af746bdf81d3438b8c53da19f6dc2c08` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:35.109282 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77e085-53fb-43f7-8f66-d5f8237bfeea admin admin] RBAC: Authorizing `identity:get_user(user_id=af746bdf81d3438b8c53da19f6dc2c08)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:35.111479 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77e085-53fb-43f7-8f66-d5f8237bfeea admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:35.113414 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 130/258] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:35 2022] GET /identity/v3/users/af746bdf81d3438b8c53da19f6dc2c08 => generated 297 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:35.114865 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 129/259] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:35.118666 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77e085-53fb-43f7-8f66-d5f8237bfeea admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:35.122089 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734535ca-b430-4c43-bbb9-edb28bd797fa None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:35.129579 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77e085-53fb-43f7-8f66-d5f8237bfeea admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:35.134159 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d81a60-a233-44c3-a1bf-1e86df3ed825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:35.135257 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d81a60-a233-44c3-a1bf-1e86df3ed825 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:35.135257 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d81a60-a233-44c3-a1bf-1e86df3ed825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:35.135438 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d81a60-a233-44c3-a1bf-1e86df3ed825 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:35.136051 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d81a60-a233-44c3-a1bf-1e86df3ed825 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:35.136357 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d81a60-a233-44c3-a1bf-1e86df3ed825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:35.138032 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d81a60-a233-44c3-a1bf-1e86df3ed825 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:35.140121 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734535ca-b430-4c43-bbb9-edb28bd797fa None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:35.146648 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9904094-b277-4b09-af32-d4b8b8432948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:35.147682 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 131/260] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:35.148203 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904094-b277-4b09-af32-d4b8b8432948 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:35.148380 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d81a60-a233-44c3-a1bf-1e86df3ed825 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:35.148902 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904094-b277-4b09-af32-d4b8b8432948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:35.149438 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904094-b277-4b09-af32-d4b8b8432948 admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:35.150863 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9904094-b277-4b09-af32-d4b8b8432948 admin admin] RBAC: Authorizing `identity:get_project(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:35.153190 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9904094-b277-4b09-af32-d4b8b8432948 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:35.155673 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 130/261] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:35 2022] GET /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:35.156630 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9904094-b277-4b09-af32-d4b8b8432948 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:35.159619 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d81a60-a233-44c3-a1bf-1e86df3ed825 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:35.164386 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7cc47-a228-470d-b498-2cf438865100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:35.165233 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7cc47-a228-470d-b498-2cf438865100 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:35.165519 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7cc47-a228-470d-b498-2cf438865100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:35.165797 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7cc47-a228-470d-b498-2cf438865100 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:35.167041 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7cc47-a228-470d-b498-2cf438865100 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:35.168814 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7cc47-a228-470d-b498-2cf438865100 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:35.169683 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9904094-b277-4b09-af32-d4b8b8432948 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:35.171097 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 132/262] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:27:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:35.171875 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7cc47-a228-470d-b498-2cf438865100 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:35.175507 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79947016-e6b1-4649-8e1b-ebb19c7ed287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:35.176594 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79947016-e6b1-4649-8e1b-ebb19c7ed287 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:35.177022 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79947016-e6b1-4649-8e1b-ebb19c7ed287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:35.177429 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79947016-e6b1-4649-8e1b-ebb19c7ed287 admin admin] PATH_INFO: `/v3/users/32fab88ea2f74c6091479c03dd09e9ee` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:35.184262 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7cc47-a228-470d-b498-2cf438865100 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:35.193265 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79947016-e6b1-4649-8e1b-ebb19c7ed287 admin admin] RBAC: Authorizing `identity:get_user(user_id=32fab88ea2f74c6091479c03dd09e9ee)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:35.195439 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79947016-e6b1-4649-8e1b-ebb19c7ed287 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:35.196543 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d8b03-2585-4121-99d3-30674e59a04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:35.197436 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 131/263] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:35 2022] GET /identity/v3/users/32fab88ea2f74c6091479c03dd09e9ee => generated 297 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:35.198019 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79947016-e6b1-4649-8e1b-ebb19c7ed287 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:35.203745 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d8b03-2585-4121-99d3-30674e59a04a admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:35.204109 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d8b03-2585-4121-99d3-30674e59a04a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:35.204396 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2d8b03-2585-4121-99d3-30674e59a04a admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6/users/af746bdf81d3438b8c53da19f6dc2c08/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:35.207916 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d8b03-2585-4121-99d3-30674e59a04a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6, user_id=af746bdf81d3438b8c53da19f6dc2c08, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:35.209395 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79947016-e6b1-4649-8e1b-ebb19c7ed287 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:35.210660 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2d8b03-2585-4121-99d3-30674e59a04a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:35.213713 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57868e-aaee-41af-abd9-a138ceb56bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:35.214451 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57868e-aaee-41af-abd9-a138ceb56bcb admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:35.214743 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57868e-aaee-41af-abd9-a138ceb56bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:35.215030 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57868e-aaee-41af-abd9-a138ceb56bcb admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:35.223057 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57868e-aaee-41af-abd9-a138ceb56bcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:35.223057 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57868e-aaee-41af-abd9-a138ceb56bcb admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:35.226054 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 133/264] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:27:35 2022] PUT /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6/users/af746bdf81d3438b8c53da19f6dc2c08/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:27:35.226948 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d8b03-2585-4121-99d3-30674e59a04a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:35.241995 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 132/265] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Feb 9 04:27:35 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:27:35.315304 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2d8b03-2585-4121-99d3-30674e59a04a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:35.321400 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f42422-744f-4787-adba-f013748ead0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:35.322232 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f42422-744f-4787-adba-f013748ead0a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:35.322637 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f42422-744f-4787-adba-f013748ead0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:35.323009 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f42422-744f-4787-adba-f013748ead0a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:35.336052 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f42422-744f-4787-adba-f013748ead0a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:35.336052 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f42422-744f-4787-adba-f013748ead0a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:35.350147 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 134/266] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:35.355563 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57868e-aaee-41af-abd9-a138ceb56bcb admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:35.366925 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57868e-aaee-41af-abd9-a138ceb56bcb admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:35.371941 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea5919-2ea8-4dd3-bec3-93baf001efbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:35.372828 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea5919-2ea8-4dd3-bec3-93baf001efbb admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:35.373145 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea5919-2ea8-4dd3-bec3-93baf001efbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:35.373443 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea5919-2ea8-4dd3-bec3-93baf001efbb admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:35.374829 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea5919-2ea8-4dd3-bec3-93baf001efbb admin admin] RBAC: Authorizing `identity:get_project(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:35.376996 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea5919-2ea8-4dd3-bec3-93baf001efbb admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:35.379276 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 133/267] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:35 2022] GET /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:35.385366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f42422-744f-4787-adba-f013748ead0a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:35.395212 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f42422-744f-4787-adba-f013748ead0a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:35.399823 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43c476-bfc0-4006-bab9-8f95cb69004f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:35.400498 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43c476-bfc0-4006-bab9-8f95cb69004f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:35.400783 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43c476-bfc0-4006-bab9-8f95cb69004f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:35.401150 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43c476-bfc0-4006-bab9-8f95cb69004f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:35.402014 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43c476-bfc0-4006-bab9-8f95cb69004f admin admin] RBAC: Adding query filter params (role.id=25d1ad8b112c4326a3a8e579f24a6d75, scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6, user.id=32fab88ea2f74c6091479c03dd09e9ee) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:35.402327 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43c476-bfc0-4006-bab9-8f95cb69004f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:35.404250 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43c476-bfc0-4006-bab9-8f95cb69004f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:35.411522 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 135/268] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:27:35 2022] GET /identity/v3/role_assignments?user.id=32fab88ea2f74c6091479c03dd09e9ee&scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6&role.id=25d1ad8b112c4326a3a8e579f24a6d75 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:37.485836 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c746ee7-51d4-4870-ac34-a851b99edf2f None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.486347 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c746ee7-51d4-4870-ac34-a851b99edf2f None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.486421 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c746ee7-51d4-4870-ac34-a851b99edf2f None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.488184 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 134/269] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:37.493683 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f511d85-8f65-4c3f-b477-b5c7e57e3643 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.494077 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f511d85-8f65-4c3f-b477-b5c7e57e3643 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.494241 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f511d85-8f65-4c3f-b477-b5c7e57e3643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.512100 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-0f511d85-8f65-4c3f-b477-b5c7e57e3643 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:37.513326 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0f511d85-8f65-4c3f-b477-b5c7e57e3643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:37.520975 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 136/270] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:37.550500 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c746ee7-51d4-4870-ac34-a851b99edf2f None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:37.563046 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c746ee7-51d4-4870-ac34-a851b99edf2f None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:37.567565 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08251819-605d-4c5d-998d-972bea716b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:37.568352 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08251819-605d-4c5d-998d-972bea716b22 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.568636 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08251819-605d-4c5d-998d-972bea716b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.568910 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08251819-605d-4c5d-998d-972bea716b22 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.588968 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08251819-605d-4c5d-998d-972bea716b22 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:37.596582 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-08251819-605d-4c5d-998d-972bea716b22 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 09 04:27:37.598124 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 135/271] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:37.603727 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f511d85-8f65-4c3f-b477-b5c7e57e3643 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:37.615976 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f511d85-8f65-4c3f-b477-b5c7e57e3643 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:37.620462 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa87ed-2a01-4e85-a927-e5243aefeac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:37.621158 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa87ed-2a01-4e85-a927-e5243aefeac3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.621444 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa87ed-2a01-4e85-a927-e5243aefeac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.621721 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa87ed-2a01-4e85-a927-e5243aefeac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.622489 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa87ed-2a01-4e85-a927-e5243aefeac3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:37.622795 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa87ed-2a01-4e85-a927-e5243aefeac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:37.624772 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa87ed-2a01-4e85-a927-e5243aefeac3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:37.625779 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee6554-76e4-4582-ad8b-b1c743abe3a2 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.626071 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee6554-76e4-4582-ad8b-b1c743abe3a2 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.626351 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee6554-76e4-4582-ad8b-b1c743abe3a2 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.628368 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 136/272] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:27:37.633506 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40a8c1-7b98-414c-9abb-96732a4eae38 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.633739 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 137/273] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:37.634087 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40a8c1-7b98-414c-9abb-96732a4eae38 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.634370 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40a8c1-7b98-414c-9abb-96732a4eae38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.638639 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc8616-b8d4-4dd8-b58d-9f8adc94b6b1 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.639242 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc8616-b8d4-4dd8-b58d-9f8adc94b6b1 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.639751 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc8616-b8d4-4dd8-b58d-9f8adc94b6b1 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.643000 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 138/274] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:37.644133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc8616-b8d4-4dd8-b58d-9f8adc94b6b1 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:37.652392 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-cb40a8c1-7b98-414c-9abb-96732a4eae38 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:37.653645 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-cb40a8c1-7b98-414c-9abb-96732a4eae38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:37.658117 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc8616-b8d4-4dd8-b58d-9f8adc94b6b1 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:37.661881 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 137/275] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 09 04:27:37.663409 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afb0d3-9323-40e2-a0f0-7280be04f362 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.663633 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092e47a-3025-4757-86a2-d724fe74ca38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:37.663760 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afb0d3-9323-40e2-a0f0-7280be04f362 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.663960 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afb0d3-9323-40e2-a0f0-7280be04f362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.664979 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092e47a-3025-4757-86a2-d724fe74ca38 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.665634 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092e47a-3025-4757-86a2-d724fe74ca38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.666195 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092e47a-3025-4757-86a2-d724fe74ca38 admin admin] PATH_INFO: `/v3/users/af746bdf81d3438b8c53da19f6dc2c08` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.667660 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092e47a-3025-4757-86a2-d724fe74ca38 admin admin] RBAC: Authorizing `identity:get_user(user_id=af746bdf81d3438b8c53da19f6dc2c08)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:37.670141 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092e47a-3025-4757-86a2-d724fe74ca38 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:37.672627 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 139/276] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:37 2022] GET /identity/v3/users/af746bdf81d3438b8c53da19f6dc2c08 => generated 297 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:37.678270 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092e47a-3025-4757-86a2-d724fe74ca38 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:37.681832 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-c4afb0d3-9323-40e2-a0f0-7280be04f362 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:37.683014 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-c4afb0d3-9323-40e2-a0f0-7280be04f362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:37.688695 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092e47a-3025-4757-86a2-d724fe74ca38 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:37.690654 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 138/277] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:37.691925 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad422274-9389-45cd-8a14-1ce1dcf3bc5a None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.692210 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad422274-9389-45cd-8a14-1ce1dcf3bc5a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.692488 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad422274-9389-45cd-8a14-1ce1dcf3bc5a None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.693467 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f959fa3-ea4a-44f1-bd89-ac3596025ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:37.694100 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f959fa3-ea4a-44f1-bd89-ac3596025ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.694192 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 139/278] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:37.694452 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f959fa3-ea4a-44f1-bd89-ac3596025ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.695778 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f959fa3-ea4a-44f1-bd89-ac3596025ec7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.695890 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad422274-9389-45cd-8a14-1ce1dcf3bc5a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:37.702799 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f959fa3-ea4a-44f1-bd89-ac3596025ec7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:37.704574 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f959fa3-ea4a-44f1-bd89-ac3596025ec7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:37.707508 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad422274-9389-45cd-8a14-1ce1dcf3bc5a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:37.711961 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ea5ea-5ff5-4339-8c46-43b808c6c206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:37.712908 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ea5ea-5ff5-4339-8c46-43b808c6c206 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.713351 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 140/279] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:37.713490 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ea5ea-5ff5-4339-8c46-43b808c6c206 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.713759 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ea5ea-5ff5-4339-8c46-43b808c6c206 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.714653 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea0529-8785-4b7c-85e8-014bc03b1bb5 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.714943 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea0529-8785-4b7c-85e8-014bc03b1bb5 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.715223 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea0529-8785-4b7c-85e8-014bc03b1bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.724587 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ea5ea-5ff5-4339-8c46-43b808c6c206 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:37.731457 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-485ea5ea-5ff5-4339-8c46-43b808c6c206 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 09 04:27:37.732378 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-84ea0529-8785-4b7c-85e8-014bc03b1bb5 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:37.732618 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 140/280] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:37.733978 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ea5ea-5ff5-4339-8c46-43b808c6c206 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:37.734384 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-84ea0529-8785-4b7c-85e8-014bc03b1bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:37.741941 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 141/281] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:37.742687 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea0529-8785-4b7c-85e8-014bc03b1bb5 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:37.742962 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ea5ea-5ff5-4339-8c46-43b808c6c206 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:37.747103 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ad3a1-7edb-407b-b6a5-0c541ddc3dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:37.747819 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ad3a1-7edb-407b-b6a5-0c541ddc3dfe admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.748452 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ad3a1-7edb-407b-b6a5-0c541ddc3dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.748452 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ad3a1-7edb-407b-b6a5-0c541ddc3dfe admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.751535 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea0529-8785-4b7c-85e8-014bc03b1bb5 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:37.755654 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5222d3-5006-4ffd-9996-67edb8ec1d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:37.756459 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5222d3-5006-4ffd-9996-67edb8ec1d0e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.756733 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5222d3-5006-4ffd-9996-67edb8ec1d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.757000 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5222d3-5006-4ffd-9996-67edb8ec1d0e admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.758182 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5222d3-5006-4ffd-9996-67edb8ec1d0e admin admin] RBAC: Authorizing `identity:get_project(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:37.758886 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ad3a1-7edb-407b-b6a5-0c541ddc3dfe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:37.760202 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5222d3-5006-4ffd-9996-67edb8ec1d0e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:37.766215 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 142/282] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:37 2022] GET /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6 => generated 302 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:37.766215 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5222d3-5006-4ffd-9996-67edb8ec1d0e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:37.766410 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-2d4ad3a1-7edb-407b-b6a5-0c541ddc3dfe admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 09 04:27:37.767587 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 141/283] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:37.768334 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ad3a1-7edb-407b-b6a5-0c541ddc3dfe admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:37.775614 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5222d3-5006-4ffd-9996-67edb8ec1d0e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:37.777455 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ad3a1-7edb-407b-b6a5-0c541ddc3dfe admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:37.780342 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd949acb-d90e-4a6f-a03f-3af611adcf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:37.780970 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd949acb-d90e-4a6f-a03f-3af611adcf37 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.781272 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd949acb-d90e-4a6f-a03f-3af611adcf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.781542 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd949acb-d90e-4a6f-a03f-3af611adcf37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.782281 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd949acb-d90e-4a6f-a03f-3af611adcf37 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:37.782517 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f095a1-6b80-43d7-a85c-8ef5cc062201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:37.782621 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd949acb-d90e-4a6f-a03f-3af611adcf37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:37.783240 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f095a1-6b80-43d7-a85c-8ef5cc062201 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.783524 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f095a1-6b80-43d7-a85c-8ef5cc062201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.783797 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f095a1-6b80-43d7-a85c-8ef5cc062201 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.784120 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd949acb-d90e-4a6f-a03f-3af611adcf37 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:37.784964 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f095a1-6b80-43d7-a85c-8ef5cc062201 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:37.786669 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f095a1-6b80-43d7-a85c-8ef5cc062201 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:37.788490 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 142/284] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:27:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:37.789659 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f095a1-6b80-43d7-a85c-8ef5cc062201 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:37.797091 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 143/285] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:37.797091 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd949acb-d90e-4a6f-a03f-3af611adcf37 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:37.798767 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f095a1-6b80-43d7-a85c-8ef5cc062201 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:37.802594 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd949acb-d90e-4a6f-a03f-3af611adcf37 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:37.803015 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f57b69-6d23-441f-9a0d-d88f3a1ad379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:37.803613 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f57b69-6d23-441f-9a0d-d88f3a1ad379 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.803897 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f57b69-6d23-441f-9a0d-d88f3a1ad379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.804175 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f57b69-6d23-441f-9a0d-d88f3a1ad379 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.804993 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f57b69-6d23-441f-9a0d-d88f3a1ad379 admin admin] RBAC: Adding query filter params (role.id=102f883957d846419d33ce22fdec0cce, scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6, user.id=af746bdf81d3438b8c53da19f6dc2c08) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:37.805334 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f57b69-6d23-441f-9a0d-d88f3a1ad379 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:37.806917 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af900138-30b2-4d8a-9a06-f3856fba12ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:37.807156 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f57b69-6d23-441f-9a0d-d88f3a1ad379 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:37.807540 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af900138-30b2-4d8a-9a06-f3856fba12ba admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.807822 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af900138-30b2-4d8a-9a06-f3856fba12ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.808096 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af900138-30b2-4d8a-9a06-f3856fba12ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.808840 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af900138-30b2-4d8a-9a06-f3856fba12ba admin admin] RBAC: Adding query filter params (name=member) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:37.809178 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af900138-30b2-4d8a-9a06-f3856fba12ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:37.810736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af900138-30b2-4d8a-9a06-f3856fba12ba admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:37.812899 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 143/286] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:27:37 2022] GET /identity/v3/role_assignments?user.id=af746bdf81d3438b8c53da19f6dc2c08&scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6&role.id=102f883957d846419d33ce22fdec0cce => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:37.813668 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f57b69-6d23-441f-9a0d-d88f3a1ad379 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:37.819289 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 144/287] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:37.820050 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af900138-30b2-4d8a-9a06-f3856fba12ba admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:37.826269 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f57b69-6d23-441f-9a0d-d88f3a1ad379 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:37.830600 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af900138-30b2-4d8a-9a06-f3856fba12ba admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:37.831624 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2e118-2d64-4fce-a9af-2cb25446c4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:37.832322 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2e118-2d64-4fce-a9af-2cb25446c4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.832606 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2e118-2d64-4fce-a9af-2cb25446c4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.832883 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2e118-2d64-4fce-a9af-2cb25446c4b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.833656 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2e118-2d64-4fce-a9af-2cb25446c4b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:37.835274 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1590bc7-68ca-4923-9580-9c10f7f1263e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:37.835614 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2e118-2d64-4fce-a9af-2cb25446c4b9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:37.836170 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1590bc7-68ca-4923-9580-9c10f7f1263e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.836450 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1590bc7-68ca-4923-9580-9c10f7f1263e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.836719 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1590bc7-68ca-4923-9580-9c10f7f1263e admin admin] PATH_INFO: `/v3/users/32fab88ea2f74c6091479c03dd09e9ee` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.837992 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1590bc7-68ca-4923-9580-9c10f7f1263e admin admin] RBAC: Authorizing `identity:get_user(user_id=32fab88ea2f74c6091479c03dd09e9ee)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:37.840161 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1590bc7-68ca-4923-9580-9c10f7f1263e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:37.842105 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 145/288] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:37 2022] GET /identity/v3/users/32fab88ea2f74c6091479c03dd09e9ee => generated 297 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:37.843420 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1590bc7-68ca-4923-9580-9c10f7f1263e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:37.854809 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1590bc7-68ca-4923-9580-9c10f7f1263e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:37.859383 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ab744-b634-4052-8db1-f4f066d6667c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:37.859662 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 144/289] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Feb 9 04:27:37 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:27:37.860260 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ab744-b634-4052-8db1-f4f066d6667c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.860615 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ab744-b634-4052-8db1-f4f066d6667c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.860935 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ab744-b634-4052-8db1-f4f066d6667c admin admin] PATH_INFO: `/v3/users/13995da9e09040238b17e9db472523f7` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.861111 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2e118-2d64-4fce-a9af-2cb25446c4b9 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:37.880851 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2e118-2d64-4fce-a9af-2cb25446c4b9 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:37.881087 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ab744-b634-4052-8db1-f4f066d6667c admin admin] RBAC: Authorizing `identity:get_user(user_id=13995da9e09040238b17e9db472523f7)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:37.883199 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ab744-b634-4052-8db1-f4f066d6667c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:37.889521 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 146/290] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:37 2022] GET /identity/v3/users/13995da9e09040238b17e9db472523f7 => generated 293 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:37.892377 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ab744-b634-4052-8db1-f4f066d6667c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:37.893452 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838e244-c601-47e0-8e9e-4ad7adf8d794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:37.894343 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838e244-c601-47e0-8e9e-4ad7adf8d794 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.894618 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838e244-c601-47e0-8e9e-4ad7adf8d794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.894888 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838e244-c601-47e0-8e9e-4ad7adf8d794 admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.896628 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838e244-c601-47e0-8e9e-4ad7adf8d794 admin admin] RBAC: Authorizing `identity:get_project(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:37.898824 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838e244-c601-47e0-8e9e-4ad7adf8d794 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:37.900880 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 145/291] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:37 2022] GET /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6 => generated 302 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:37.907959 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ab744-b634-4052-8db1-f4f066d6667c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:37.910599 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838e244-c601-47e0-8e9e-4ad7adf8d794 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:37.913362 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20bcd6-1df0-4803-ab13-309a4ebc8344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:37.914198 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20bcd6-1df0-4803-ab13-309a4ebc8344 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.914586 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20bcd6-1df0-4803-ab13-309a4ebc8344 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.914969 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20bcd6-1df0-4803-ab13-309a4ebc8344 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.916240 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20bcd6-1df0-4803-ab13-309a4ebc8344 admin admin] RBAC: Adding query filter params (role.id=102f883957d846419d33ce22fdec0cce, user.id=13995da9e09040238b17e9db472523f7, scope.system=all) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:37.916703 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20bcd6-1df0-4803-ab13-309a4ebc8344 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:37.919002 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20bcd6-1df0-4803-ab13-309a4ebc8344 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:37.927488 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838e244-c601-47e0-8e9e-4ad7adf8d794 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:37.933284 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 147/292] 10.222.0.36 () {56 vars in 1329 bytes} [Wed Feb 9 04:27:37 2022] GET /identity/v3/role_assignments?user.id=13995da9e09040238b17e9db472523f7&scope.system=all&role.id=102f883957d846419d33ce22fdec0cce => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:37.941043 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da418d-6c01-40ff-b5cf-727528ff492f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:37.942387 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da418d-6c01-40ff-b5cf-727528ff492f admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:37.942892 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da418d-6c01-40ff-b5cf-727528ff492f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:37.943636 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da418d-6c01-40ff-b5cf-727528ff492f admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6/users/32fab88ea2f74c6091479c03dd09e9ee/roles/25d1ad8b112c4326a3a8e579f24a6d75` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:37.946884 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da418d-6c01-40ff-b5cf-727528ff492f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6, user_id=32fab88ea2f74c6091479c03dd09e9ee, role_id=25d1ad8b112c4326a3a8e579f24a6d75)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:37.950613 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da418d-6c01-40ff-b5cf-727528ff492f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:37.981231 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 146/293] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:27:37 2022] PUT /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6/users/32fab88ea2f74c6091479c03dd09e9ee/roles/25d1ad8b112c4326a3a8e579f24a6d75 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:27:40.215833 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c9cff-f20f-4472-9fa1-2c4067a1aa49 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.216383 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c9cff-f20f-4472-9fa1-2c4067a1aa49 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.216657 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c9cff-f20f-4472-9fa1-2c4067a1aa49 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.219391 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 148/294] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:40.224851 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea2150-1f72-424f-becf-0fdb9fcd45ad None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.225297 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea2150-1f72-424f-becf-0fdb9fcd45ad None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.225615 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea2150-1f72-424f-becf-0fdb9fcd45ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.243727 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-fdea2150-1f72-424f-becf-0fdb9fcd45ad None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:40.244898 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-fdea2150-1f72-424f-becf-0fdb9fcd45ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:40.261930 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32402a75-13ae-401b-9802-4ee6906e83f0 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.262220 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32402a75-13ae-401b-9802-4ee6906e83f0 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.262488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32402a75-13ae-401b-9802-4ee6906e83f0 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.264944 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 149/295] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:40.269871 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27807349-2d0f-42b7-82ff-766d624f749c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.270156 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27807349-2d0f-42b7-82ff-766d624f749c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.270436 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27807349-2d0f-42b7-82ff-766d624f749c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.288932 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-27807349-2d0f-42b7-82ff-766d624f749c None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:40.290157 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-27807349-2d0f-42b7-82ff-766d624f749c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:40.304404 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 147/296] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:40.319605 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27465e2c-36c4-4bef-99ae-dd91380aeb22 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.319890 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27465e2c-36c4-4bef-99ae-dd91380aeb22 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.320163 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27465e2c-36c4-4bef-99ae-dd91380aeb22 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.321954 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 148/297] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:27:40.327559 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83d2a5-5e04-413a-92a8-3bebb156f21e None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.327837 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83d2a5-5e04-413a-92a8-3bebb156f21e None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.328103 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d83d2a5-5e04-413a-92a8-3bebb156f21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.346583 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-6d83d2a5-5e04-413a-92a8-3bebb156f21e None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:40.348002 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-6d83d2a5-5e04-413a-92a8-3bebb156f21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:40.349677 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 150/298] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 09 04:27:40.351045 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27807349-2d0f-42b7-82ff-766d624f749c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:40.355761 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 149/299] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 09 04:27:40.360991 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27807349-2d0f-42b7-82ff-766d624f749c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:40.365587 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a5314-4de6-494e-9e50-c36d42b77f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:40.366595 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a5314-4de6-494e-9e50-c36d42b77f80 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.367099 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a5314-4de6-494e-9e50-c36d42b77f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.367576 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a5314-4de6-494e-9e50-c36d42b77f80 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.372026 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83d2a5-5e04-413a-92a8-3bebb156f21e None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:40.382797 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d83d2a5-5e04-413a-92a8-3bebb156f21e None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:40.384264 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a5314-4de6-494e-9e50-c36d42b77f80 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:40.387117 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f29fd-66f1-4b5f-aadf-3ff02319d670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:40.387894 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f29fd-66f1-4b5f-aadf-3ff02319d670 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.388175 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f29fd-66f1-4b5f-aadf-3ff02319d670 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.388448 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f29fd-66f1-4b5f-aadf-3ff02319d670 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.391762 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-d39a5314-4de6-494e-9e50-c36d42b77f80 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 09 04:27:40.393125 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 151/300] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:40.393798 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a5314-4de6-494e-9e50-c36d42b77f80 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:40.403243 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a5314-4de6-494e-9e50-c36d42b77f80 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:40.405218 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f29fd-66f1-4b5f-aadf-3ff02319d670 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:40.407617 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319f22d-7e74-4214-8a42-c6b401dc2893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:40.408352 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319f22d-7e74-4214-8a42-c6b401dc2893 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.408636 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319f22d-7e74-4214-8a42-c6b401dc2893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.408911 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319f22d-7e74-4214-8a42-c6b401dc2893 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.410105 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319f22d-7e74-4214-8a42-c6b401dc2893 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:40.411805 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319f22d-7e74-4214-8a42-c6b401dc2893 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:40.412069 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-0a8f29fd-66f1-4b5f-aadf-3ff02319d670 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 09 04:27:40.413571 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 150/301] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:27:40.413684 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 152/302] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:27:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:40.415037 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45d837-6d1f-4d92-a20c-a72b54dcb24f None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.415329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45d837-6d1f-4d92-a20c-a72b54dcb24f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.415608 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45d837-6d1f-4d92-a20c-a72b54dcb24f None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.415710 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f29fd-66f1-4b5f-aadf-3ff02319d670 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:40.417371 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 153/303] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:40.418939 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45d837-6d1f-4d92-a20c-a72b54dcb24f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:40.426698 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f29fd-66f1-4b5f-aadf-3ff02319d670 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:40.430756 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb45d837-6d1f-4d92-a20c-a72b54dcb24f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:40.430952 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc25f18-be5e-4e97-bad7-5c776924f832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:40.431592 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc25f18-be5e-4e97-bad7-5c776924f832 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.431876 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc25f18-be5e-4e97-bad7-5c776924f832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.432152 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc25f18-be5e-4e97-bad7-5c776924f832 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.432914 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc25f18-be5e-4e97-bad7-5c776924f832 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:40.433259 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc25f18-be5e-4e97-bad7-5c776924f832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:40.434846 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc25f18-be5e-4e97-bad7-5c776924f832 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:40.435041 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fd355-1b82-46e0-b286-2cf967fd9f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:40.435676 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fd355-1b82-46e0-b286-2cf967fd9f01 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.436516 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fd355-1b82-46e0-b286-2cf967fd9f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.436964 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fd355-1b82-46e0-b286-2cf967fd9f01 admin admin] PATH_INFO: `/v3/groups` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.437687 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4fd355-1b82-46e0-b286-2cf967fd9f01 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:40.438691 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-cc4fd355-1b82-46e0-b286-2cf967fd9f01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:27:40.438691 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 09 04:27:40.438691 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: Feb 09 04:27:40.439861 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4fd355-1b82-46e0-b286-2cf967fd9f01 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:40.444061 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 151/304] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:40.444841 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc25f18-be5e-4e97-bad7-5c776924f832 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:40.454627 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 154/305] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Feb 9 04:27:40 2022] POST /identity/v3/groups => generated 229 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:27:40.455776 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e5e25-f95d-46c8-b909-d7203cf9ad4a None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.456064 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e5e25-f95d-46c8-b909-d7203cf9ad4a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.456338 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e5e25-f95d-46c8-b909-d7203cf9ad4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.460477 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc25f18-be5e-4e97-bad7-5c776924f832 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:40.465204 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7da29-d0c1-4bf7-9237-260aba27e4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:40.465948 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7da29-d0c1-4bf7-9237-260aba27e4bd admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.466173 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7da29-d0c1-4bf7-9237-260aba27e4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.466450 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7da29-d0c1-4bf7-9237-260aba27e4bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.467270 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7da29-d0c1-4bf7-9237-260aba27e4bd admin admin] RBAC: Adding query filter params (name=member) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:40.467575 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7da29-d0c1-4bf7-9237-260aba27e4bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:40.469257 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd7da29-d0c1-4bf7-9237-260aba27e4bd admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:40.475179 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ab3e5e25-f95d-46c8-b909-d7203cf9ad4a None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:40.476422 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ab3e5e25-f95d-46c8-b909-d7203cf9ad4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:40.483982 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 152/306] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:40.483982 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7da29-d0c1-4bf7-9237-260aba27e4bd admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:40.488246 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 155/307] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:40.488961 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e5e25-f95d-46c8-b909-d7203cf9ad4a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:40.498842 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e5e25-f95d-46c8-b909-d7203cf9ad4a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:40.499297 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7da29-d0c1-4bf7-9237-260aba27e4bd admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:40.503678 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb5e9e-178c-43da-b3e1-c79bd6a1ec51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:40.504575 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb5e9e-178c-43da-b3e1-c79bd6a1ec51 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.504861 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb5e9e-178c-43da-b3e1-c79bd6a1ec51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.505065 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096ba2b-d3af-404b-97c9-58a04aca772f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:40.505199 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb5e9e-178c-43da-b3e1-c79bd6a1ec51 admin admin] PATH_INFO: `/v3/users/13995da9e09040238b17e9db472523f7` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.506213 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096ba2b-d3af-404b-97c9-58a04aca772f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.506469 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb5e9e-178c-43da-b3e1-c79bd6a1ec51 admin admin] RBAC: Authorizing `identity:get_user(user_id=13995da9e09040238b17e9db472523f7)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:40.506791 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096ba2b-d3af-404b-97c9-58a04aca772f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.507203 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096ba2b-d3af-404b-97c9-58a04aca772f admin admin] PATH_INFO: `/v3/users/32fab88ea2f74c6091479c03dd09e9ee` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.508691 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb5e9e-178c-43da-b3e1-c79bd6a1ec51 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:40.508977 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096ba2b-d3af-404b-97c9-58a04aca772f admin admin] RBAC: Authorizing `identity:get_user(user_id=32fab88ea2f74c6091479c03dd09e9ee)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:40.510642 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 156/308] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:40 2022] GET /identity/v3/users/13995da9e09040238b17e9db472523f7 => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:40.511862 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5096ba2b-d3af-404b-97c9-58a04aca772f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:40.514534 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 153/309] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:40 2022] GET /identity/v3/users/32fab88ea2f74c6091479c03dd09e9ee => generated 297 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:40.516790 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096ba2b-d3af-404b-97c9-58a04aca772f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:40.516936 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb5e9e-178c-43da-b3e1-c79bd6a1ec51 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:40.527113 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb5e9e-178c-43da-b3e1-c79bd6a1ec51 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:40.528777 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096ba2b-d3af-404b-97c9-58a04aca772f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:40.531715 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f40a55-44ef-4e77-8561-68d9855ee552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:40.532515 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f40a55-44ef-4e77-8561-68d9855ee552 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.532800 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f40a55-44ef-4e77-8561-68d9855ee552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.533106 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f40a55-44ef-4e77-8561-68d9855ee552 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.533471 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67c0bf-a8ad-4b9c-9fe5-5654e6e5d91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:40.534391 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67c0bf-a8ad-4b9c-9fe5-5654e6e5d91c admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.534674 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67c0bf-a8ad-4b9c-9fe5-5654e6e5d91c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.534952 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67c0bf-a8ad-4b9c-9fe5-5654e6e5d91c admin admin] PATH_INFO: `/v3/system/users/13995da9e09040238b17e9db472523f7/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.537241 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67c0bf-a8ad-4b9c-9fe5-5654e6e5d91c admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=13995da9e09040238b17e9db472523f7, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:40.538543 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING py.warnings [None req-ed67c0bf-a8ad-4b9c-9fe5-5654e6e5d91c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:27:40.538543 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: warnings.warn(msg) Feb 09 04:27:40.538543 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: Feb 09 04:27:40.539782 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67c0bf-a8ad-4b9c-9fe5-5654e6e5d91c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:40.545183 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f40a55-44ef-4e77-8561-68d9855ee552 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:40.552305 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-d5f40a55-44ef-4e77-8561-68d9855ee552 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 09 04:27:40.553599 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 157/310] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:40.554121 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 154/311] 10.222.0.36 () {58 vars in 1355 bytes} [Wed Feb 9 04:27:40 2022] PUT /identity/v3/system/users/13995da9e09040238b17e9db472523f7/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:27:40.559916 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67c0bf-a8ad-4b9c-9fe5-5654e6e5d91c admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:40.565524 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f40a55-44ef-4e77-8561-68d9855ee552 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:40.576091 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67c0bf-a8ad-4b9c-9fe5-5654e6e5d91c admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:40.580141 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f40a55-44ef-4e77-8561-68d9855ee552 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:40.582925 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bab64e-bbe1-43cd-9641-ff96f5ec535b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:40.583968 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bab64e-bbe1-43cd-9641-ff96f5ec535b admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.584507 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bab64e-bbe1-43cd-9641-ff96f5ec535b admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.584936 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bab64e-bbe1-43cd-9641-ff96f5ec535b admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.585591 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683cfef-4e50-4fcb-85dc-1b0ac673b918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:40.586216 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bab64e-bbe1-43cd-9641-ff96f5ec535b admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:40.586333 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683cfef-4e50-4fcb-85dc-1b0ac673b918 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.586614 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683cfef-4e50-4fcb-85dc-1b0ac673b918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.586942 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683cfef-4e50-4fcb-85dc-1b0ac673b918 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.587059 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bab64e-bbe1-43cd-9641-ff96f5ec535b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:40.589189 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bab64e-bbe1-43cd-9641-ff96f5ec535b admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:40.596134 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683cfef-4e50-4fcb-85dc-1b0ac673b918 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:40.598153 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7683cfef-4e50-4fcb-85dc-1b0ac673b918 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:40.601969 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 155/312] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:40.607777 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bab64e-bbe1-43cd-9641-ff96f5ec535b admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:40.610063 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 158/313] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:40.616280 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683cfef-4e50-4fcb-85dc-1b0ac673b918 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:40.626171 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bab64e-bbe1-43cd-9641-ff96f5ec535b admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:40.627212 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683cfef-4e50-4fcb-85dc-1b0ac673b918 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:40.632071 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3b25a-543e-4dd2-8fb1-f348236cace6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:40.632268 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5de45-ffe8-488a-9cf2-b06ce4449130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:40.633201 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5de45-ffe8-488a-9cf2-b06ce4449130 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.633526 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5de45-ffe8-488a-9cf2-b06ce4449130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.633809 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5de45-ffe8-488a-9cf2-b06ce4449130 admin admin] PATH_INFO: `/v3/users/39f5826da40c4bb9a1c0171d7bbe6564` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.634026 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3b25a-543e-4dd2-8fb1-f348236cace6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.634484 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3b25a-543e-4dd2-8fb1-f348236cace6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.634932 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3b25a-543e-4dd2-8fb1-f348236cace6 admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.636639 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3b25a-543e-4dd2-8fb1-f348236cace6 admin admin] RBAC: Authorizing `identity:get_project(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:40.640713 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3b25a-543e-4dd2-8fb1-f348236cace6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:40.648100 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 159/314] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:40 2022] GET /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:40.651249 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3b25a-543e-4dd2-8fb1-f348236cace6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:40.657966 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5de45-ffe8-488a-9cf2-b06ce4449130 admin admin] RBAC: Authorizing `identity:get_user(user_id=39f5826da40c4bb9a1c0171d7bbe6564)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:40.660249 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5de45-ffe8-488a-9cf2-b06ce4449130 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:40.661352 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3b25a-543e-4dd2-8fb1-f348236cace6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:40.662463 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 156/315] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:40 2022] GET /identity/v3/users/39f5826da40c4bb9a1c0171d7bbe6564 => generated 293 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:40.666164 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb8324-fe75-4c10-9775-c601553722a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:40.666831 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb8324-fe75-4c10-9775-c601553722a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.667112 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb8324-fe75-4c10-9775-c601553722a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.667385 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb8324-fe75-4c10-9775-c601553722a6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.668245 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb8324-fe75-4c10-9775-c601553722a6 admin admin] RBAC: Adding query filter params (role.id=25d1ad8b112c4326a3a8e579f24a6d75, scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6, user.id=32fab88ea2f74c6091479c03dd09e9ee) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:40.668640 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb8324-fe75-4c10-9775-c601553722a6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:40.669951 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5de45-ffe8-488a-9cf2-b06ce4449130 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:40.670594 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb8324-fe75-4c10-9775-c601553722a6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:40.677428 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 160/316] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:27:40 2022] GET /identity/v3/role_assignments?user.id=32fab88ea2f74c6091479c03dd09e9ee&scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6&role.id=25d1ad8b112c4326a3a8e579f24a6d75 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:40.680514 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5de45-ffe8-488a-9cf2-b06ce4449130 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:40.688599 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7da54-afd3-4ca8-bdf1-05be67ebea99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:40.691222 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7da54-afd3-4ca8-bdf1-05be67ebea99 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:40.691222 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7da54-afd3-4ca8-bdf1-05be67ebea99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:40.691222 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7da54-afd3-4ca8-bdf1-05be67ebea99 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:40.691222 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7da54-afd3-4ca8-bdf1-05be67ebea99 admin admin] RBAC: Adding query filter params (role.id=25d1ad8b112c4326a3a8e579f24a6d75, user.id=39f5826da40c4bb9a1c0171d7bbe6564, scope.system=all) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:40.691649 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7da54-afd3-4ca8-bdf1-05be67ebea99 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:40.694641 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7da54-afd3-4ca8-bdf1-05be67ebea99 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:40.703464 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 157/317] 10.222.0.36 () {56 vars in 1329 bytes} [Wed Feb 9 04:27:40 2022] GET /identity/v3/role_assignments?user.id=39f5826da40c4bb9a1c0171d7bbe6564&scope.system=all&role.id=25d1ad8b112c4326a3a8e579f24a6d75 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:42.745503 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2110b-8eb9-403f-853e-ebe264537af3 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:42.746003 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2110b-8eb9-403f-853e-ebe264537af3 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:42.746075 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2110b-8eb9-403f-853e-ebe264537af3 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:42.747830 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 161/318] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:42.753064 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85c9bf-a429-4230-a2bc-6ae076c5463e None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:42.753462 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85c9bf-a429-4230-a2bc-6ae076c5463e None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:42.753639 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85c9bf-a429-4230-a2bc-6ae076c5463e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:42.770916 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-3d85c9bf-a429-4230-a2bc-6ae076c5463e None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:42.772080 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-3d85c9bf-a429-4230-a2bc-6ae076c5463e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:42.779405 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 158/319] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:42.780026 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3aff9-a680-4bde-914b-1b9b3b656f86 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:42.780255 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3aff9-a680-4bde-914b-1b9b3b656f86 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:42.780534 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3aff9-a680-4bde-914b-1b9b3b656f86 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:42.782319 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 162/320] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:27:42.787196 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bd0a3-0c47-4923-932b-b20e3a8b1ac5 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:42.787487 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bd0a3-0c47-4923-932b-b20e3a8b1ac5 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:42.788025 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bd0a3-0c47-4923-932b-b20e3a8b1ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:42.803414 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3aff9-a680-4bde-914b-1b9b3b656f86 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:42.807727 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-610bd0a3-0c47-4923-932b-b20e3a8b1ac5 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:42.808932 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-610bd0a3-0c47-4923-932b-b20e3a8b1ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:42.815048 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3aff9-a680-4bde-914b-1b9b3b656f86 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:42.816630 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 159/321] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:42.819406 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040097b-9a15-480e-b1ca-e1bdb31c5ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:42.820179 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040097b-9a15-480e-b1ca-e1bdb31c5ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:42.820460 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040097b-9a15-480e-b1ca-e1bdb31c5ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:42.820735 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040097b-9a15-480e-b1ca-e1bdb31c5ce5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:42.821913 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040097b-9a15-480e-b1ca-e1bdb31c5ce5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:42.823592 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040097b-9a15-480e-b1ca-e1bdb31c5ce5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:42.825266 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 163/322] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:27:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:42.830597 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bd0a3-0c47-4923-932b-b20e3a8b1ac5 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:42.839636 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bd0a3-0c47-4923-932b-b20e3a8b1ac5 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:42.839976 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040097b-9a15-480e-b1ca-e1bdb31c5ce5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:42.844340 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22be1c-2383-47d5-8acf-4f88ecc9d9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:42.844976 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22be1c-2383-47d5-8acf-4f88ecc9d9cc admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:42.845286 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22be1c-2383-47d5-8acf-4f88ecc9d9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:42.845559 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22be1c-2383-47d5-8acf-4f88ecc9d9cc admin admin] PATH_INFO: `/v3/groups` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:42.846260 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22be1c-2383-47d5-8acf-4f88ecc9d9cc admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:42.847252 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING py.warnings [None req-ca22be1c-2383-47d5-8acf-4f88ecc9d9cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:27:42.847252 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: warnings.warn(msg) Feb 09 04:27:42.847252 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: Feb 09 04:27:42.848432 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22be1c-2383-47d5-8acf-4f88ecc9d9cc admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:42.850116 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040097b-9a15-480e-b1ca-e1bdb31c5ce5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:42.854918 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae5497a-70a4-4241-ac66-3afeb405f8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:42.855914 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5497a-70a4-4241-ac66-3afeb405f8d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:42.856245 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5497a-70a4-4241-ac66-3afeb405f8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:42.856506 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae5497a-70a4-4241-ac66-3afeb405f8d7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:42.864851 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 160/323] 10.222.0.36 () {60 vars in 1155 bytes} [Wed Feb 9 04:27:42 2022] POST /identity/v3/groups => generated 226 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:27:42.874879 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae5497a-70a4-4241-ac66-3afeb405f8d7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:42.882072 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-dae5497a-70a4-4241-ac66-3afeb405f8d7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 09 04:27:42.883558 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 164/324] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:27:42.889301 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22be1c-2383-47d5-8acf-4f88ecc9d9cc admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:42.899607 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22be1c-2383-47d5-8acf-4f88ecc9d9cc admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:42.904130 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54d0a4-5e89-48f5-be3f-158c828ecc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:42.905393 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54d0a4-5e89-48f5-be3f-158c828ecc6c admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:42.905676 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54d0a4-5e89-48f5-be3f-158c828ecc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:42.905946 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54d0a4-5e89-48f5-be3f-158c828ecc6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:42.906792 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54d0a4-5e89-48f5-be3f-158c828ecc6c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:42.907098 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54d0a4-5e89-48f5-be3f-158c828ecc6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:42.908089 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61b2ba-139b-4cbb-baf8-fd8c0084a7ff None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:42.908380 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61b2ba-139b-4cbb-baf8-fd8c0084a7ff None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:42.908661 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61b2ba-139b-4cbb-baf8-fd8c0084a7ff None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:42.908765 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a54d0a4-5e89-48f5-be3f-158c828ecc6c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:42.910610 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 165/325] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:42.916474 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498fa4e-fdef-4849-8001-6ba31f537a33 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:42.916765 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498fa4e-fdef-4849-8001-6ba31f537a33 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:42.917138 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498fa4e-fdef-4849-8001-6ba31f537a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:42.924122 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 161/326] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:42.925465 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54d0a4-5e89-48f5-be3f-158c828ecc6c admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:42.935032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54d0a4-5e89-48f5-be3f-158c828ecc6c admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:42.939530 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1c6f5-a276-4312-b22d-1b836391577f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:42.940407 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1c6f5-a276-4312-b22d-1b836391577f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:42.940689 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1c6f5-a276-4312-b22d-1b836391577f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:42.940966 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1c6f5-a276-4312-b22d-1b836391577f admin admin] PATH_INFO: `/v3/users/13995da9e09040238b17e9db472523f7` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:42.941294 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d498fa4e-fdef-4849-8001-6ba31f537a33 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:42.942244 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1c6f5-a276-4312-b22d-1b836391577f admin admin] RBAC: Authorizing `identity:get_user(user_id=13995da9e09040238b17e9db472523f7)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:42.942684 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d498fa4e-fdef-4849-8001-6ba31f537a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:42.944408 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1c6f5-a276-4312-b22d-1b836391577f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:42.951087 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 162/327] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:42 2022] GET /identity/v3/users/13995da9e09040238b17e9db472523f7 => generated 293 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:42.952771 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1c6f5-a276-4312-b22d-1b836391577f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:42.956627 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 166/328] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 09 04:27:42.962671 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1c6f5-a276-4312-b22d-1b836391577f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:42.967602 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc96e0-a680-4fd1-b07c-697e7c98a193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:42.968259 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc96e0-a680-4fd1-b07c-697e7c98a193 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:42.968538 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc96e0-a680-4fd1-b07c-697e7c98a193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:42.968815 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc96e0-a680-4fd1-b07c-697e7c98a193 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:42.969695 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc96e0-a680-4fd1-b07c-697e7c98a193 admin admin] RBAC: Adding query filter params (role.id=102f883957d846419d33ce22fdec0cce, user.id=13995da9e09040238b17e9db472523f7, scope.system=all) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:42.970021 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc96e0-a680-4fd1-b07c-697e7c98a193 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:42.971862 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc96e0-a680-4fd1-b07c-697e7c98a193 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:42.980128 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498fa4e-fdef-4849-8001-6ba31f537a33 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:42.989183 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 163/329] 10.222.0.36 () {56 vars in 1329 bytes} [Wed Feb 9 04:27:42 2022] GET /identity/v3/role_assignments?user.id=13995da9e09040238b17e9db472523f7&scope.system=all&role.id=102f883957d846419d33ce22fdec0cce => generated 510 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:42.990391 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498fa4e-fdef-4849-8001-6ba31f537a33 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:42.999741 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530678d7-be20-46f1-8e9f-a6dbcf32fc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:43.000570 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530678d7-be20-46f1-8e9f-a6dbcf32fc87 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:43.000853 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530678d7-be20-46f1-8e9f-a6dbcf32fc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:43.001179 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530678d7-be20-46f1-8e9f-a6dbcf32fc87 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:43.013557 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530678d7-be20-46f1-8e9f-a6dbcf32fc87 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:43.021269 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-530678d7-be20-46f1-8e9f-a6dbcf32fc87 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 09 04:27:43.022741 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 167/330] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:27:43.028835 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc96e0-a680-4fd1-b07c-697e7c98a193 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:43.039638 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc96e0-a680-4fd1-b07c-697e7c98a193 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:43.044228 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa5c93-957f-4aed-a8a0-c2494bc54943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:43.044914 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa5c93-957f-4aed-a8a0-c2494bc54943 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:43.045281 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa5c93-957f-4aed-a8a0-c2494bc54943 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:43.045566 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa5c93-957f-4aed-a8a0-c2494bc54943 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:43.046352 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa5c93-957f-4aed-a8a0-c2494bc54943 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:43.046661 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa5c93-957f-4aed-a8a0-c2494bc54943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:43.048314 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa5c93-957f-4aed-a8a0-c2494bc54943 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:43.057962 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 164/331] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:43.063736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530678d7-be20-46f1-8e9f-a6dbcf32fc87 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:43.074035 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530678d7-be20-46f1-8e9f-a6dbcf32fc87 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:43.079080 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8163ec3e-1f32-4209-a67d-589d909c4ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:43.079972 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163ec3e-1f32-4209-a67d-589d909c4ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:43.080251 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163ec3e-1f32-4209-a67d-589d909c4ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:43.080528 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8163ec3e-1f32-4209-a67d-589d909c4ee0 admin admin] PATH_INFO: `/v3/users/39f5826da40c4bb9a1c0171d7bbe6564` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:43.081882 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163ec3e-1f32-4209-a67d-589d909c4ee0 admin admin] RBAC: Authorizing `identity:get_user(user_id=39f5826da40c4bb9a1c0171d7bbe6564)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:43.084128 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8163ec3e-1f32-4209-a67d-589d909c4ee0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:43.085978 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 168/332] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:43 2022] GET /identity/v3/users/39f5826da40c4bb9a1c0171d7bbe6564 => generated 293 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:43.091763 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa5c93-957f-4aed-a8a0-c2494bc54943 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:43.102635 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa5c93-957f-4aed-a8a0-c2494bc54943 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:43.107424 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb95047-1592-422e-bdde-8665822274fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:43.108424 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb95047-1592-422e-bdde-8665822274fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:43.108702 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb95047-1592-422e-bdde-8665822274fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:43.108973 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb95047-1592-422e-bdde-8665822274fe admin admin] PATH_INFO: `/v3/system/users/39f5826da40c4bb9a1c0171d7bbe6564/roles/25d1ad8b112c4326a3a8e579f24a6d75` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:43.110600 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb95047-1592-422e-bdde-8665822274fe admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=39f5826da40c4bb9a1c0171d7bbe6564, role_id=25d1ad8b112c4326a3a8e579f24a6d75)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:43.112217 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb95047-1592-422e-bdde-8665822274fe admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:43.121066 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 165/333] 10.222.0.36 () {58 vars in 1355 bytes} [Wed Feb 9 04:27:43 2022] PUT /identity/v3/system/users/39f5826da40c4bb9a1c0171d7bbe6564/roles/25d1ad8b112c4326a3a8e579f24a6d75 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:27:45.429285 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbf516-fc52-4c6c-b8b5-2cc5e5ed609f None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:45.430311 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbf516-fc52-4c6c-b8b5-2cc5e5ed609f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:45.430790 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbf516-fc52-4c6c-b8b5-2cc5e5ed609f None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:45.433050 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 169/334] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:45.438252 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af697a-dfa1-44db-b016-c538dc4806fe None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:45.439088 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af697a-dfa1-44db-b016-c538dc4806fe None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:45.439575 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af697a-dfa1-44db-b016-c538dc4806fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:45.463832 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-92af697a-dfa1-44db-b016-c538dc4806fe None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:45.465363 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-92af697a-dfa1-44db-b016-c538dc4806fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:45.479067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 166/335] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:45.514926 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbf516-fc52-4c6c-b8b5-2cc5e5ed609f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:45.531686 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbf516-fc52-4c6c-b8b5-2cc5e5ed609f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:45.536431 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367c040-d2a5-4f7e-8fc0-c4fbae75d2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:45.537484 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367c040-d2a5-4f7e-8fc0-c4fbae75d2dc admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:45.538205 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367c040-d2a5-4f7e-8fc0-c4fbae75d2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:45.538668 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367c040-d2a5-4f7e-8fc0-c4fbae75d2dc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:45.555264 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367c040-d2a5-4f7e-8fc0-c4fbae75d2dc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:45.562222 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-e367c040-d2a5-4f7e-8fc0-c4fbae75d2dc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 09 04:27:45.563715 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 170/336] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:45.569037 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af697a-dfa1-44db-b016-c538dc4806fe None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:45.582060 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af697a-dfa1-44db-b016-c538dc4806fe None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:45.587823 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb9661-f7a3-46e0-9082-b49ce0dc4c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:45.588484 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb9661-f7a3-46e0-9082-b49ce0dc4c93 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:45.588760 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb9661-f7a3-46e0-9082-b49ce0dc4c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:45.589040 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb9661-f7a3-46e0-9082-b49ce0dc4c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:45.589821 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb9661-f7a3-46e0-9082-b49ce0dc4c93 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:45.590109 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb9661-f7a3-46e0-9082-b49ce0dc4c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:45.591678 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbb9661-f7a3-46e0-9082-b49ce0dc4c93 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:45.604413 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 167/337] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:45.610599 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367c040-d2a5-4f7e-8fc0-c4fbae75d2dc admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:45.621261 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367c040-d2a5-4f7e-8fc0-c4fbae75d2dc admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:45.630683 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553a67a-1fc6-4f2d-8ff4-a39098cdf634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:45.631350 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553a67a-1fc6-4f2d-8ff4-a39098cdf634 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:45.631632 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553a67a-1fc6-4f2d-8ff4-a39098cdf634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:45.631905 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553a67a-1fc6-4f2d-8ff4-a39098cdf634 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:45.645658 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553a67a-1fc6-4f2d-8ff4-a39098cdf634 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:45.647437 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553a67a-1fc6-4f2d-8ff4-a39098cdf634 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:45.660879 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03da145-6f25-4c1c-824d-cf9d655541c3 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:45.661228 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03da145-6f25-4c1c-824d-cf9d655541c3 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:45.661511 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03da145-6f25-4c1c-824d-cf9d655541c3 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:45.663376 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 171/338] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:45.664374 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 168/339] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:27:45.668435 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553a67a-1fc6-4f2d-8ff4-a39098cdf634 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:45.680007 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a38f1-ffec-490c-b469-312ba8cf7bac None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:45.680261 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a38f1-ffec-490c-b469-312ba8cf7bac None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:45.680487 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a38f1-ffec-490c-b469-312ba8cf7bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:45.682383 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553a67a-1fc6-4f2d-8ff4-a39098cdf634 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:45.692338 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f3396-1f3b-4f63-af88-2d8a7ce8619c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:45.693218 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f3396-1f3b-4f63-af88-2d8a7ce8619c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:45.693496 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f3396-1f3b-4f63-af88-2d8a7ce8619c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:45.693767 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f3396-1f3b-4f63-af88-2d8a7ce8619c admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:45.697798 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f3396-1f3b-4f63-af88-2d8a7ce8619c admin admin] RBAC: Authorizing `identity:get_project(project_id=635df70d95a247b1a0a172cbb183ba9b)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:45.699906 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889f3396-1f3b-4f63-af88-2d8a7ce8619c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:45.702561 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 172/340] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:45 2022] GET /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:45.709313 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f3396-1f3b-4f63-af88-2d8a7ce8619c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:45.714058 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-d45a38f1-ffec-490c-b469-312ba8cf7bac None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:45.715279 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-d45a38f1-ffec-490c-b469-312ba8cf7bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:45.722825 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889f3396-1f3b-4f63-af88-2d8a7ce8619c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:45.730532 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 169/341] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 09 04:27:45.737792 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6821f9-2352-4ea1-895c-94e21eb77940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:45.738675 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6821f9-2352-4ea1-895c-94e21eb77940 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:45.738956 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6821f9-2352-4ea1-895c-94e21eb77940 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:45.739231 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6821f9-2352-4ea1-895c-94e21eb77940 admin admin] PATH_INFO: `/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:45.750427 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6821f9-2352-4ea1-895c-94e21eb77940 admin admin] RBAC: Authorizing `identity:get_group(group_id=fa64a08f9e81412e8862d4ad8532fbd0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:45.751471 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-8e6821f9-2352-4ea1-895c-94e21eb77940 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:27:45.751471 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 09 04:27:45.751471 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: Feb 09 04:27:45.752649 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6821f9-2352-4ea1-895c-94e21eb77940 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:45.754327 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 173/342] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Feb 9 04:27:45 2022] GET /identity/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0 => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:45.760205 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a38f1-ffec-490c-b469-312ba8cf7bac None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:45.775851 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a38f1-ffec-490c-b469-312ba8cf7bac None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:45.784276 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de6f52-797b-4ebf-9a18-df4269a74202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:45.785258 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de6f52-797b-4ebf-9a18-df4269a74202 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:45.785440 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de6f52-797b-4ebf-9a18-df4269a74202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:45.785701 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de6f52-797b-4ebf-9a18-df4269a74202 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:45.786775 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de6f52-797b-4ebf-9a18-df4269a74202 admin admin] RBAC: Adding query filter params (group.id=fa64a08f9e81412e8862d4ad8532fbd0, role.id=102f883957d846419d33ce22fdec0cce, scope.project.id=635df70d95a247b1a0a172cbb183ba9b) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:45.786988 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6821f9-2352-4ea1-895c-94e21eb77940 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:45.787145 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de6f52-797b-4ebf-9a18-df4269a74202 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:45.789216 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de6f52-797b-4ebf-9a18-df4269a74202 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:45.801365 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 170/343] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Feb 9 04:27:45 2022] GET /identity/v3/role_assignments?group.id=fa64a08f9e81412e8862d4ad8532fbd0&scope.project.id=635df70d95a247b1a0a172cbb183ba9b&role.id=102f883957d846419d33ce22fdec0cce => generated 260 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:45.805944 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6821f9-2352-4ea1-895c-94e21eb77940 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:45.818635 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6548eb-d600-4f65-956c-12b250b2c591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:45.819463 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6548eb-d600-4f65-956c-12b250b2c591 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:45.819739 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6548eb-d600-4f65-956c-12b250b2c591 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:45.820009 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6548eb-d600-4f65-956c-12b250b2c591 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:45.842111 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6548eb-d600-4f65-956c-12b250b2c591 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:45.849200 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-9d6548eb-d600-4f65-956c-12b250b2c591 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 09 04:27:45.850668 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 174/344] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:45.856371 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de6f52-797b-4ebf-9a18-df4269a74202 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:45.872893 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de6f52-797b-4ebf-9a18-df4269a74202 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:45.885821 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140de10f-a3a5-4136-90d2-1883da655799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:45.886640 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140de10f-a3a5-4136-90d2-1883da655799 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:45.886854 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140de10f-a3a5-4136-90d2-1883da655799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:45.887064 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140de10f-a3a5-4136-90d2-1883da655799 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:45.887837 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140de10f-a3a5-4136-90d2-1883da655799 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:45.888143 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140de10f-a3a5-4136-90d2-1883da655799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:45.889849 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140de10f-a3a5-4136-90d2-1883da655799 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:45.904751 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 171/345] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:45.910294 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6548eb-d600-4f65-956c-12b250b2c591 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:45.924213 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6548eb-d600-4f65-956c-12b250b2c591 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:45.933815 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a80a7-8c46-4dca-922a-cec26c778693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:45.934640 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a80a7-8c46-4dca-922a-cec26c778693 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:45.934919 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a80a7-8c46-4dca-922a-cec26c778693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:45.935192 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a80a7-8c46-4dca-922a-cec26c778693 admin admin] PATH_INFO: `/v3/users/39f5826da40c4bb9a1c0171d7bbe6564` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:45.942077 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a80a7-8c46-4dca-922a-cec26c778693 admin admin] RBAC: Authorizing `identity:get_user(user_id=39f5826da40c4bb9a1c0171d7bbe6564)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:45.944288 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a80a7-8c46-4dca-922a-cec26c778693 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:45.946437 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 175/346] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:27:45 2022] GET /identity/v3/users/39f5826da40c4bb9a1c0171d7bbe6564 => generated 293 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:45.952398 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140de10f-a3a5-4136-90d2-1883da655799 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:45.966623 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140de10f-a3a5-4136-90d2-1883da655799 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:45.973163 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47029f70-0d13-4cde-8ba4-a8c33ea63679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:45.974216 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47029f70-0d13-4cde-8ba4-a8c33ea63679 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:45.974706 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47029f70-0d13-4cde-8ba4-a8c33ea63679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:45.975326 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47029f70-0d13-4cde-8ba4-a8c33ea63679 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:45.976395 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47029f70-0d13-4cde-8ba4-a8c33ea63679 admin admin] RBAC: Adding query filter params (role.id=25d1ad8b112c4326a3a8e579f24a6d75, user.id=39f5826da40c4bb9a1c0171d7bbe6564, scope.system=all) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:45.976906 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47029f70-0d13-4cde-8ba4-a8c33ea63679 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:45.978987 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47029f70-0d13-4cde-8ba4-a8c33ea63679 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:46.001374 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 172/347] 10.222.0.36 () {56 vars in 1329 bytes} [Wed Feb 9 04:27:45 2022] GET /identity/v3/role_assignments?user.id=39f5826da40c4bb9a1c0171d7bbe6564&scope.system=all&role.id=25d1ad8b112c4326a3a8e579f24a6d75 => generated 510 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:46.343363 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132a8c5-ea37-47dd-8820-cfe960703148 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:46.343558 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca1931-c966-4919-80fd-54beb8ae68dd None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:46.343635 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132a8c5-ea37-47dd-8820-cfe960703148 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:46.343733 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca1931-c966-4919-80fd-54beb8ae68dd None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:46.344018 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132a8c5-ea37-47dd-8820-cfe960703148 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:46.344115 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca1931-c966-4919-80fd-54beb8ae68dd None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:46.345957 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 176/349] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:46.346074 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 173/349] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:46.352687 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe5294-6738-4bd9-b236-eed3b1b59a49 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:46.352974 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe5294-6738-4bd9-b236-eed3b1b59a49 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:46.353323 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe5294-6738-4bd9-b236-eed3b1b59a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:46.356005 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a1c31-a986-4915-962e-c9b77c79b241 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:46.356292 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a1c31-a986-4915-962e-c9b77c79b241 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:46.356567 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a1c31-a986-4915-962e-c9b77c79b241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:46.387284 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-9dbe5294-6738-4bd9-b236-eed3b1b59a49 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:46.388485 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9dbe5294-6738-4bd9-b236-eed3b1b59a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:46.390855 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-443a1c31-a986-4915-962e-c9b77c79b241 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:46.392008 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-443a1c31-a986-4915-962e-c9b77c79b241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:46.406685 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 174/350] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 09 04:27:46.413205 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 177/351] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:46.456182 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a1c31-a986-4915-962e-c9b77c79b241 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:46.457680 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe5294-6738-4bd9-b236-eed3b1b59a49 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:46.473584 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a1c31-a986-4915-962e-c9b77c79b241 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:46.476818 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe5294-6738-4bd9-b236-eed3b1b59a49 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:46.481766 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c390d-6435-4978-9383-7ae604b87e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:46.482608 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c390d-6435-4978-9383-7ae604b87e30 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:46.482888 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c390d-6435-4978-9383-7ae604b87e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:46.483158 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c390d-6435-4978-9383-7ae604b87e30 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:46.484471 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012c684-cf8c-4248-bacd-df3e5ae3ef33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:46.485324 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012c684-cf8c-4248-bacd-df3e5ae3ef33 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:46.485605 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012c684-cf8c-4248-bacd-df3e5ae3ef33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:46.485876 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012c684-cf8c-4248-bacd-df3e5ae3ef33 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:46.494063 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c390d-6435-4978-9383-7ae604b87e30 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:46.503782 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-2d6c390d-6435-4978-9383-7ae604b87e30 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 09 04:27:46.505325 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 175/352] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:46.506110 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b012c684-cf8c-4248-bacd-df3e5ae3ef33 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:46.515355 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-b012c684-cf8c-4248-bacd-df3e5ae3ef33 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 09 04:27:46.517174 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 178/353] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Feb 9 04:27:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:46.522238 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c390d-6435-4978-9383-7ae604b87e30 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:46.522779 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012c684-cf8c-4248-bacd-df3e5ae3ef33 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:46.535724 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012c684-cf8c-4248-bacd-df3e5ae3ef33 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:46.541333 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c390d-6435-4978-9383-7ae604b87e30 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:46.543325 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb4bfb-9659-4d8e-a662-5873cc70e50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:46.544093 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb4bfb-9659-4d8e-a662-5873cc70e50a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:46.544393 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb4bfb-9659-4d8e-a662-5873cc70e50a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:46.544665 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb4bfb-9659-4d8e-a662-5873cc70e50a admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:46.545512 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb4bfb-9659-4d8e-a662-5873cc70e50a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:46.545818 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb4bfb-9659-4d8e-a662-5873cc70e50a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:46.547564 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb4bfb-9659-4d8e-a662-5873cc70e50a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:46.553023 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d157ca-351a-47da-a28d-086eb18a0852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:46.553023 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d157ca-351a-47da-a28d-086eb18a0852 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:46.553023 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d157ca-351a-47da-a28d-086eb18a0852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:46.553023 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d157ca-351a-47da-a28d-086eb18a0852 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:46.553422 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d157ca-351a-47da-a28d-086eb18a0852 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:46.553422 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d157ca-351a-47da-a28d-086eb18a0852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:46.554340 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d157ca-351a-47da-a28d-086eb18a0852 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:46.564087 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 179/354] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:27:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:46.564946 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 176/355] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:46.569481 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb4bfb-9659-4d8e-a662-5873cc70e50a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:46.572453 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d157ca-351a-47da-a28d-086eb18a0852 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:46.584059 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb4bfb-9659-4d8e-a662-5873cc70e50a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:46.588343 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d157ca-351a-47da-a28d-086eb18a0852 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:46.594844 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbf639-6adc-43c0-91fa-58f5dc277284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:46.595902 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbf639-6adc-43c0-91fa-58f5dc277284 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:46.596528 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbf639-6adc-43c0-91fa-58f5dc277284 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:46.596808 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbf639-6adc-43c0-91fa-58f5dc277284 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:46.599379 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de5392-1f66-47e5-ab87-78fa4962d035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:46.600030 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de5392-1f66-47e5-ab87-78fa4962d035 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:46.600317 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de5392-1f66-47e5-ab87-78fa4962d035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:46.600601 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de5392-1f66-47e5-ab87-78fa4962d035 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:46.606682 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbf639-6adc-43c0-91fa-58f5dc277284 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:46.610695 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afbf639-6adc-43c0-91fa-58f5dc277284 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:46.613068 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de5392-1f66-47e5-ab87-78fa4962d035 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:46.614808 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de5392-1f66-47e5-ab87-78fa4962d035 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:46.622638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 180/356] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:46.630024 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbf639-6adc-43c0-91fa-58f5dc277284 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:46.643527 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbf639-6adc-43c0-91fa-58f5dc277284 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:46.644416 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 177/357] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:46.646074 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de5392-1f66-47e5-ab87-78fa4962d035 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:46.657319 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de5392-1f66-47e5-ab87-78fa4962d035 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:46.658495 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6898e-caac-4a0c-8357-864cd4d4c822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:46.659347 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6898e-caac-4a0c-8357-864cd4d4c822 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:46.659624 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6898e-caac-4a0c-8357-864cd4d4c822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:46.659925 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6898e-caac-4a0c-8357-864cd4d4c822 admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:46.661402 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6898e-caac-4a0c-8357-864cd4d4c822 admin admin] RBAC: Authorizing `identity:get_project(project_id=635df70d95a247b1a0a172cbb183ba9b)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:46.663729 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6898e-caac-4a0c-8357-864cd4d4c822 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:46.665423 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 181/358] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:46 2022] GET /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:46.671545 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6898e-caac-4a0c-8357-864cd4d4c822 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:46.672953 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b54d12-505b-4b06-bbb1-f3236528f694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:46.673834 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b54d12-505b-4b06-bbb1-f3236528f694 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:46.674119 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b54d12-505b-4b06-bbb1-f3236528f694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:46.674389 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b54d12-505b-4b06-bbb1-f3236528f694 admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:46.675568 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b54d12-505b-4b06-bbb1-f3236528f694 admin admin] RBAC: Authorizing `identity:get_project(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:46.677615 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b54d12-505b-4b06-bbb1-f3236528f694 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:46.681053 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 178/359] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:46 2022] GET /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6 => generated 302 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:46.685225 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b54d12-505b-4b06-bbb1-f3236528f694 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:46.693104 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6898e-caac-4a0c-8357-864cd4d4c822 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:46.699677 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b54d12-505b-4b06-bbb1-f3236528f694 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:46.702933 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd2001-5dd2-4124-bdbb-a978e8254c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:46.703781 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd2001-5dd2-4124-bdbb-a978e8254c11 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:46.704062 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd2001-5dd2-4124-bdbb-a978e8254c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:46.704335 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd2001-5dd2-4124-bdbb-a978e8254c11 admin admin] PATH_INFO: `/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:46.705931 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd2001-5dd2-4124-bdbb-a978e8254c11 admin admin] RBAC: Authorizing `identity:get_group(group_id=fa64a08f9e81412e8862d4ad8532fbd0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:46.707830 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd2001-5dd2-4124-bdbb-a978e8254c11 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:46.711768 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 182/360] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Feb 9 04:27:46 2022] GET /identity/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:46.712831 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d33b50-cf2c-41f5-adbc-473287da02c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:46.713745 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d33b50-cf2c-41f5-adbc-473287da02c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:46.713986 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d33b50-cf2c-41f5-adbc-473287da02c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:46.714258 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d33b50-cf2c-41f5-adbc-473287da02c2 admin admin] PATH_INFO: `/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:46.715591 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd2001-5dd2-4124-bdbb-a978e8254c11 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:46.716585 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d33b50-cf2c-41f5-adbc-473287da02c2 admin admin] RBAC: Authorizing `identity:get_group(group_id=fa64a08f9e81412e8862d4ad8532fbd0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:46.718244 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING py.warnings [None req-48d33b50-cf2c-41f5-adbc-473287da02c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:27:46.718244 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: warnings.warn(msg) Feb 09 04:27:46.718244 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: Feb 09 04:27:46.719839 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d33b50-cf2c-41f5-adbc-473287da02c2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:46.725181 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 179/361] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Feb 9 04:27:46 2022] GET /identity/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0 => generated 226 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:46.729946 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d33b50-cf2c-41f5-adbc-473287da02c2 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:46.730654 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd2001-5dd2-4124-bdbb-a978e8254c11 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:46.740601 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d33b50-cf2c-41f5-adbc-473287da02c2 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:46.741552 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19089e-b704-4871-bda6-3ab92d3a364c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:46.742213 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19089e-b704-4871-bda6-3ab92d3a364c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:46.742500 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19089e-b704-4871-bda6-3ab92d3a364c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:46.742783 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19089e-b704-4871-bda6-3ab92d3a364c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:46.743835 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19089e-b704-4871-bda6-3ab92d3a364c admin admin] RBAC: Adding query filter params (group.id=fa64a08f9e81412e8862d4ad8532fbd0, role.id=850547f4dcf34a76a710ddaae9dc30de, scope.project.id=635df70d95a247b1a0a172cbb183ba9b) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:46.744153 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19089e-b704-4871-bda6-3ab92d3a364c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:46.746085 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19089e-b704-4871-bda6-3ab92d3a364c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:46.755382 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95bfcdf-8f64-4d38-b9b0-09994659bb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:46.756031 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bfcdf-8f64-4d38-b9b0-09994659bb6d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:46.756314 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bfcdf-8f64-4d38-b9b0-09994659bb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:46.756591 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95bfcdf-8f64-4d38-b9b0-09994659bb6d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:46.758663 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 183/362] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Feb 9 04:27:46 2022] GET /identity/v3/role_assignments?group.id=fa64a08f9e81412e8862d4ad8532fbd0&scope.project.id=635df70d95a247b1a0a172cbb183ba9b&role.id=850547f4dcf34a76a710ddaae9dc30de => generated 260 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:46.759128 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bfcdf-8f64-4d38-b9b0-09994659bb6d admin admin] RBAC: Adding query filter params (group.id=fa64a08f9e81412e8862d4ad8532fbd0, role.id=102f883957d846419d33ce22fdec0cce, scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:46.759445 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bfcdf-8f64-4d38-b9b0-09994659bb6d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:46.761359 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95bfcdf-8f64-4d38-b9b0-09994659bb6d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:46.768564 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 180/363] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Feb 9 04:27:46 2022] GET /identity/v3/role_assignments?group.id=fa64a08f9e81412e8862d4ad8532fbd0&scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6&role.id=102f883957d846419d33ce22fdec0cce => generated 260 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:47.694649 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd2240-fd49-4434-8c01-265abab9c2f2 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:47.695329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd2240-fd49-4434-8c01-265abab9c2f2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:47.695329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd2240-fd49-4434-8c01-265abab9c2f2 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:47.697410 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 184/364] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:47.703493 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149710d6-3fe7-4154-8867-3acce8e305c6 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:47.704006 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149710d6-3fe7-4154-8867-3acce8e305c6 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:47.704175 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149710d6-3fe7-4154-8867-3acce8e305c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:47.730021 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-149710d6-3fe7-4154-8867-3acce8e305c6 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:47.731239 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-149710d6-3fe7-4154-8867-3acce8e305c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:47.739468 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 181/365] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 09 04:27:47.776860 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd2240-fd49-4434-8c01-265abab9c2f2 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:47.795887 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd2240-fd49-4434-8c01-265abab9c2f2 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:47.802549 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a1620-1673-40cc-a81f-464d2e6643bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:47.803291 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a1620-1673-40cc-a81f-464d2e6643bf admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:47.803568 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a1620-1673-40cc-a81f-464d2e6643bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:47.803844 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a1620-1673-40cc-a81f-464d2e6643bf admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:47.812008 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68655c22-7c02-4ec7-acf1-8de428b33d1a None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:47.812302 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68655c22-7c02-4ec7-acf1-8de428b33d1a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:47.812589 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68655c22-7c02-4ec7-acf1-8de428b33d1a None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:47.814670 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 182/366] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:47.818276 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a1620-1673-40cc-a81f-464d2e6643bf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:47.820038 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84a0ea-c783-4cfb-80b9-3d2f3575fa88 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:47.820329 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84a0ea-c783-4cfb-80b9-3d2f3575fa88 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:47.820612 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84a0ea-c783-4cfb-80b9-3d2f3575fa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:47.825650 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-d92a1620-1673-40cc-a81f-464d2e6643bf admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 09 04:27:47.829304 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 185/367] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Feb 9 04:27:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:47.834884 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a1620-1673-40cc-a81f-464d2e6643bf admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:47.845040 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a1620-1673-40cc-a81f-464d2e6643bf admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:47.850667 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9caa78-3438-46ea-b70e-7073dc99ba80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:47.851313 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9caa78-3438-46ea-b70e-7073dc99ba80 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:47.851588 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9caa78-3438-46ea-b70e-7073dc99ba80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:47.851858 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9caa78-3438-46ea-b70e-7073dc99ba80 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:47.852602 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9caa78-3438-46ea-b70e-7073dc99ba80 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:47.852900 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9caa78-3438-46ea-b70e-7073dc99ba80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:47.854511 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9caa78-3438-46ea-b70e-7073dc99ba80 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:47.860025 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-9b84a0ea-c783-4cfb-80b9-3d2f3575fa88 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:47.861250 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-9b84a0ea-c783-4cfb-80b9-3d2f3575fa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:47.864905 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 186/368] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:27:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:47.870261 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9caa78-3438-46ea-b70e-7073dc99ba80 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:47.880064 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 183/369] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:47.880464 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9caa78-3438-46ea-b70e-7073dc99ba80 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:47.884919 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcb548-d34c-4b98-a6ef-4ee3056d3680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:47.885590 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcb548-d34c-4b98-a6ef-4ee3056d3680 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:47.885876 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcb548-d34c-4b98-a6ef-4ee3056d3680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:47.886150 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefcb548-d34c-4b98-a6ef-4ee3056d3680 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:47.894901 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcb548-d34c-4b98-a6ef-4ee3056d3680 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:47.896660 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefcb548-d34c-4b98-a6ef-4ee3056d3680 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:47.905824 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 187/370] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 09 04:27:47.911236 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84a0ea-c783-4cfb-80b9-3d2f3575fa88 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:47.926901 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcb548-d34c-4b98-a6ef-4ee3056d3680 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:47.927156 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84a0ea-c783-4cfb-80b9-3d2f3575fa88 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:47.937806 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edfa3b-8b35-4e00-996f-e6997a7ae993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:47.938671 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edfa3b-8b35-4e00-996f-e6997a7ae993 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:47.938955 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edfa3b-8b35-4e00-996f-e6997a7ae993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:47.939231 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31edfa3b-8b35-4e00-996f-e6997a7ae993 admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:47.941798 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefcb548-d34c-4b98-a6ef-4ee3056d3680 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:47.943055 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edfa3b-8b35-4e00-996f-e6997a7ae993 admin admin] RBAC: Authorizing `identity:get_project(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:47.945720 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31edfa3b-8b35-4e00-996f-e6997a7ae993 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:47.948394 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 184/371] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:47 2022] GET /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:47.954079 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edfa3b-8b35-4e00-996f-e6997a7ae993 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:47.955017 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b1af8-4abe-44ec-8263-5df0ba4cc8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:47.955869 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b1af8-4abe-44ec-8263-5df0ba4cc8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:47.956151 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b1af8-4abe-44ec-8263-5df0ba4cc8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:47.956424 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b1af8-4abe-44ec-8263-5df0ba4cc8a8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:47.968914 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31edfa3b-8b35-4e00-996f-e6997a7ae993 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:47.977950 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b1af8-4abe-44ec-8263-5df0ba4cc8a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:47.984428 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4e5db-3683-4994-ba4f-a6ae563b0448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:47.986683 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4e5db-3683-4994-ba4f-a6ae563b0448 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:47.986968 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4e5db-3683-4994-ba4f-a6ae563b0448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:47.987240 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4e5db-3683-4994-ba4f-a6ae563b0448 admin admin] PATH_INFO: `/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:47.989398 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4e5db-3683-4994-ba4f-a6ae563b0448 admin admin] RBAC: Authorizing `identity:get_group(group_id=fa64a08f9e81412e8862d4ad8532fbd0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:47.992846 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4e5db-3683-4994-ba4f-a6ae563b0448 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:47.994989 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-5b6b1af8-4abe-44ec-8263-5df0ba4cc8a8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:27:47.994989 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 188/373] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:27:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:27:47.995306 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 185/373] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Feb 9 04:27:47 2022] GET /identity/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0 => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:48.001367 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b1af8-4abe-44ec-8263-5df0ba4cc8a8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:48.004732 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4e5db-3683-4994-ba4f-a6ae563b0448 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:48.014617 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b1af8-4abe-44ec-8263-5df0ba4cc8a8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:48.021110 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4e5db-3683-4994-ba4f-a6ae563b0448 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:48.022499 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ba3ae-1114-4f6c-9c7c-a90bc310f63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:48.023392 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ba3ae-1114-4f6c-9c7c-a90bc310f63d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:48.023867 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ba3ae-1114-4f6c-9c7c-a90bc310f63d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:48.024336 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ba3ae-1114-4f6c-9c7c-a90bc310f63d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:48.025399 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ba3ae-1114-4f6c-9c7c-a90bc310f63d admin admin] RBAC: Adding query filter params (group.id=fa64a08f9e81412e8862d4ad8532fbd0, role.id=850547f4dcf34a76a710ddaae9dc30de, scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:48.026020 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ba3ae-1114-4f6c-9c7c-a90bc310f63d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:48.028653 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ba3ae-1114-4f6c-9c7c-a90bc310f63d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:48.029751 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c7bbc-185a-49d7-b08a-b23bbd3cfd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:48.030460 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c7bbc-185a-49d7-b08a-b23bbd3cfd6e admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:48.030740 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c7bbc-185a-49d7-b08a-b23bbd3cfd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:48.031067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c7bbc-185a-49d7-b08a-b23bbd3cfd6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:48.037026 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c7bbc-185a-49d7-b08a-b23bbd3cfd6e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:48.037026 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c7bbc-185a-49d7-b08a-b23bbd3cfd6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:48.037026 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c7bbc-185a-49d7-b08a-b23bbd3cfd6e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:48.042975 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 189/374] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Feb 9 04:27:48 2022] GET /identity/v3/role_assignments?group.id=fa64a08f9e81412e8862d4ad8532fbd0&scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6&role.id=850547f4dcf34a76a710ddaae9dc30de => generated 260 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:48.051891 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 186/375] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:48.057821 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ba3ae-1114-4f6c-9c7c-a90bc310f63d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:48.074658 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ba3ae-1114-4f6c-9c7c-a90bc310f63d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:48.079877 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d4510-7435-4569-84bc-a3f763740129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:48.080572 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d4510-7435-4569-84bc-a3f763740129 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:48.080854 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d4510-7435-4569-84bc-a3f763740129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:48.081147 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d4510-7435-4569-84bc-a3f763740129 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:48.093069 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d4510-7435-4569-84bc-a3f763740129 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:48.094946 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d4510-7435-4569-84bc-a3f763740129 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:48.112022 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 190/376] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:48.117805 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c7bbc-185a-49d7-b08a-b23bbd3cfd6e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:48.128716 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c7bbc-185a-49d7-b08a-b23bbd3cfd6e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:48.133702 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1600ce7-65fb-4aed-91df-8f240802edd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:48.134702 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1600ce7-65fb-4aed-91df-8f240802edd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:48.134978 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1600ce7-65fb-4aed-91df-8f240802edd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:48.135248 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1600ce7-65fb-4aed-91df-8f240802edd7 admin admin] PATH_INFO: `/v3/projects/583a6798f0f24da3a88ba3f8de9474df` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:48.142073 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1600ce7-65fb-4aed-91df-8f240802edd7 admin admin] RBAC: Authorizing `identity:get_project(project_id=583a6798f0f24da3a88ba3f8de9474df)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:48.144077 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1600ce7-65fb-4aed-91df-8f240802edd7 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:48.145959 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 187/377] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:48 2022] GET /identity/v3/projects/583a6798f0f24da3a88ba3f8de9474df => generated 344 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:48.151519 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d4510-7435-4569-84bc-a3f763740129 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:48.164672 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d4510-7435-4569-84bc-a3f763740129 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:48.169349 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc3c1a-17d1-445b-a2f0-2ad36d2b6243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:48.170791 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc3c1a-17d1-445b-a2f0-2ad36d2b6243 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:48.171124 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc3c1a-17d1-445b-a2f0-2ad36d2b6243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:48.171441 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc3c1a-17d1-445b-a2f0-2ad36d2b6243 admin admin] PATH_INFO: `/v3/groups/01a002a0ba1b4fbcb55f398c9fa90090` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:48.179773 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc3c1a-17d1-445b-a2f0-2ad36d2b6243 admin admin] RBAC: Authorizing `identity:get_group(group_id=01a002a0ba1b4fbcb55f398c9fa90090)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:48.181723 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc3c1a-17d1-445b-a2f0-2ad36d2b6243 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:48.183805 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 191/378] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Feb 9 04:27:48 2022] GET /identity/v3/groups/01a002a0ba1b4fbcb55f398c9fa90090 => generated 229 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:48.190414 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1600ce7-65fb-4aed-91df-8f240802edd7 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:48.201498 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1600ce7-65fb-4aed-91df-8f240802edd7 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:48.208151 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d254d1e-9ecd-40d1-8058-0d59097fd6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:48.208840 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d254d1e-9ecd-40d1-8058-0d59097fd6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:48.209148 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d254d1e-9ecd-40d1-8058-0d59097fd6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:48.209471 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d254d1e-9ecd-40d1-8058-0d59097fd6c6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:48.210313 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d254d1e-9ecd-40d1-8058-0d59097fd6c6 admin admin] RBAC: Adding query filter params (group.id=01a002a0ba1b4fbcb55f398c9fa90090, role.id=05ca9a16ef2a450b8cc73ade47f5c7d0, scope.project.id=583a6798f0f24da3a88ba3f8de9474df) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:48.210678 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d254d1e-9ecd-40d1-8058-0d59097fd6c6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:48.212617 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d254d1e-9ecd-40d1-8058-0d59097fd6c6 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:48.221413 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 188/379] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Feb 9 04:27:48 2022] GET /identity/v3/role_assignments?group.id=01a002a0ba1b4fbcb55f398c9fa90090&scope.project.id=583a6798f0f24da3a88ba3f8de9474df&role.id=05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 260 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:48.611935 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2eaa8-a7ef-4a6b-99ed-50a25214b858 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:48.612281 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2eaa8-a7ef-4a6b-99ed-50a25214b858 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:48.612496 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2eaa8-a7ef-4a6b-99ed-50a25214b858 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:48.614533 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 192/380] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:48.619596 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8137b-5707-4abe-a849-9e32cdac4aee None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:48.619884 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8137b-5707-4abe-a849-9e32cdac4aee None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:48.620162 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8137b-5707-4abe-a849-9e32cdac4aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:48.643708 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-98f8137b-5707-4abe-a849-9e32cdac4aee None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:48.644884 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-98f8137b-5707-4abe-a849-9e32cdac4aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:48.659836 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 189/381] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:48.685174 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2eaa8-a7ef-4a6b-99ed-50a25214b858 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:48.701916 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2eaa8-a7ef-4a6b-99ed-50a25214b858 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:48.706541 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130d021-f353-4be7-9570-34e831709559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:48.707327 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130d021-f353-4be7-9570-34e831709559 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:48.707604 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130d021-f353-4be7-9570-34e831709559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:48.707875 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130d021-f353-4be7-9570-34e831709559 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:48.722432 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130d021-f353-4be7-9570-34e831709559 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:48.729491 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-b130d021-f353-4be7-9570-34e831709559 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 09 04:27:48.730992 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 193/382] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:48.736852 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8137b-5707-4abe-a849-9e32cdac4aee None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:48.746016 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8137b-5707-4abe-a849-9e32cdac4aee None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:48.752249 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097a9e4-936b-4498-8112-fce4a2eca2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:48.752907 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097a9e4-936b-4498-8112-fce4a2eca2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:48.753212 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097a9e4-936b-4498-8112-fce4a2eca2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:48.753485 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097a9e4-936b-4498-8112-fce4a2eca2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:48.754240 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097a9e4-936b-4498-8112-fce4a2eca2b4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:48.754541 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097a9e4-936b-4498-8112-fce4a2eca2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:48.756163 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097a9e4-936b-4498-8112-fce4a2eca2b4 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:48.768007 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 190/383] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:48.773741 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130d021-f353-4be7-9570-34e831709559 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:48.786094 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130d021-f353-4be7-9570-34e831709559 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:48.791980 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87843e7-9980-4d51-a4d8-68d8b61e0d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:48.792873 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87843e7-9980-4d51-a4d8-68d8b61e0d31 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:48.793181 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87843e7-9980-4d51-a4d8-68d8b61e0d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:48.793454 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87843e7-9980-4d51-a4d8-68d8b61e0d31 admin admin] PATH_INFO: `/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:48.794709 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87843e7-9980-4d51-a4d8-68d8b61e0d31 admin admin] RBAC: Authorizing `identity:get_group(group_id=fa64a08f9e81412e8862d4ad8532fbd0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:48.796747 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87843e7-9980-4d51-a4d8-68d8b61e0d31 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:48.798814 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 194/384] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Feb 9 04:27:48 2022] GET /identity/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:48.804030 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097a9e4-936b-4498-8112-fce4a2eca2b4 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:48.814421 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097a9e4-936b-4498-8112-fce4a2eca2b4 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:48.819687 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af911c5e-d99f-45a4-ab7a-bc687ce34db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:48.820591 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af911c5e-d99f-45a4-ab7a-bc687ce34db3 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:48.820872 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af911c5e-d99f-45a4-ab7a-bc687ce34db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:48.821176 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af911c5e-d99f-45a4-ab7a-bc687ce34db3 admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:48.823468 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af911c5e-d99f-45a4-ab7a-bc687ce34db3 admin admin] RBAC: Authorizing `identity:get_project(project_id=635df70d95a247b1a0a172cbb183ba9b)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:48.825684 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af911c5e-d99f-45a4-ab7a-bc687ce34db3 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:48.828044 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 191/385] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:48 2022] GET /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:48.833784 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87843e7-9980-4d51-a4d8-68d8b61e0d31 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:48.846033 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87843e7-9980-4d51-a4d8-68d8b61e0d31 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:48.853092 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c5ec3-6eb9-4545-aef6-f9f6ae0d7e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:48.854010 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c5ec3-6eb9-4545-aef6-f9f6ae0d7e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:48.854285 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c5ec3-6eb9-4545-aef6-f9f6ae0d7e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:48.854552 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c5ec3-6eb9-4545-aef6-f9f6ae0d7e6a admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b/groups/fa64a08f9e81412e8862d4ad8532fbd0/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:48.858625 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c5ec3-6eb9-4545-aef6-f9f6ae0d7e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=635df70d95a247b1a0a172cbb183ba9b, group_id=fa64a08f9e81412e8862d4ad8532fbd0, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:48.863250 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c5ec3-6eb9-4545-aef6-f9f6ae0d7e6a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:48.884648 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 195/386] 10.222.0.36 () {58 vars in 1463 bytes} [Wed Feb 9 04:27:48 2022] PUT /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b/groups/fa64a08f9e81412e8862d4ad8532fbd0/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:27:49.533486 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5cfdf-791e-4a76-9de0-7b60b8cc1a6a None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:49.534197 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5cfdf-791e-4a76-9de0-7b60b8cc1a6a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:49.534701 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5cfdf-791e-4a76-9de0-7b60b8cc1a6a None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:49.536680 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 192/387] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:49.542662 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7b48f-5ffd-476b-975c-af93f7a281c2 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:49.549324 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7b48f-5ffd-476b-975c-af93f7a281c2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:49.549820 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7b48f-5ffd-476b-975c-af93f7a281c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:49.582051 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-25d7b48f-5ffd-476b-975c-af93f7a281c2 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:49.583607 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-25d7b48f-5ffd-476b-975c-af93f7a281c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:49.657066 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 196/388] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Feb 09 04:27:49.692255 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5cfdf-791e-4a76-9de0-7b60b8cc1a6a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:49.707340 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5cfdf-791e-4a76-9de0-7b60b8cc1a6a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:49.717064 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8ffa6-7050-450f-86eb-353c1aee581a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:49.718132 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8ffa6-7050-450f-86eb-353c1aee581a admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:49.718616 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8ffa6-7050-450f-86eb-353c1aee581a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:49.719087 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8ffa6-7050-450f-86eb-353c1aee581a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:49.734614 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8ffa6-7050-450f-86eb-353c1aee581a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:49.741990 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-d5e8ffa6-7050-450f-86eb-353c1aee581a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 09 04:27:49.744184 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 193/389] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:49.750496 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7b48f-5ffd-476b-975c-af93f7a281c2 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:49.760799 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7b48f-5ffd-476b-975c-af93f7a281c2 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:49.769372 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480ae7d-87d1-4c1f-a902-7ea62c6f586d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:49.770366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480ae7d-87d1-4c1f-a902-7ea62c6f586d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:49.770876 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480ae7d-87d1-4c1f-a902-7ea62c6f586d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:49.771356 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8480ae7d-87d1-4c1f-a902-7ea62c6f586d admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:49.772326 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480ae7d-87d1-4c1f-a902-7ea62c6f586d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:49.772831 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480ae7d-87d1-4c1f-a902-7ea62c6f586d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:49.774660 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8480ae7d-87d1-4c1f-a902-7ea62c6f586d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:49.785061 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 197/390] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:49.791966 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8ffa6-7050-450f-86eb-353c1aee581a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:49.806139 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8ffa6-7050-450f-86eb-353c1aee581a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:49.810970 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf4e91-d907-4f4e-a940-3a7eef1746c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:49.812030 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf4e91-d907-4f4e-a940-3a7eef1746c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:49.812534 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf4e91-d907-4f4e-a940-3a7eef1746c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:49.813022 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf4e91-d907-4f4e-a940-3a7eef1746c9 admin admin] PATH_INFO: `/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:49.816871 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf4e91-d907-4f4e-a940-3a7eef1746c9 admin admin] RBAC: Authorizing `identity:get_group(group_id=fa64a08f9e81412e8862d4ad8532fbd0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:49.819037 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cf4e91-d907-4f4e-a940-3a7eef1746c9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:49.821176 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 194/391] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Feb 9 04:27:49 2022] GET /identity/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:49.826361 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480ae7d-87d1-4c1f-a902-7ea62c6f586d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:49.836402 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8480ae7d-87d1-4c1f-a902-7ea62c6f586d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:49.845684 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168843e-415f-48fd-850d-fddc21ea37fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:49.846783 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168843e-415f-48fd-850d-fddc21ea37fd admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:49.847267 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168843e-415f-48fd-850d-fddc21ea37fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:49.847843 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168843e-415f-48fd-850d-fddc21ea37fd admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:49.849288 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168843e-415f-48fd-850d-fddc21ea37fd admin admin] RBAC: Authorizing `identity:get_project(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:49.851569 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168843e-415f-48fd-850d-fddc21ea37fd admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:49.853511 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 198/392] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:49 2022] GET /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:49.859628 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf4e91-d907-4f4e-a940-3a7eef1746c9 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:49.869760 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf4e91-d907-4f4e-a940-3a7eef1746c9 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:49.877328 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534fe8a-0b97-424d-bdc6-caa42f670c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:49.878436 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534fe8a-0b97-424d-bdc6-caa42f670c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:49.878930 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534fe8a-0b97-424d-bdc6-caa42f670c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:49.879405 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534fe8a-0b97-424d-bdc6-caa42f670c63 admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6/groups/fa64a08f9e81412e8862d4ad8532fbd0/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:49.881674 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534fe8a-0b97-424d-bdc6-caa42f670c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6, group_id=fa64a08f9e81412e8862d4ad8532fbd0, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:49.884501 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534fe8a-0b97-424d-bdc6-caa42f670c63 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:49.908428 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 195/393] 10.222.0.36 () {58 vars in 1463 bytes} [Wed Feb 9 04:27:49 2022] PUT /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6/groups/fa64a08f9e81412e8862d4ad8532fbd0/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:27:50.123921 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a9384-bc1b-4608-b68a-88262f7eb097 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:50.124584 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a9384-bc1b-4608-b68a-88262f7eb097 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:50.125121 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a9384-bc1b-4608-b68a-88262f7eb097 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:50.127159 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 199/394] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:50.132793 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527739af-9cff-4781-80de-9dc59fdbd003 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:50.133113 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527739af-9cff-4781-80de-9dc59fdbd003 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:50.133396 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527739af-9cff-4781-80de-9dc59fdbd003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:50.155438 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-527739af-9cff-4781-80de-9dc59fdbd003 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:50.156662 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-527739af-9cff-4781-80de-9dc59fdbd003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:50.226287 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 196/395] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:50.250864 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a9384-bc1b-4608-b68a-88262f7eb097 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:50.264309 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a9384-bc1b-4608-b68a-88262f7eb097 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:50.268639 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06483e1d-fff9-49e0-acd2-ca405b85abef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:50.269482 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06483e1d-fff9-49e0-acd2-ca405b85abef admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:50.269766 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06483e1d-fff9-49e0-acd2-ca405b85abef admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:50.270040 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06483e1d-fff9-49e0-acd2-ca405b85abef admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:50.283798 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06483e1d-fff9-49e0-acd2-ca405b85abef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:50.291451 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-06483e1d-fff9-49e0-acd2-ca405b85abef admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 09 04:27:50.293023 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 200/396] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Feb 9 04:27:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:50.299227 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527739af-9cff-4781-80de-9dc59fdbd003 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:50.312940 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527739af-9cff-4781-80de-9dc59fdbd003 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:50.318770 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab7f28-6629-4dea-a4ad-abca610b77b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:50.319435 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab7f28-6629-4dea-a4ad-abca610b77b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:50.319715 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab7f28-6629-4dea-a4ad-abca610b77b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:50.319990 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab7f28-6629-4dea-a4ad-abca610b77b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:50.320764 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab7f28-6629-4dea-a4ad-abca610b77b3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:50.321108 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab7f28-6629-4dea-a4ad-abca610b77b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:50.322725 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab7f28-6629-4dea-a4ad-abca610b77b3 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:50.336191 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 197/397] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:27:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:50.341905 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06483e1d-fff9-49e0-acd2-ca405b85abef admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:50.358904 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06483e1d-fff9-49e0-acd2-ca405b85abef admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:50.365433 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2057e20-f79f-43dd-a114-9b660661eb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:50.366626 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2057e20-f79f-43dd-a114-9b660661eb45 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:50.367128 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2057e20-f79f-43dd-a114-9b660661eb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:50.367624 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2057e20-f79f-43dd-a114-9b660661eb45 admin admin] PATH_INFO: `/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:50.372313 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2057e20-f79f-43dd-a114-9b660661eb45 admin admin] RBAC: Authorizing `identity:get_group(group_id=fa64a08f9e81412e8862d4ad8532fbd0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:50.375550 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2057e20-f79f-43dd-a114-9b660661eb45 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:50.377568 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 201/398] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Feb 9 04:27:50 2022] GET /identity/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:50.383204 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab7f28-6629-4dea-a4ad-abca610b77b3 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:50.398157 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab7f28-6629-4dea-a4ad-abca610b77b3 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:50.408685 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3150262-90db-4373-9ff5-c8f153be105d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:50.409573 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3150262-90db-4373-9ff5-c8f153be105d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:50.409852 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3150262-90db-4373-9ff5-c8f153be105d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:50.410129 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3150262-90db-4373-9ff5-c8f153be105d admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:50.412155 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3150262-90db-4373-9ff5-c8f153be105d admin admin] RBAC: Authorizing `identity:get_project(project_id=635df70d95a247b1a0a172cbb183ba9b)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:50.414512 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3150262-90db-4373-9ff5-c8f153be105d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:50.417194 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 198/399] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:50 2022] GET /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:50.422276 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2057e20-f79f-43dd-a114-9b660661eb45 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:50.438982 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2057e20-f79f-43dd-a114-9b660661eb45 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:50.450680 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d818740-fea9-443e-b699-3b80b118d85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:50.451625 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d818740-fea9-443e-b699-3b80b118d85e admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:50.451907 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d818740-fea9-443e-b699-3b80b118d85e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:50.452180 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d818740-fea9-443e-b699-3b80b118d85e admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b/groups/fa64a08f9e81412e8862d4ad8532fbd0/roles/850547f4dcf34a76a710ddaae9dc30de` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:50.458935 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d818740-fea9-443e-b699-3b80b118d85e admin admin] RBAC: Authorizing `identity:create_grant(project_id=635df70d95a247b1a0a172cbb183ba9b, group_id=fa64a08f9e81412e8862d4ad8532fbd0, role_id=850547f4dcf34a76a710ddaae9dc30de)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:50.461841 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d818740-fea9-443e-b699-3b80b118d85e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:50.490000 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 202/400] 10.222.0.36 () {58 vars in 1463 bytes} [Wed Feb 9 04:27:50 2022] PUT /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b/groups/fa64a08f9e81412e8862d4ad8532fbd0/roles/850547f4dcf34a76a710ddaae9dc30de => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:27:51.168921 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5214a13-650f-4872-834b-9fd3cea8f2ee None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:51.169455 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5214a13-650f-4872-834b-9fd3cea8f2ee None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:51.169531 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5214a13-650f-4872-834b-9fd3cea8f2ee None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:51.171583 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 199/401] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:51.188327 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ec1ca-bcce-48be-8999-188da3de9ffd None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:51.189282 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ec1ca-bcce-48be-8999-188da3de9ffd None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:51.190041 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ec1ca-bcce-48be-8999-188da3de9ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:51.209724 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff792bb-81a3-460a-9ae2-7c8790930594 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:51.210029 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff792bb-81a3-460a-9ae2-7c8790930594 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:51.210289 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff792bb-81a3-460a-9ae2-7c8790930594 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:51.217332 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 200/402] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:51.218584 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-150ec1ca-bcce-48be-8999-188da3de9ffd None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:51.218797 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd42500-4fb5-44e4-a658-9edff463a6f4 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:51.219085 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd42500-4fb5-44e4-a658-9edff463a6f4 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:51.219362 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd42500-4fb5-44e4-a658-9edff463a6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:51.220627 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-150ec1ca-bcce-48be-8999-188da3de9ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:51.249789 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-8fd42500-4fb5-44e4-a658-9edff463a6f4 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:51.251069 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-8fd42500-4fb5-44e4-a658-9edff463a6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:51.298571 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 203/403] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:51.350178 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ec1ca-bcce-48be-8999-188da3de9ffd None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:51.361147 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 201/404] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 09 04:27:51.361977 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ec1ca-bcce-48be-8999-188da3de9ffd None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:51.377149 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea407c-55f3-4ea2-9039-01f6efd5f5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:51.378013 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea407c-55f3-4ea2-9039-01f6efd5f5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:51.378301 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea407c-55f3-4ea2-9039-01f6efd5f5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:51.378579 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea407c-55f3-4ea2-9039-01f6efd5f5f6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:51.396747 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea407c-55f3-4ea2-9039-01f6efd5f5f6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:51.403795 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-71ea407c-55f3-4ea2-9039-01f6efd5f5f6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:27:51.405349 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 204/405] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:27:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:51.410990 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd42500-4fb5-44e4-a658-9edff463a6f4 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:51.420320 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea407c-55f3-4ea2-9039-01f6efd5f5f6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:51.426012 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd42500-4fb5-44e4-a658-9edff463a6f4 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:51.433582 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea407c-55f3-4ea2-9039-01f6efd5f5f6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:51.437150 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316e94d-6407-4b32-ab9d-c8323afc545d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:51.438033 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316e94d-6407-4b32-ab9d-c8323afc545d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:51.438315 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316e94d-6407-4b32-ab9d-c8323afc545d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:51.439117 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316e94d-6407-4b32-ab9d-c8323afc545d admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:51.440450 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316e94d-6407-4b32-ab9d-c8323afc545d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:51.440763 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316e94d-6407-4b32-ab9d-c8323afc545d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:51.443168 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2171bb5-b72d-487c-9244-837bd5843419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:51.444010 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2171bb5-b72d-487c-9244-837bd5843419 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:51.444289 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2171bb5-b72d-487c-9244-837bd5843419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:51.445706 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2171bb5-b72d-487c-9244-837bd5843419 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:51.446333 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316e94d-6407-4b32-ab9d-c8323afc545d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:51.461397 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 202/406] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:51.466871 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316e94d-6407-4b32-ab9d-c8323afc545d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:51.469625 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2171bb5-b72d-487c-9244-837bd5843419 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:51.477242 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-c2171bb5-b72d-487c-9244-837bd5843419 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 09 04:27:51.477674 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316e94d-6407-4b32-ab9d-c8323afc545d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:51.478700 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 205/407] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Feb 9 04:27:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:27:51.485075 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd185cae-4779-4d95-9c55-8c8d3e11b219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:51.485594 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2171bb5-b72d-487c-9244-837bd5843419 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:51.486097 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd185cae-4779-4d95-9c55-8c8d3e11b219 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:51.486396 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd185cae-4779-4d95-9c55-8c8d3e11b219 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:51.486671 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd185cae-4779-4d95-9c55-8c8d3e11b219 admin admin] PATH_INFO: `/v3/groups/01a002a0ba1b4fbcb55f398c9fa90090` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:51.488006 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd185cae-4779-4d95-9c55-8c8d3e11b219 admin admin] RBAC: Authorizing `identity:get_group(group_id=01a002a0ba1b4fbcb55f398c9fa90090)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:51.490224 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd185cae-4779-4d95-9c55-8c8d3e11b219 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:51.492346 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 203/408] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Feb 9 04:27:51 2022] GET /identity/v3/groups/01a002a0ba1b4fbcb55f398c9fa90090 => generated 229 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:51.498699 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd185cae-4779-4d95-9c55-8c8d3e11b219 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:51.508925 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2171bb5-b72d-487c-9244-837bd5843419 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:51.512179 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd185cae-4779-4d95-9c55-8c8d3e11b219 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:51.518423 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0144ad0-ff79-4b45-aff6-aa05466faad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:51.519366 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0144ad0-ff79-4b45-aff6-aa05466faad4 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:51.519703 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0144ad0-ff79-4b45-aff6-aa05466faad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:51.519982 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0144ad0-ff79-4b45-aff6-aa05466faad4 admin admin] PATH_INFO: `/v3/projects/583a6798f0f24da3a88ba3f8de9474df` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:51.521358 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0144ad0-ff79-4b45-aff6-aa05466faad4 admin admin] RBAC: Authorizing `identity:get_project(project_id=583a6798f0f24da3a88ba3f8de9474df)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:51.523529 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0144ad0-ff79-4b45-aff6-aa05466faad4 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:51.525869 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 204/409] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:51 2022] GET /identity/v3/projects/583a6798f0f24da3a88ba3f8de9474df => generated 344 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:51.526392 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336d320-32a1-4262-8ac7-3dac64572a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:51.527078 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336d320-32a1-4262-8ac7-3dac64572a7c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:51.527357 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336d320-32a1-4262-8ac7-3dac64572a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:51.527625 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336d320-32a1-4262-8ac7-3dac64572a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:51.528396 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336d320-32a1-4262-8ac7-3dac64572a7c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:51.528697 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336d320-32a1-4262-8ac7-3dac64572a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:51.530361 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336d320-32a1-4262-8ac7-3dac64572a7c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:51.531552 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0144ad0-ff79-4b45-aff6-aa05466faad4 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:51.543579 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0144ad0-ff79-4b45-aff6-aa05466faad4 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:51.550699 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba09d76-c611-48c2-91a7-617b3ef71a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:51.551275 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 206/410] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:27:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:51.551589 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba09d76-c611-48c2-91a7-617b3ef71a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:51.551927 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba09d76-c611-48c2-91a7-617b3ef71a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:51.552203 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba09d76-c611-48c2-91a7-617b3ef71a4a admin admin] PATH_INFO: `/v3/projects/583a6798f0f24da3a88ba3f8de9474df/groups/01a002a0ba1b4fbcb55f398c9fa90090/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:51.554288 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba09d76-c611-48c2-91a7-617b3ef71a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=583a6798f0f24da3a88ba3f8de9474df, group_id=01a002a0ba1b4fbcb55f398c9fa90090, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:51.557340 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba09d76-c611-48c2-91a7-617b3ef71a4a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:51.557531 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336d320-32a1-4262-8ac7-3dac64572a7c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:51.578030 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 205/411] 10.222.0.36 () {58 vars in 1463 bytes} [Wed Feb 9 04:27:51 2022] PUT /identity/v3/projects/583a6798f0f24da3a88ba3f8de9474df/groups/01a002a0ba1b4fbcb55f398c9fa90090/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:27:51.580514 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336d320-32a1-4262-8ac7-3dac64572a7c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:51.674683 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8cd5f-9d95-4895-a31d-1f69b9301c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:51.675525 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8cd5f-9d95-4895-a31d-1f69b9301c78 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:51.675811 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8cd5f-9d95-4895-a31d-1f69b9301c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:51.676087 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8cd5f-9d95-4895-a31d-1f69b9301c78 admin admin] PATH_INFO: `/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:51.679206 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8cd5f-9d95-4895-a31d-1f69b9301c78 admin admin] RBAC: Authorizing `identity:get_group(group_id=fa64a08f9e81412e8862d4ad8532fbd0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:51.681280 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8cd5f-9d95-4895-a31d-1f69b9301c78 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:51.683007 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 207/412] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Feb 9 04:27:51 2022] GET /identity/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0 => generated 226 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:51.689713 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba09d76-c611-48c2-91a7-617b3ef71a4a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:51.703940 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba09d76-c611-48c2-91a7-617b3ef71a4a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:51.716873 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55eef16-5949-47b2-beb5-8b0a3f810221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:51.717872 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55eef16-5949-47b2-beb5-8b0a3f810221 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:51.718136 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55eef16-5949-47b2-beb5-8b0a3f810221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:51.718413 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55eef16-5949-47b2-beb5-8b0a3f810221 admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:51.719671 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55eef16-5949-47b2-beb5-8b0a3f810221 admin admin] RBAC: Authorizing `identity:get_project(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:51.721918 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55eef16-5949-47b2-beb5-8b0a3f810221 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:51.723676 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 206/413] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:51 2022] GET /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:51.729453 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8cd5f-9d95-4895-a31d-1f69b9301c78 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:51.742325 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8cd5f-9d95-4895-a31d-1f69b9301c78 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:51.750266 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb8bf3-852a-4352-a97f-8a086e6a3ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:51.751218 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb8bf3-852a-4352-a97f-8a086e6a3ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:51.751499 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb8bf3-852a-4352-a97f-8a086e6a3ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:51.751772 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb8bf3-852a-4352-a97f-8a086e6a3ad9 admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6/groups/fa64a08f9e81412e8862d4ad8532fbd0/roles/850547f4dcf34a76a710ddaae9dc30de` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:51.757228 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb8bf3-852a-4352-a97f-8a086e6a3ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6, group_id=fa64a08f9e81412e8862d4ad8532fbd0, role_id=850547f4dcf34a76a710ddaae9dc30de)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:51.759996 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb8bf3-852a-4352-a97f-8a086e6a3ad9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:51.779052 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 208/414] 10.222.0.36 () {58 vars in 1463 bytes} [Wed Feb 9 04:27:51 2022] PUT /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6/groups/fa64a08f9e81412e8862d4ad8532fbd0/roles/850547f4dcf34a76a710ddaae9dc30de => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:27:51.859876 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e42e9-82ec-462d-b8bd-af0f4485a999 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:51.860183 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e42e9-82ec-462d-b8bd-af0f4485a999 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:51.860430 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e42e9-82ec-462d-b8bd-af0f4485a999 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:51.862277 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 207/415] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:51.868445 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30a75f-6796-40c8-a30d-031488684f7e None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:51.868788 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30a75f-6796-40c8-a30d-031488684f7e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:51.869159 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30a75f-6796-40c8-a30d-031488684f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:51.892154 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-da30a75f-6796-40c8-a30d-031488684f7e None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:51.893501 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-da30a75f-6796-40c8-a30d-031488684f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:51.964675 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 209/416] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:51.999861 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e42e9-82ec-462d-b8bd-af0f4485a999 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:52.012183 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e42e9-82ec-462d-b8bd-af0f4485a999 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:52.016821 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26d6a2-d576-4ed4-b372-2d04da0c957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:52.017728 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26d6a2-d576-4ed4-b372-2d04da0c957b admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:52.018027 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26d6a2-d576-4ed4-b372-2d04da0c957b admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:52.018281 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26d6a2-d576-4ed4-b372-2d04da0c957b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:52.031821 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26d6a2-d576-4ed4-b372-2d04da0c957b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:52.039182 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-ec26d6a2-d576-4ed4-b372-2d04da0c957b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 09 04:27:52.040768 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 208/417] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:52.047009 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30a75f-6796-40c8-a30d-031488684f7e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:52.056135 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30a75f-6796-40c8-a30d-031488684f7e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:52.061442 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f98366-87e7-4544-a6d9-9acc26376e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:52.062115 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f98366-87e7-4544-a6d9-9acc26376e05 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:52.062400 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f98366-87e7-4544-a6d9-9acc26376e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:52.062679 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f98366-87e7-4544-a6d9-9acc26376e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:52.063444 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f98366-87e7-4544-a6d9-9acc26376e05 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:52.063752 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f98366-87e7-4544-a6d9-9acc26376e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:52.065445 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f98366-87e7-4544-a6d9-9acc26376e05 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:52.076072 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 210/418] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:52.081575 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26d6a2-d576-4ed4-b372-2d04da0c957b admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:52.094550 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26d6a2-d576-4ed4-b372-2d04da0c957b admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:52.099066 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f978b-7134-4df9-bcb9-b550b7eaf571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:52.099717 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f978b-7134-4df9-bcb9-b550b7eaf571 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:52.099996 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f978b-7134-4df9-bcb9-b550b7eaf571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:52.100270 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f978b-7134-4df9-bcb9-b550b7eaf571 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:52.112108 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f978b-7134-4df9-bcb9-b550b7eaf571 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:52.113962 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f978b-7134-4df9-bcb9-b550b7eaf571 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:52.127388 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 209/419] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:52.132574 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f98366-87e7-4544-a6d9-9acc26376e05 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:52.146967 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f98366-87e7-4544-a6d9-9acc26376e05 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:52.151886 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1b747-0745-4840-9bc3-79dab1588e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:52.152827 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1b747-0745-4840-9bc3-79dab1588e1e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:52.153144 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1b747-0745-4840-9bc3-79dab1588e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:52.153420 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1b747-0745-4840-9bc3-79dab1588e1e admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:52.155335 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1b747-0745-4840-9bc3-79dab1588e1e admin admin] RBAC: Authorizing `identity:get_project(project_id=635df70d95a247b1a0a172cbb183ba9b)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:52.157574 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1b747-0745-4840-9bc3-79dab1588e1e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:52.159737 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 211/420] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:52 2022] GET /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:52.165248 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f978b-7134-4df9-bcb9-b550b7eaf571 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:52.175458 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f978b-7134-4df9-bcb9-b550b7eaf571 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:52.180062 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d1a2c-feeb-4891-a336-1ace0f5499e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:52.180960 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d1a2c-feeb-4891-a336-1ace0f5499e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:52.181273 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d1a2c-feeb-4891-a336-1ace0f5499e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:52.181549 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d1a2c-feeb-4891-a336-1ace0f5499e5 admin admin] PATH_INFO: `/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:52.182777 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d1a2c-feeb-4891-a336-1ace0f5499e5 admin admin] RBAC: Authorizing `identity:get_group(group_id=fa64a08f9e81412e8862d4ad8532fbd0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:52.184790 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d1a2c-feeb-4891-a336-1ace0f5499e5 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:52.186752 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 210/421] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Feb 9 04:27:52 2022] GET /identity/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:52.192112 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1b747-0745-4840-9bc3-79dab1588e1e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:52.202480 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1b747-0745-4840-9bc3-79dab1588e1e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:52.207179 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f9416-aa54-423c-9e4b-7dd537bfda4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:52.207909 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f9416-aa54-423c-9e4b-7dd537bfda4e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:52.208240 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f9416-aa54-423c-9e4b-7dd537bfda4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:52.208520 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f9416-aa54-423c-9e4b-7dd537bfda4e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:52.209442 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f9416-aa54-423c-9e4b-7dd537bfda4e admin admin] RBAC: Adding query filter params (group.id=fa64a08f9e81412e8862d4ad8532fbd0, role.id=102f883957d846419d33ce22fdec0cce, scope.project.id=635df70d95a247b1a0a172cbb183ba9b) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:52.209754 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f9416-aa54-423c-9e4b-7dd537bfda4e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:52.211740 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f9416-aa54-423c-9e4b-7dd537bfda4e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:52.219108 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 212/422] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Feb 9 04:27:52 2022] GET /identity/v3/role_assignments?group.id=fa64a08f9e81412e8862d4ad8532fbd0&scope.project.id=635df70d95a247b1a0a172cbb183ba9b&role.id=102f883957d846419d33ce22fdec0cce => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:52.893780 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4efff8-2bf5-48ac-9d7e-8cff839e5b97 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:52.893780 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4efff8-2bf5-48ac-9d7e-8cff839e5b97 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:52.893780 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4efff8-2bf5-48ac-9d7e-8cff839e5b97 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:52.893780 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 211/423] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:52.902354 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351f8d6-e895-4505-8b15-dddab39c886c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:52.902354 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351f8d6-e895-4505-8b15-dddab39c886c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:52.902354 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351f8d6-e895-4505-8b15-dddab39c886c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:52.923699 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-7351f8d6-e895-4505-8b15-dddab39c886c None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:52.925234 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7351f8d6-e895-4505-8b15-dddab39c886c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:52.941100 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 213/424] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:52.959106 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4efff8-2bf5-48ac-9d7e-8cff839e5b97 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:52.972204 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4efff8-2bf5-48ac-9d7e-8cff839e5b97 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:52.976851 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ff76c-c7ef-45ce-9e3e-1b121998316d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:52.977889 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ff76c-c7ef-45ce-9e3e-1b121998316d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:52.978368 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ff76c-c7ef-45ce-9e3e-1b121998316d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:52.978839 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058ff76c-c7ef-45ce-9e3e-1b121998316d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:52.990109 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058ff76c-c7ef-45ce-9e3e-1b121998316d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:52.997426 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-058ff76c-c7ef-45ce-9e3e-1b121998316d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 09 04:27:53.003649 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 212/425] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:53.005267 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351f8d6-e895-4505-8b15-dddab39c886c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:53.014461 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351f8d6-e895-4505-8b15-dddab39c886c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:53.019166 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fa541-a8cb-472e-b5fb-bbc26542f948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:53.020069 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fa541-a8cb-472e-b5fb-bbc26542f948 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:53.020548 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fa541-a8cb-472e-b5fb-bbc26542f948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:53.021076 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fa541-a8cb-472e-b5fb-bbc26542f948 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:53.022038 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fa541-a8cb-472e-b5fb-bbc26542f948 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:53.022538 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fa541-a8cb-472e-b5fb-bbc26542f948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:53.024347 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fa541-a8cb-472e-b5fb-bbc26542f948 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:53.039080 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 214/426] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:27:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:53.040669 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ff76c-c7ef-45ce-9e3e-1b121998316d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:53.051693 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058ff76c-c7ef-45ce-9e3e-1b121998316d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:53.056378 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239179b-0db1-4cdf-9a1c-2b7d60510df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:53.057299 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239179b-0db1-4cdf-9a1c-2b7d60510df0 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:53.057794 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239179b-0db1-4cdf-9a1c-2b7d60510df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:53.058258 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239179b-0db1-4cdf-9a1c-2b7d60510df0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:53.067137 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239179b-0db1-4cdf-9a1c-2b7d60510df0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:53.069168 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239179b-0db1-4cdf-9a1c-2b7d60510df0 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:53.084512 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 213/427] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:53.086312 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fa541-a8cb-472e-b5fb-bbc26542f948 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:53.097916 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fa541-a8cb-472e-b5fb-bbc26542f948 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:53.103112 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583df6c5-4db8-42fe-b1c4-f7b2f27d38a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:53.104382 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583df6c5-4db8-42fe-b1c4-f7b2f27d38a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:53.104863 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583df6c5-4db8-42fe-b1c4-f7b2f27d38a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:53.105363 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583df6c5-4db8-42fe-b1c4-f7b2f27d38a9 admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:53.106884 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583df6c5-4db8-42fe-b1c4-f7b2f27d38a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:53.109828 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583df6c5-4db8-42fe-b1c4-f7b2f27d38a9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:53.116344 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 215/428] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:53 2022] GET /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:53.118104 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239179b-0db1-4cdf-9a1c-2b7d60510df0 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:53.127498 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239179b-0db1-4cdf-9a1c-2b7d60510df0 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:53.134748 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769051d-ecb6-4c70-a89e-307a9c6f7c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:53.135880 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769051d-ecb6-4c70-a89e-307a9c6f7c81 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:53.136382 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769051d-ecb6-4c70-a89e-307a9c6f7c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:53.136853 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769051d-ecb6-4c70-a89e-307a9c6f7c81 admin admin] PATH_INFO: `/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:53.138294 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769051d-ecb6-4c70-a89e-307a9c6f7c81 admin admin] RBAC: Authorizing `identity:get_group(group_id=fa64a08f9e81412e8862d4ad8532fbd0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:53.140914 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769051d-ecb6-4c70-a89e-307a9c6f7c81 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:53.147711 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 214/429] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Feb 9 04:27:53 2022] GET /identity/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:53.149306 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583df6c5-4db8-42fe-b1c4-f7b2f27d38a9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:53.159792 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583df6c5-4db8-42fe-b1c4-f7b2f27d38a9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:53.165678 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f80c08-fc10-4479-9c06-bff07ea0fe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:53.166621 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f80c08-fc10-4479-9c06-bff07ea0fe67 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:53.167141 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f80c08-fc10-4479-9c06-bff07ea0fe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:53.167636 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f80c08-fc10-4479-9c06-bff07ea0fe67 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:53.168732 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f80c08-fc10-4479-9c06-bff07ea0fe67 admin admin] RBAC: Adding query filter params (group.id=fa64a08f9e81412e8862d4ad8532fbd0, role.id=102f883957d846419d33ce22fdec0cce, scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:53.169272 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f80c08-fc10-4479-9c06-bff07ea0fe67 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:53.171560 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f80c08-fc10-4479-9c06-bff07ea0fe67 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:53.185197 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 216/430] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Feb 9 04:27:53 2022] GET /identity/v3/role_assignments?group.id=fa64a08f9e81412e8862d4ad8532fbd0&scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6&role.id=102f883957d846419d33ce22fdec0cce => generated 611 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:53.384573 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff53ec-cbfb-4b3b-abf1-40570f75d8cf None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:53.385103 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff53ec-cbfb-4b3b-abf1-40570f75d8cf None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:53.385404 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff53ec-cbfb-4b3b-abf1-40570f75d8cf None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:53.387186 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 215/431] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:53.393264 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59da947-b717-4646-b5cb-d9d6c0d5598b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:53.393710 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59da947-b717-4646-b5cb-d9d6c0d5598b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:53.393884 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59da947-b717-4646-b5cb-d9d6c0d5598b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:53.414488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-b59da947-b717-4646-b5cb-d9d6c0d5598b None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:53.415618 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b59da947-b717-4646-b5cb-d9d6c0d5598b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:53.426111 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 217/432] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:53.450656 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff53ec-cbfb-4b3b-abf1-40570f75d8cf None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:53.463889 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff53ec-cbfb-4b3b-abf1-40570f75d8cf None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:53.470339 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1298bfd-0213-46a6-996f-720c6ebdb80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:53.471142 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1298bfd-0213-46a6-996f-720c6ebdb80c admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:53.471428 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1298bfd-0213-46a6-996f-720c6ebdb80c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:53.471710 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1298bfd-0213-46a6-996f-720c6ebdb80c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:53.483623 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1298bfd-0213-46a6-996f-720c6ebdb80c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:53.490911 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-f1298bfd-0213-46a6-996f-720c6ebdb80c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 09 04:27:53.492399 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 216/433] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Feb 9 04:27:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:53.498517 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59da947-b717-4646-b5cb-d9d6c0d5598b None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:53.508156 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59da947-b717-4646-b5cb-d9d6c0d5598b None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:53.513093 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e5dce-0e33-4542-96df-3b6a929d01bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:53.514551 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e5dce-0e33-4542-96df-3b6a929d01bb admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:53.515051 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e5dce-0e33-4542-96df-3b6a929d01bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:53.515526 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e5dce-0e33-4542-96df-3b6a929d01bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:53.516500 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e5dce-0e33-4542-96df-3b6a929d01bb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:53.517080 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e5dce-0e33-4542-96df-3b6a929d01bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:53.518950 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e5dce-0e33-4542-96df-3b6a929d01bb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:53.529483 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 218/434] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:27:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:53.534868 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1298bfd-0213-46a6-996f-720c6ebdb80c admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:53.549944 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1298bfd-0213-46a6-996f-720c6ebdb80c admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:53.559035 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b42788-3848-4ec8-915e-02e8e2f27ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:53.559738 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b42788-3848-4ec8-915e-02e8e2f27ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:53.560021 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b42788-3848-4ec8-915e-02e8e2f27ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:53.560295 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b42788-3848-4ec8-915e-02e8e2f27ac8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:53.572235 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b42788-3848-4ec8-915e-02e8e2f27ac8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:53.574277 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b42788-3848-4ec8-915e-02e8e2f27ac8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:53.585516 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 217/435] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:53.591111 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e5dce-0e33-4542-96df-3b6a929d01bb admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:53.601318 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e5dce-0e33-4542-96df-3b6a929d01bb admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:53.606054 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c439d-0d2c-4740-a813-2c904ae92220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:53.607102 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c439d-0d2c-4740-a813-2c904ae92220 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:53.607591 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c439d-0d2c-4740-a813-2c904ae92220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:53.608046 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c439d-0d2c-4740-a813-2c904ae92220 admin admin] PATH_INFO: `/v3/projects/635df70d95a247b1a0a172cbb183ba9b` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:53.609505 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c439d-0d2c-4740-a813-2c904ae92220 admin admin] RBAC: Authorizing `identity:get_project(project_id=635df70d95a247b1a0a172cbb183ba9b)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:53.611740 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c439d-0d2c-4740-a813-2c904ae92220 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:53.613972 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 219/436] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:53 2022] GET /identity/v3/projects/635df70d95a247b1a0a172cbb183ba9b => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:53.619255 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b42788-3848-4ec8-915e-02e8e2f27ac8 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:53.631304 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b42788-3848-4ec8-915e-02e8e2f27ac8 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:53.641735 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13a20c-d00f-402c-b4f4-077dd821f582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:53.642907 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13a20c-d00f-402c-b4f4-077dd821f582 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:53.643208 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13a20c-d00f-402c-b4f4-077dd821f582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:53.643481 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13a20c-d00f-402c-b4f4-077dd821f582 admin admin] PATH_INFO: `/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:53.644723 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13a20c-d00f-402c-b4f4-077dd821f582 admin admin] RBAC: Authorizing `identity:get_group(group_id=fa64a08f9e81412e8862d4ad8532fbd0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:53.646666 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13a20c-d00f-402c-b4f4-077dd821f582 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:53.649570 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 218/437] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Feb 9 04:27:53 2022] GET /identity/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:53.655016 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c439d-0d2c-4740-a813-2c904ae92220 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:53.666633 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c439d-0d2c-4740-a813-2c904ae92220 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:53.672038 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe284f1e-f9da-424c-8498-43fcb2a76005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:53.672688 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe284f1e-f9da-424c-8498-43fcb2a76005 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:53.672970 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe284f1e-f9da-424c-8498-43fcb2a76005 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:53.673283 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe284f1e-f9da-424c-8498-43fcb2a76005 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:53.674137 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe284f1e-f9da-424c-8498-43fcb2a76005 admin admin] RBAC: Adding query filter params (group.id=fa64a08f9e81412e8862d4ad8532fbd0, role.id=850547f4dcf34a76a710ddaae9dc30de, scope.project.id=635df70d95a247b1a0a172cbb183ba9b) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:53.674451 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe284f1e-f9da-424c-8498-43fcb2a76005 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:53.676345 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe284f1e-f9da-424c-8498-43fcb2a76005 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:53.682805 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 220/438] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Feb 9 04:27:53 2022] GET /identity/v3/role_assignments?group.id=fa64a08f9e81412e8862d4ad8532fbd0&scope.project.id=635df70d95a247b1a0a172cbb183ba9b&role.id=850547f4dcf34a76a710ddaae9dc30de => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:54.321432 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efa34c-540c-4a60-a163-b1deed136ad1 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:54.321719 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efa34c-540c-4a60-a163-b1deed136ad1 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:54.322004 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efa34c-540c-4a60-a163-b1deed136ad1 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:54.323781 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 219/439] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:54.330090 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e32ee2-ba63-4ab6-8b71-e9ece06abc79 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:54.330385 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e32ee2-ba63-4ab6-8b71-e9ece06abc79 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:54.330667 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e32ee2-ba63-4ab6-8b71-e9ece06abc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:54.348052 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a6e32ee2-ba63-4ab6-8b71-e9ece06abc79 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:54.349295 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a6e32ee2-ba63-4ab6-8b71-e9ece06abc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:54.356663 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 221/440] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:54.383734 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efa34c-540c-4a60-a163-b1deed136ad1 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:54.396259 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efa34c-540c-4a60-a163-b1deed136ad1 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:54.400441 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00aa626-69f9-4707-992a-b5150056ee50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:54.401314 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00aa626-69f9-4707-992a-b5150056ee50 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:54.401694 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00aa626-69f9-4707-992a-b5150056ee50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:54.401977 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00aa626-69f9-4707-992a-b5150056ee50 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:54.411815 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00aa626-69f9-4707-992a-b5150056ee50 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:54.418883 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-b00aa626-69f9-4707-992a-b5150056ee50 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:27:54.420054 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 220/441] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:27:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:54.425684 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e32ee2-ba63-4ab6-8b71-e9ece06abc79 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:54.434494 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e32ee2-ba63-4ab6-8b71-e9ece06abc79 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:54.440739 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d306d-1e75-4c35-a5e4-482cdb1b030a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:54.441439 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d306d-1e75-4c35-a5e4-482cdb1b030a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:54.441728 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d306d-1e75-4c35-a5e4-482cdb1b030a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:54.441999 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d306d-1e75-4c35-a5e4-482cdb1b030a admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:54.442882 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d306d-1e75-4c35-a5e4-482cdb1b030a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:54.443205 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d306d-1e75-4c35-a5e4-482cdb1b030a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:54.444968 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d306d-1e75-4c35-a5e4-482cdb1b030a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:54.453941 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 222/442] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:27:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:54.459406 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00aa626-69f9-4707-992a-b5150056ee50 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:54.468831 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00aa626-69f9-4707-992a-b5150056ee50 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:54.473098 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984bf3b-433f-4569-bec1-586c86302efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:54.473727 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984bf3b-433f-4569-bec1-586c86302efe admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:54.474012 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984bf3b-433f-4569-bec1-586c86302efe admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:54.474287 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984bf3b-433f-4569-bec1-586c86302efe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:54.482412 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984bf3b-433f-4569-bec1-586c86302efe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:54.484134 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984bf3b-433f-4569-bec1-586c86302efe admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:54.492608 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 221/443] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:27:54.498461 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d306d-1e75-4c35-a5e4-482cdb1b030a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:54.507776 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d306d-1e75-4c35-a5e4-482cdb1b030a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:54.510756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6b0cf-5d80-40f0-b425-46d1d83c354a None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:54.511047 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6b0cf-5d80-40f0-b425-46d1d83c354a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:54.511328 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad6b0cf-5d80-40f0-b425-46d1d83c354a None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:54.512030 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e7be8-95ba-4f67-bad4-e8e4d69ff342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:54.512868 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e7be8-95ba-4f67-bad4-e8e4d69ff342 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:54.513325 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e7be8-95ba-4f67-bad4-e8e4d69ff342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:54.513441 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 222/444] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:27:54.513637 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e7be8-95ba-4f67-bad4-e8e4d69ff342 admin admin] PATH_INFO: `/v3/projects/583a6798f0f24da3a88ba3f8de9474df` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:54.515265 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e7be8-95ba-4f67-bad4-e8e4d69ff342 admin admin] RBAC: Authorizing `identity:get_project(project_id=583a6798f0f24da3a88ba3f8de9474df)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:54.517095 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e7be8-95ba-4f67-bad4-e8e4d69ff342 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:54.518400 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530ed0c-acb8-42c2-a2ef-e3d25bb50487 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:54.518904 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530ed0c-acb8-42c2-a2ef-e3d25bb50487 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:54.519027 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 223/445] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:54 2022] GET /identity/v3/projects/583a6798f0f24da3a88ba3f8de9474df => generated 344 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:54.519119 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530ed0c-acb8-42c2-a2ef-e3d25bb50487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:54.523939 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e7be8-95ba-4f67-bad4-e8e4d69ff342 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:54.533167 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e7be8-95ba-4f67-bad4-e8e4d69ff342 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:54.535834 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-4530ed0c-acb8-42c2-a2ef-e3d25bb50487 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:54.536991 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-4530ed0c-acb8-42c2-a2ef-e3d25bb50487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:54.537475 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772758a-f1c0-41d2-b110-2589ce6e1aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:54.538534 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772758a-f1c0-41d2-b110-2589ce6e1aaa admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:54.538819 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772758a-f1c0-41d2-b110-2589ce6e1aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:54.539102 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772758a-f1c0-41d2-b110-2589ce6e1aaa admin admin] PATH_INFO: `/v3/groups/01a002a0ba1b4fbcb55f398c9fa90090` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:54.540264 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772758a-f1c0-41d2-b110-2589ce6e1aaa admin admin] RBAC: Authorizing `identity:get_group(group_id=01a002a0ba1b4fbcb55f398c9fa90090)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:54.542165 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772758a-f1c0-41d2-b110-2589ce6e1aaa admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:54.545229 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 224/446] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Feb 9 04:27:54 2022] GET /identity/v3/groups/01a002a0ba1b4fbcb55f398c9fa90090 => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:27:54.545364 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 223/447] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 09 04:27:54.550115 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772758a-f1c0-41d2-b110-2589ce6e1aaa admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:54.559446 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772758a-f1c0-41d2-b110-2589ce6e1aaa admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:54.564368 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4222c-7e49-4567-8cf3-b12dcd53d91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:54.564982 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4222c-7e49-4567-8cf3-b12dcd53d91c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:54.565305 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4222c-7e49-4567-8cf3-b12dcd53d91c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:54.565582 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4222c-7e49-4567-8cf3-b12dcd53d91c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:54.566413 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4222c-7e49-4567-8cf3-b12dcd53d91c admin admin] RBAC: Adding query filter params (group.id=01a002a0ba1b4fbcb55f398c9fa90090, role.id=05ca9a16ef2a450b8cc73ade47f5c7d0, scope.project.id=583a6798f0f24da3a88ba3f8de9474df) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:54.566726 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4222c-7e49-4567-8cf3-b12dcd53d91c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:54.568396 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530ed0c-acb8-42c2-a2ef-e3d25bb50487 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:54.568784 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4222c-7e49-4567-8cf3-b12dcd53d91c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:54.574834 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 225/448] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Feb 9 04:27:54 2022] GET /identity/v3/role_assignments?group.id=01a002a0ba1b4fbcb55f398c9fa90090&scope.project.id=583a6798f0f24da3a88ba3f8de9474df&role.id=05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:54.579090 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530ed0c-acb8-42c2-a2ef-e3d25bb50487 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:54.583498 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e6816-8e28-443d-9900-0d6248007685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:54.584323 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e6816-8e28-443d-9900-0d6248007685 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:54.584602 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e6816-8e28-443d-9900-0d6248007685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:54.584871 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e6816-8e28-443d-9900-0d6248007685 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:54.596665 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e6816-8e28-443d-9900-0d6248007685 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:54.604098 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-a47e6816-8e28-443d-9900-0d6248007685 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 09 04:27:54.605385 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 224/449] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Feb 9 04:27:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:27:54.611358 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4222c-7e49-4567-8cf3-b12dcd53d91c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:54.621205 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4222c-7e49-4567-8cf3-b12dcd53d91c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:54.626243 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fd503-b12e-4b35-9707-a565f1eb493c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:54.626931 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fd503-b12e-4b35-9707-a565f1eb493c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:54.627214 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fd503-b12e-4b35-9707-a565f1eb493c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:54.627490 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486fd503-b12e-4b35-9707-a565f1eb493c admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:54.628269 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fd503-b12e-4b35-9707-a565f1eb493c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:54.628575 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fd503-b12e-4b35-9707-a565f1eb493c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:54.630263 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486fd503-b12e-4b35-9707-a565f1eb493c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:54.639904 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 226/450] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:27:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:54.645732 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e6816-8e28-443d-9900-0d6248007685 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:54.655943 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e6816-8e28-443d-9900-0d6248007685 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:54.660453 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1ba28-6855-4894-a537-1e92926dcfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:54.661211 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1ba28-6855-4894-a537-1e92926dcfec admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:54.661494 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1ba28-6855-4894-a537-1e92926dcfec admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:54.661768 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1ba28-6855-4894-a537-1e92926dcfec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:54.672105 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1ba28-6855-4894-a537-1e92926dcfec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:54.674126 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1ba28-6855-4894-a537-1e92926dcfec admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:54.684448 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 225/451] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:27:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 09 04:27:54.690821 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fd503-b12e-4b35-9707-a565f1eb493c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:54.701233 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486fd503-b12e-4b35-9707-a565f1eb493c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:54.706390 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d32de-b548-4a28-83c7-a135e47a62e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:54.707264 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d32de-b548-4a28-83c7-a135e47a62e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:54.707543 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d32de-b548-4a28-83c7-a135e47a62e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:54.707815 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d32de-b548-4a28-83c7-a135e47a62e5 admin admin] PATH_INFO: `/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:54.709395 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d32de-b548-4a28-83c7-a135e47a62e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=7dce9d8acc2d46ed9dad6cf9c37cc0d6)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:54.711576 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d32de-b548-4a28-83c7-a135e47a62e5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:54.713740 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 227/452] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:27:54 2022] GET /identity/v3/projects/7dce9d8acc2d46ed9dad6cf9c37cc0d6 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:54.719380 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1ba28-6855-4894-a537-1e92926dcfec admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:54.728399 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1ba28-6855-4894-a537-1e92926dcfec admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:54.733262 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a32aa23-1b5a-485d-bafa-f0413b930b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:54.734117 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32aa23-1b5a-485d-bafa-f0413b930b7e admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:54.734391 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32aa23-1b5a-485d-bafa-f0413b930b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:54.734680 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a32aa23-1b5a-485d-bafa-f0413b930b7e admin admin] PATH_INFO: `/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:54.735844 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32aa23-1b5a-485d-bafa-f0413b930b7e admin admin] RBAC: Authorizing `identity:get_group(group_id=fa64a08f9e81412e8862d4ad8532fbd0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:54.737758 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a32aa23-1b5a-485d-bafa-f0413b930b7e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:54.739356 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 226/453] 10.222.0.36 () {56 vars in 1201 bytes} [Wed Feb 9 04:27:54 2022] GET /identity/v3/groups/fa64a08f9e81412e8862d4ad8532fbd0 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:54.745157 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d32de-b548-4a28-83c7-a135e47a62e5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:54.756181 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d32de-b548-4a28-83c7-a135e47a62e5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:54.760481 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744079b5-a47c-426c-940b-b99ebe2060ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:54.761145 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744079b5-a47c-426c-940b-b99ebe2060ff admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:54.761430 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744079b5-a47c-426c-940b-b99ebe2060ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:54.761700 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744079b5-a47c-426c-940b-b99ebe2060ff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:54.762539 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744079b5-a47c-426c-940b-b99ebe2060ff admin admin] RBAC: Adding query filter params (group.id=fa64a08f9e81412e8862d4ad8532fbd0, role.id=850547f4dcf34a76a710ddaae9dc30de, scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:54.762846 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744079b5-a47c-426c-940b-b99ebe2060ff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:54.764724 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744079b5-a47c-426c-940b-b99ebe2060ff admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:54.771584 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 228/454] 10.222.0.36 () {56 vars in 1397 bytes} [Wed Feb 9 04:27:54 2022] GET /identity/v3/role_assignments?group.id=fa64a08f9e81412e8862d4ad8532fbd0&scope.project.id=7dce9d8acc2d46ed9dad6cf9c37cc0d6&role.id=850547f4dcf34a76a710ddaae9dc30de => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:57.626852 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744c800-8e40-4fb4-8ad0-30c6373c4cb5 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:57.627781 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744c800-8e40-4fb4-8ad0-30c6373c4cb5 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:57.628250 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744c800-8e40-4fb4-8ad0-30c6373c4cb5 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:57.630487 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 227/455] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:57.635521 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c473c-e274-45e5-ab0c-c5fb08857dba None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:57.636296 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c473c-e274-45e5-ab0c-c5fb08857dba None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:57.636766 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c473c-e274-45e5-ab0c-c5fb08857dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:57.661989 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-c43c473c-e274-45e5-ab0c-c5fb08857dba None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:57.663725 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c43c473c-e274-45e5-ab0c-c5fb08857dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:57.672479 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 229/456] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:57.703242 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a2b5a-0875-4727-8fd7-63923bc3dbef None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:57.703839 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a2b5a-0875-4727-8fd7-63923bc3dbef None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:57.704295 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a2b5a-0875-4727-8fd7-63923bc3dbef None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:57.706477 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 228/457] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:57.712024 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e4411-e975-467e-869b-50e4f05f6182 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:57.712568 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e4411-e975-467e-869b-50e4f05f6182 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:57.713085 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e4411-e975-467e-869b-50e4f05f6182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:57.716014 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a2b5a-0875-4727-8fd7-63923bc3dbef None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:57.738240 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a2b5a-0875-4727-8fd7-63923bc3dbef None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:57.748483 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66978d1-95e0-4c76-936a-b35bbda64e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:57.749567 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66978d1-95e0-4c76-936a-b35bbda64e08 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:57.750081 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66978d1-95e0-4c76-936a-b35bbda64e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:57.750546 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66978d1-95e0-4c76-936a-b35bbda64e08 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:57.752134 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-5d4e4411-e975-467e-869b-50e4f05f6182 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:57.753736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5d4e4411-e975-467e-869b-50e4f05f6182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:57.769273 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66978d1-95e0-4c76-936a-b35bbda64e08 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:57.771419 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66978d1-95e0-4c76-936a-b35bbda64e08 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:57.773204 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 230/458] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:57.798312 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e4411-e975-467e-869b-50e4f05f6182 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:57.807413 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-a66978d1-95e0-4c76-936a-b35bbda64e08 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:27:57.810346 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e4411-e975-467e-869b-50e4f05f6182 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:57.816002 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 229/459] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:27:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:57.819217 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9f239-1536-4c8c-8513-33242bb20c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:57.820329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9f239-1536-4c8c-8513-33242bb20c6f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:57.820832 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9f239-1536-4c8c-8513-33242bb20c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:57.821345 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9f239-1536-4c8c-8513-33242bb20c6f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:57.822061 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66978d1-95e0-4c76-936a-b35bbda64e08 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:57.839965 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66978d1-95e0-4c76-936a-b35bbda64e08 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:57.841128 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9f239-1536-4c8c-8513-33242bb20c6f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:57.843267 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9f239-1536-4c8c-8513-33242bb20c6f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:57.854497 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac4afa-326b-4e7d-8187-686e773da514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:57.855494 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac4afa-326b-4e7d-8187-686e773da514 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:57.855977 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac4afa-326b-4e7d-8187-686e773da514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:57.856440 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac4afa-326b-4e7d-8187-686e773da514 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:57.857926 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac4afa-326b-4e7d-8187-686e773da514 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:57.858439 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac4afa-326b-4e7d-8187-686e773da514 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:57.859623 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING py.warnings [None req-a6ac4afa-326b-4e7d-8187-686e773da514 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:27:57.859623 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: warnings.warn(msg) Feb 09 04:27:57.859623 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: Feb 09 04:27:57.862179 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac4afa-326b-4e7d-8187-686e773da514 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:57.874867 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-dad9f239-1536-4c8c-8513-33242bb20c6f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:27:57.891133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 231/460] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:27:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:27:57.892344 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9f239-1536-4c8c-8513-33242bb20c6f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:57.900898 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 230/461] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:57.909145 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac4afa-326b-4e7d-8187-686e773da514 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:57.917144 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9f239-1536-4c8c-8513-33242bb20c6f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:57.924285 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac4afa-326b-4e7d-8187-686e773da514 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:57.929594 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f388c78-903a-45f9-892c-4f4690ac5a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:57.930650 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f388c78-903a-45f9-892c-4f4690ac5a5e admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:57.931155 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f388c78-903a-45f9-892c-4f4690ac5a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:57.931623 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f388c78-903a-45f9-892c-4f4690ac5a5e admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:57.932580 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f388c78-903a-45f9-892c-4f4690ac5a5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:57.934416 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcaedb-fcb3-4df9-bd3e-a40862ac4767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:57.935108 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcaedb-fcb3-4df9-bd3e-a40862ac4767 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:57.935964 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcaedb-fcb3-4df9-bd3e-a40862ac4767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:57.936078 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f388c78-903a-45f9-892c-4f4690ac5a5e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:57.936241 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcaedb-fcb3-4df9-bd3e-a40862ac4767 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:57.937213 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fcaedb-fcb3-4df9-bd3e-a40862ac4767 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:57.937679 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fcaedb-fcb3-4df9-bd3e-a40862ac4767 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:57.939478 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fcaedb-fcb3-4df9-bd3e-a40862ac4767 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:57.957784 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 232/462] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:57.963028 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcaedb-fcb3-4df9-bd3e-a40862ac4767 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:57.969878 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 231/463] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Feb 9 04:27:57 2022] POST /identity/v3/users => generated 246 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:27:57.986418 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcaedb-fcb3-4df9-bd3e-a40862ac4767 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:57.994801 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1b053-89c1-486f-aedf-a7520747f7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:57.995736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1b053-89c1-486f-aedf-a7520747f7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:57.996180 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1b053-89c1-486f-aedf-a7520747f7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:57.996589 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1b053-89c1-486f-aedf-a7520747f7d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:57.997580 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1b053-89c1-486f-aedf-a7520747f7d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:58.000342 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1b053-89c1-486f-aedf-a7520747f7d9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:58.040098 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 233/464] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Feb 9 04:27:57 2022] POST /identity/v3/users => generated 248 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:27:58.109334 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a92fac-3c27-47ea-8841-54fc03574069 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:58.109860 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a92fac-3c27-47ea-8841-54fc03574069 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:58.110338 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a92fac-3c27-47ea-8841-54fc03574069 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:58.112739 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 232/465] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:58.118709 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f240f-125d-45a8-b79c-7c66014cf1a2 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:58.119037 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f240f-125d-45a8-b79c-7c66014cf1a2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:58.119283 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f240f-125d-45a8-b79c-7c66014cf1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:58.149831 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-b31f240f-125d-45a8-b79c-7c66014cf1a2 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:58.151384 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b31f240f-125d-45a8-b79c-7c66014cf1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:58.166535 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 234/466] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:58.216103 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a92fac-3c27-47ea-8841-54fc03574069 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:58.217207 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd65987-d065-4fe8-87c5-be2481160dad None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:58.217504 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd65987-d065-4fe8-87c5-be2481160dad None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:58.217783 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd65987-d065-4fe8-87c5-be2481160dad None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:58.219841 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 235/467] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:58.233627 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a92fac-3c27-47ea-8841-54fc03574069 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:58.234582 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760dbe4-9474-4014-91af-f49393c9c023 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:58.234872 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760dbe4-9474-4014-91af-f49393c9c023 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:58.235149 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760dbe4-9474-4014-91af-f49393c9c023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:58.239098 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f5874-faf6-4868-8be4-d3703253a073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:58.239905 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f5874-faf6-4868-8be4-d3703253a073 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:58.240187 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f5874-faf6-4868-8be4-d3703253a073 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:58.240463 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f5874-faf6-4868-8be4-d3703253a073 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:58.258646 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f5874-faf6-4868-8be4-d3703253a073 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:58.260486 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-e760dbe4-9474-4014-91af-f49393c9c023 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:58.260604 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549f5874-faf6-4868-8be4-d3703253a073 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:58.261798 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e760dbe4-9474-4014-91af-f49393c9c023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:58.270068 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 236/468] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 09 04:27:58.282250 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-549f5874-faf6-4868-8be4-d3703253a073 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:27:58.283472 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 233/469] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:58.289783 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760dbe4-9474-4014-91af-f49393c9c023 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:58.302121 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f5874-faf6-4868-8be4-d3703253a073 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:58.303680 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760dbe4-9474-4014-91af-f49393c9c023 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:58.309938 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2869b2-4607-4a3a-a820-f5d247321456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:58.310925 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2869b2-4607-4a3a-a820-f5d247321456 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:58.311434 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2869b2-4607-4a3a-a820-f5d247321456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:58.311990 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2869b2-4607-4a3a-a820-f5d247321456 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:58.312913 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2869b2-4607-4a3a-a820-f5d247321456 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:58.313396 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2869b2-4607-4a3a-a820-f5d247321456 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:58.314372 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549f5874-faf6-4868-8be4-d3703253a073 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:58.315441 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2869b2-4607-4a3a-a820-f5d247321456 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:58.325758 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a59fa6-478e-4bbf-95a0-3d319c625567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:58.325966 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a59fa6-478e-4bbf-95a0-3d319c625567 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:58.326208 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a59fa6-478e-4bbf-95a0-3d319c625567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:58.326419 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a59fa6-478e-4bbf-95a0-3d319c625567 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:58.329965 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 237/470] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:58.340348 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a59fa6-478e-4bbf-95a0-3d319c625567 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:58.342042 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2869b2-4607-4a3a-a820-f5d247321456 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:58.344915 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a59fa6-478e-4bbf-95a0-3d319c625567 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:58.352642 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2869b2-4607-4a3a-a820-f5d247321456 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:58.359777 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc082ee-918a-4851-a1d4-084b4d1b45cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:58.360355 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc082ee-918a-4851-a1d4-084b4d1b45cf admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:58.360657 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc082ee-918a-4851-a1d4-084b4d1b45cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:58.360939 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc082ee-918a-4851-a1d4-084b4d1b45cf admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:58.361694 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc082ee-918a-4851-a1d4-084b4d1b45cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:58.363622 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc082ee-918a-4851-a1d4-084b4d1b45cf admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:58.365755 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-45a59fa6-478e-4bbf-95a0-3d319c625567 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:27:58.371689 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 234/471] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:58.373117 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a59fa6-478e-4bbf-95a0-3d319c625567 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:58.384670 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a59fa6-478e-4bbf-95a0-3d319c625567 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:58.390520 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765dbfc1-ca7f-4993-b0ba-cf4d5c0a06cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:58.391232 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dbfc1-ca7f-4993-b0ba-cf4d5c0a06cb admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:58.391520 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dbfc1-ca7f-4993-b0ba-cf4d5c0a06cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:58.391815 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dbfc1-ca7f-4993-b0ba-cf4d5c0a06cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:58.392584 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765dbfc1-ca7f-4993-b0ba-cf4d5c0a06cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:58.392891 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765dbfc1-ca7f-4993-b0ba-cf4d5c0a06cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:58.394593 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765dbfc1-ca7f-4993-b0ba-cf4d5c0a06cb admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:58.396841 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 238/472] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Feb 9 04:27:58 2022] POST /identity/v3/users => generated 248 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:27:58.415674 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 235/473] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:27:58.417143 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc082ee-918a-4851-a1d4-084b4d1b45cf admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:58.429530 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc082ee-918a-4851-a1d4-084b4d1b45cf admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:58.435037 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adaa01-3e3d-49dd-8d38-796f3a4e3b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:58.436093 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adaa01-3e3d-49dd-8d38-796f3a4e3b4c admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:58.436577 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adaa01-3e3d-49dd-8d38-796f3a4e3b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:58.437177 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adaa01-3e3d-49dd-8d38-796f3a4e3b4c admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:58.438274 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33adaa01-3e3d-49dd-8d38-796f3a4e3b4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:58.440650 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33adaa01-3e3d-49dd-8d38-796f3a4e3b4c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:58.468021 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 239/474] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Feb 9 04:27:58 2022] POST /identity/v3/users => generated 249 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:27:59.232889 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d7ab3-f75d-4529-add8-78a46e9bbeef None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:59.233431 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d7ab3-f75d-4529-add8-78a46e9bbeef None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:59.233431 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058d7ab3-f75d-4529-add8-78a46e9bbeef None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:59.235619 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 236/475] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:27:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:27:59.246442 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5a218-dad6-40d8-a2c3-99a035543809 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:59.246879 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5a218-dad6-40d8-a2c3-99a035543809 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:59.247073 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5a218-dad6-40d8-a2c3-99a035543809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:59.269511 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-7fd5a218-dad6-40d8-a2c3-99a035543809 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:27:59.270737 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7fd5a218-dad6-40d8-a2c3-99a035543809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:27:59.281752 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 240/476] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:27:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:27:59.304060 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d7ab3-f75d-4529-add8-78a46e9bbeef None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:59.316100 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058d7ab3-f75d-4529-add8-78a46e9bbeef None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:59.320293 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40808c27-2ad6-4c7b-a3cc-6bc04789b3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:59.320929 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40808c27-2ad6-4c7b-a3cc-6bc04789b3db admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:59.321247 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40808c27-2ad6-4c7b-a3cc-6bc04789b3db admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:59.321516 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40808c27-2ad6-4c7b-a3cc-6bc04789b3db admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:59.322259 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40808c27-2ad6-4c7b-a3cc-6bc04789b3db admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:59.323824 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40808c27-2ad6-4c7b-a3cc-6bc04789b3db admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:59.330545 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.sql.core [None req-40808c27-2ad6-4c7b-a3cc-6bc04789b3db admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 09 04:27:59.330545 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 09 04:27:59.330545 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [parameters: {'id': 'ab36ea93fe9849feb2682ee38dfb9aff', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 09 04:27:59.330545 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79176) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 09 04:27:59.349072 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-40808c27-2ad6-4c7b-a3cc-6bc04789b3db admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 09 04:27:59.351776 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 237/477] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:27:59 2022] POST /identity/v3/roles => generated 144 bytes in 48 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:59.358034 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5a218-dad6-40d8-a2c3-99a035543809 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:59.367228 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5a218-dad6-40d8-a2c3-99a035543809 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:59.371768 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92f868-575d-463b-8a61-6599ef11f1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:59.372594 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92f868-575d-463b-8a61-6599ef11f1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:59.372962 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92f868-575d-463b-8a61-6599ef11f1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:59.373264 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92f868-575d-463b-8a61-6599ef11f1f0 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:59.389049 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92f868-575d-463b-8a61-6599ef11f1f0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:27:59.396588 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-4b92f868-575d-463b-8a61-6599ef11f1f0 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 09 04:27:59.397872 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 241/478] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Feb 9 04:27:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:27:59.403673 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40808c27-2ad6-4c7b-a3cc-6bc04789b3db admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:27:59.418017 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40808c27-2ad6-4c7b-a3cc-6bc04789b3db admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:27:59.433656 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb246f0-671f-4e20-a512-98910705b0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:27:59.434720 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb246f0-671f-4e20-a512-98910705b0bb admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:27:59.435265 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb246f0-671f-4e20-a512-98910705b0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:27:59.436268 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb246f0-671f-4e20-a512-98910705b0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:27:59.437253 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb246f0-671f-4e20-a512-98910705b0bb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:27:59.437756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb246f0-671f-4e20-a512-98910705b0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:27:59.439552 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb246f0-671f-4e20-a512-98910705b0bb admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:27:59.455143 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 238/479] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:27:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:00.888102 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652d962-1f27-4ca7-9a0e-64779b5cc287 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:00.888633 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652d962-1f27-4ca7-9a0e-64779b5cc287 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:00.888633 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652d962-1f27-4ca7-9a0e-64779b5cc287 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:00.890699 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 242/480] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:00.895994 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bf6b3-e534-4ab9-893e-5e6c60742b95 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:00.896394 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bf6b3-e534-4ab9-893e-5e6c60742b95 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:00.896561 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bf6b3-e534-4ab9-893e-5e6c60742b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:00.916703 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03172660-25b1-49f3-858b-1f9a86d60b71 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:00.917074 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03172660-25b1-49f3-858b-1f9a86d60b71 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:00.917279 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03172660-25b1-49f3-858b-1f9a86d60b71 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:00.919325 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 243/481] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:28:00.924558 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-370bf6b3-e534-4ab9-893e-5e6c60742b95 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:00.925873 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-370bf6b3-e534-4ab9-893e-5e6c60742b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:00.926793 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba052a-c3cf-41f8-a581-cb4f1ac2ae58 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:00.927093 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba052a-c3cf-41f8-a581-cb4f1ac2ae58 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:00.927374 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba052a-c3cf-41f8-a581-cb4f1ac2ae58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:00.933837 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 239/482] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 09 04:28:00.951106 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-82ba052a-c3cf-41f8-a581-cb4f1ac2ae58 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:00.952312 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-82ba052a-c3cf-41f8-a581-cb4f1ac2ae58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:00.958079 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bf6b3-e534-4ab9-893e-5e6c60742b95 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:00.966347 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 244/483] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:28:00.967248 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bf6b3-e534-4ab9-893e-5e6c60742b95 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:00.971780 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda83ea-99dd-45a2-bc5d-54d066feb496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:00.972553 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda83ea-99dd-45a2-bc5d-54d066feb496 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:00.972831 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda83ea-99dd-45a2-bc5d-54d066feb496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:00.973135 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda83ea-99dd-45a2-bc5d-54d066feb496 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:00.984703 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda83ea-99dd-45a2-bc5d-54d066feb496 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:00.991791 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-3eda83ea-99dd-45a2-bc5d-54d066feb496 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 09 04:28:00.997334 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 240/484] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:28:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:00.999540 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba052a-c3cf-41f8-a581-cb4f1ac2ae58 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.003661 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda83ea-99dd-45a2-bc5d-54d066feb496 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.013500 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda83ea-99dd-45a2-bc5d-54d066feb496 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.018771 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba052a-c3cf-41f8-a581-cb4f1ac2ae58 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.023445 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0e61d-b5db-4d69-87ae-f135b7a17c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.024438 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0e61d-b5db-4d69-87ae-f135b7a17c2a admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.024897 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0e61d-b5db-4d69-87ae-f135b7a17c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.025374 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0e61d-b5db-4d69-87ae-f135b7a17c2a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.033626 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e433f-3964-461d-a566-ac017ce2c526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.034528 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e433f-3964-461d-a566-ac017ce2c526 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.034979 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e433f-3964-461d-a566-ac017ce2c526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.035420 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e433f-3964-461d-a566-ac017ce2c526 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.036410 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e433f-3964-461d-a566-ac017ce2c526 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:01.036886 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e433f-3964-461d-a566-ac017ce2c526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.039090 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e433f-3964-461d-a566-ac017ce2c526 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.052630 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 245/485] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Feb 9 04:28:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:01.053997 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0e61d-b5db-4d69-87ae-f135b7a17c2a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:01.055078 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e433f-3964-461d-a566-ac017ce2c526 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.060843 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-bce0e61d-b5db-4d69-87ae-f135b7a17c2a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 09 04:28:01.066477 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 241/486] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:01.074077 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0e61d-b5db-4d69-87ae-f135b7a17c2a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.074949 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e433f-3964-461d-a566-ac017ce2c526 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.087508 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0e61d-b5db-4d69-87ae-f135b7a17c2a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.093121 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b931f-16ba-4321-8397-e059c7745c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.094171 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b931f-16ba-4321-8397-e059c7745c3f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.094365 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236de86e-42cc-4c9b-8c9b-c867b2391563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.094869 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b931f-16ba-4321-8397-e059c7745c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.095253 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236de86e-42cc-4c9b-8c9b-c867b2391563 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.095544 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236de86e-42cc-4c9b-8c9b-c867b2391563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.095736 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b931f-16ba-4321-8397-e059c7745c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.095829 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236de86e-42cc-4c9b-8c9b-c867b2391563 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.096813 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b931f-16ba-4321-8397-e059c7745c3f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:01.097356 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b931f-16ba-4321-8397-e059c7745c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.099181 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b931f-16ba-4321-8397-e059c7745c3f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.110064 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 242/487] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:01.121037 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236de86e-42cc-4c9b-8c9b-c867b2391563 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.121178 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236de86e-42cc-4c9b-8c9b-c867b2391563 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.122294 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b931f-16ba-4321-8397-e059c7745c3f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.139420 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b931f-16ba-4321-8397-e059c7745c3f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.149835 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-236de86e-42cc-4c9b-8c9b-c867b2391563 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:01.153091 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eaac96-4552-47d7-939d-e14ccbef2118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.154628 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaac96-4552-47d7-939d-e14ccbef2118 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.155117 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaac96-4552-47d7-939d-e14ccbef2118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.155576 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaac96-4552-47d7-939d-e14ccbef2118 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.160213 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 246/488] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:01.173585 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eaac96-4552-47d7-939d-e14ccbef2118 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.175747 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eaac96-4552-47d7-939d-e14ccbef2118 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.177907 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236de86e-42cc-4c9b-8c9b-c867b2391563 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.189312 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236de86e-42cc-4c9b-8c9b-c867b2391563 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.207421 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-b8eaac96-4552-47d7-939d-e14ccbef2118 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:01.208366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c663d2-5bfd-42cb-9a6b-6979394b43a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.209266 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c663d2-5bfd-42cb-9a6b-6979394b43a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.209734 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c663d2-5bfd-42cb-9a6b-6979394b43a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.210174 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c663d2-5bfd-42cb-9a6b-6979394b43a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.211098 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c663d2-5bfd-42cb-9a6b-6979394b43a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:01.211570 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c663d2-5bfd-42cb-9a6b-6979394b43a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.213140 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 243/489] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:01.213779 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c663d2-5bfd-42cb-9a6b-6979394b43a4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.214451 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eaac96-4552-47d7-939d-e14ccbef2118 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.226694 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eaac96-4552-47d7-939d-e14ccbef2118 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.227930 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 247/490] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:01.233139 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93b9ce-0878-4388-9678-16ad994c35e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.233139 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93b9ce-0878-4388-9678-16ad994c35e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.233139 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93b9ce-0878-4388-9678-16ad994c35e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.233139 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93b9ce-0878-4388-9678-16ad994c35e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.233814 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93b9ce-0878-4388-9678-16ad994c35e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:01.234126 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93b9ce-0878-4388-9678-16ad994c35e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.234519 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1e082-231d-48dd-91f1-60f4cea66416 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.234995 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1e082-231d-48dd-91f1-60f4cea66416 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.235454 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1e082-231d-48dd-91f1-60f4cea66416 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.235710 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93b9ce-0878-4388-9678-16ad994c35e8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.237577 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 248/491] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:01.239604 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1e082-231d-48dd-91f1-60f4cea66416 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.252127 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1e082-231d-48dd-91f1-60f4cea66416 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.254004 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 244/492] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:01.255360 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f6c39-f029-40fa-86c5-beface52ea2e None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.255656 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f6c39-f029-40fa-86c5-beface52ea2e None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.255934 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f6c39-f029-40fa-86c5-beface52ea2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.257763 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c5f4e-73aa-4dc4-a5f4-fd38c792b3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.258753 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c5f4e-73aa-4dc4-a5f4-fd38c792b3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.259254 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c5f4e-73aa-4dc4-a5f4-fd38c792b3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.259716 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c5f4e-73aa-4dc4-a5f4-fd38c792b3e3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.267774 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c5f4e-73aa-4dc4-a5f4-fd38c792b3e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.270145 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c5f4e-73aa-4dc4-a5f4-fd38c792b3e3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.275081 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-766f6c39-f029-40fa-86c5-beface52ea2e None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:01.276294 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-766f6c39-f029-40fa-86c5-beface52ea2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:01.284836 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 245/493] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:28:01.285762 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-279c5f4e-73aa-4dc4-a5f4-fd38c792b3e3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 09 04:28:01.285869 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f6c39-f029-40fa-86c5-beface52ea2e None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.287950 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 249/494] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:01.293440 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c5f4e-73aa-4dc4-a5f4-fd38c792b3e3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.295822 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f6c39-f029-40fa-86c5-beface52ea2e None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.301237 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c0823-4cde-4725-9336-c31c362abfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.302064 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c0823-4cde-4725-9336-c31c362abfdf admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.302355 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c0823-4cde-4725-9336-c31c362abfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.302921 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c0823-4cde-4725-9336-c31c362abfdf admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.305460 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c5f4e-73aa-4dc4-a5f4-fd38c792b3e3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.310950 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4309cd-18e2-4b0f-a9be-343305ff70b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.311588 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c0823-4cde-4725-9336-c31c362abfdf admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.312184 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4309cd-18e2-4b0f-a9be-343305ff70b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.312661 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4309cd-18e2-4b0f-a9be-343305ff70b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.313255 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4309cd-18e2-4b0f-a9be-343305ff70b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.313686 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c0823-4cde-4725-9336-c31c362abfdf admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.314539 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4309cd-18e2-4b0f-a9be-343305ff70b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:01.315130 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4309cd-18e2-4b0f-a9be-343305ff70b6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.316417 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-8d4309cd-18e2-4b0f-a9be-343305ff70b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:28:01.316417 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 09 04:28:01.316417 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: Feb 09 04:28:01.318201 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4309cd-18e2-4b0f-a9be-343305ff70b6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.330890 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-3f4c0823-4cde-4725-9336-c31c362abfdf admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 09 04:28:01.332247 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 246/495] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:01.332873 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c0823-4cde-4725-9336-c31c362abfdf admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.342999 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c0823-4cde-4725-9336-c31c362abfdf admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.347567 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897d810-6fb9-4c0d-ae7f-f94cc5da9965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.348341 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897d810-6fb9-4c0d-ae7f-f94cc5da9965 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.348614 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897d810-6fb9-4c0d-ae7f-f94cc5da9965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.348882 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897d810-6fb9-4c0d-ae7f-f94cc5da9965 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.359292 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897d810-6fb9-4c0d-ae7f-f94cc5da9965 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:01.361111 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 250/496] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:01.362173 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4309cd-18e2-4b0f-a9be-343305ff70b6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.366365 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-d897d810-6fb9-4c0d-ae7f-f94cc5da9965 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 09 04:28:01.367654 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 247/497] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:01.368727 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58603516-3239-4c69-a5ee-f2d357ef1e5b None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.369033 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58603516-3239-4c69-a5ee-f2d357ef1e5b None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.369296 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58603516-3239-4c69-a5ee-f2d357ef1e5b None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.371190 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 248/498] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:01.371886 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58603516-3239-4c69-a5ee-f2d357ef1e5b None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.373936 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4309cd-18e2-4b0f-a9be-343305ff70b6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.378842 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cba5b1-16dc-450a-9200-aaac7e5566f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.379751 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cba5b1-16dc-450a-9200-aaac7e5566f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.380233 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cba5b1-16dc-450a-9200-aaac7e5566f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.380506 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cba5b1-16dc-450a-9200-aaac7e5566f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.381431 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cba5b1-16dc-450a-9200-aaac7e5566f2 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:01.381736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cba5b1-16dc-450a-9200-aaac7e5566f2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.383756 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cba5b1-16dc-450a-9200-aaac7e5566f2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.385291 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58603516-3239-4c69-a5ee-f2d357ef1e5b None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.390252 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da44b5-e24d-4697-b9a6-ccec52659712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.390791 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da44b5-e24d-4697-b9a6-ccec52659712 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.391067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da44b5-e24d-4697-b9a6-ccec52659712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.391343 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da44b5-e24d-4697-b9a6-ccec52659712 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.399536 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da44b5-e24d-4697-b9a6-ccec52659712 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.401295 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da44b5-e24d-4697-b9a6-ccec52659712 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.402954 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 251/499] 10.222.0.36 () {56 vars in 1158 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:01.404560 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ab810-70d3-4d21-95b1-26c22933c852 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.405026 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ab810-70d3-4d21-95b1-26c22933c852 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.405503 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ab810-70d3-4d21-95b1-26c22933c852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.413343 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 249/500] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:28:01.414312 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da44b5-e24d-4697-b9a6-ccec52659712 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.423975 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da44b5-e24d-4697-b9a6-ccec52659712 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.428259 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee6bae-c26d-4c01-ab1f-9ab08050df7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.428492 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-912ab810-70d3-4d21-95b1-26c22933c852 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:01.428898 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee6bae-c26d-4c01-ab1f-9ab08050df7b admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.429212 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee6bae-c26d-4c01-ab1f-9ab08050df7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.429483 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee6bae-c26d-4c01-ab1f-9ab08050df7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.429714 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-912ab810-70d3-4d21-95b1-26c22933c852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:01.430236 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee6bae-c26d-4c01-ab1f-9ab08050df7b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:01.430533 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee6bae-c26d-4c01-ab1f-9ab08050df7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.432084 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee6bae-c26d-4c01-ab1f-9ab08050df7b admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.437646 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 252/501] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:28:01.438570 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ab810-70d3-4d21-95b1-26c22933c852 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.446273 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 250/502] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:01.447334 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee6bae-c26d-4c01-ab1f-9ab08050df7b admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.447439 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ab810-70d3-4d21-95b1-26c22933c852 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.452278 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8b69d-2ddd-45eb-b6fa-0b48f17966aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.452944 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8b69d-2ddd-45eb-b6fa-0b48f17966aa admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.453272 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8b69d-2ddd-45eb-b6fa-0b48f17966aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.453543 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8b69d-2ddd-45eb-b6fa-0b48f17966aa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.461386 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8b69d-2ddd-45eb-b6fa-0b48f17966aa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.463144 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8b69d-2ddd-45eb-b6fa-0b48f17966aa admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.466332 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee6bae-c26d-4c01-ab1f-9ab08050df7b admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.471625 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626d408-0a70-4143-8e93-f3ff70374b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.472328 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 253/503] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:28:01.472958 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8b69d-2ddd-45eb-b6fa-0b48f17966aa admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.476779 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626d408-0a70-4143-8e93-f3ff70374b46 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.477203 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626d408-0a70-4143-8e93-f3ff70374b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.477518 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626d408-0a70-4143-8e93-f3ff70374b46 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.481420 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8b69d-2ddd-45eb-b6fa-0b48f17966aa admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.485946 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb99b2-48ad-4e15-8a85-d18afb0244e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.486676 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb99b2-48ad-4e15-8a85-d18afb0244e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.486951 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb99b2-48ad-4e15-8a85-d18afb0244e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.487218 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb99b2-48ad-4e15-8a85-d18afb0244e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.488948 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626d408-0a70-4143-8e93-f3ff70374b46 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.490829 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626d408-0a70-4143-8e93-f3ff70374b46 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.496947 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb99b2-48ad-4e15-8a85-d18afb0244e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.498823 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb99b2-48ad-4e15-8a85-d18afb0244e6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.506733 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-9626d408-0a70-4143-8e93-f3ff70374b46 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:01.508053 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 251/504] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:01.509801 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626d408-0a70-4143-8e93-f3ff70374b46 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.515334 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-afbb99b2-48ad-4e15-8a85-d18afb0244e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:01.516690 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 254/505] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:01.520996 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb99b2-48ad-4e15-8a85-d18afb0244e6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.523421 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626d408-0a70-4143-8e93-f3ff70374b46 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.526438 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb99b2-48ad-4e15-8a85-d18afb0244e6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.527918 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d1bdc-bc7a-4db7-998b-dd1dc3d6c6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.528764 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d1bdc-bc7a-4db7-998b-dd1dc3d6c6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.529725 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d1bdc-bc7a-4db7-998b-dd1dc3d6c6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.530094 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d1bdc-bc7a-4db7-998b-dd1dc3d6c6f5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.531235 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97899b-4c1c-41bb-8403-aa5fa619640c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.531935 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97899b-4c1c-41bb-8403-aa5fa619640c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.532216 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97899b-4c1c-41bb-8403-aa5fa619640c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.532485 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97899b-4c1c-41bb-8403-aa5fa619640c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.541384 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d1bdc-bc7a-4db7-998b-dd1dc3d6c6f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:01.542479 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97899b-4c1c-41bb-8403-aa5fa619640c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.545041 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97899b-4c1c-41bb-8403-aa5fa619640c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.549190 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-222d1bdc-bc7a-4db7-998b-dd1dc3d6c6f5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 09 04:28:01.550517 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 252/506] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:01.553799 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d1bdc-bc7a-4db7-998b-dd1dc3d6c6f5 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.562492 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-ec97899b-4c1c-41bb-8403-aa5fa619640c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:01.563904 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 255/507] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:01.564084 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d1bdc-bc7a-4db7-998b-dd1dc3d6c6f5 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.565806 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97899b-4c1c-41bb-8403-aa5fa619640c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.574938 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69b0d7-764e-4507-9f04-1da0eb65e9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.575695 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69b0d7-764e-4507-9f04-1da0eb65e9cc admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.576555 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97899b-4c1c-41bb-8403-aa5fa619640c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.576656 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69b0d7-764e-4507-9f04-1da0eb65e9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.577067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69b0d7-764e-4507-9f04-1da0eb65e9cc admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.577905 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69b0d7-764e-4507-9f04-1da0eb65e9cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:01.578316 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69b0d7-764e-4507-9f04-1da0eb65e9cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.580027 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69b0d7-764e-4507-9f04-1da0eb65e9cc admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.581253 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae8315-c815-4e08-923a-7d7dd701122c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.581927 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae8315-c815-4e08-923a-7d7dd701122c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.582257 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae8315-c815-4e08-923a-7d7dd701122c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.582534 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae8315-c815-4e08-923a-7d7dd701122c admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.583286 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae8315-c815-4e08-923a-7d7dd701122c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:01.583584 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae8315-c815-4e08-923a-7d7dd701122c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.585194 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae8315-c815-4e08-923a-7d7dd701122c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.592849 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 253/508] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:01.593644 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69b0d7-764e-4507-9f04-1da0eb65e9cc admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.601629 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 256/509] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:01.602572 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae8315-c815-4e08-923a-7d7dd701122c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.608998 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69b0d7-764e-4507-9f04-1da0eb65e9cc admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.611478 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae8315-c815-4e08-923a-7d7dd701122c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.613533 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc9e66-3969-4cc5-a9cb-ec4c5f22b215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.614174 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc9e66-3969-4cc5-a9cb-ec4c5f22b215 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.614457 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc9e66-3969-4cc5-a9cb-ec4c5f22b215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.614737 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc9e66-3969-4cc5-a9cb-ec4c5f22b215 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.615500 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc9e66-3969-4cc5-a9cb-ec4c5f22b215 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:01.615786 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc9e66-3969-4cc5-a9cb-ec4c5f22b215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.616008 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88af91-b035-4d64-a48c-49167f2ab324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.616629 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88af91-b035-4d64-a48c-49167f2ab324 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.616910 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88af91-b035-4d64-a48c-49167f2ab324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.617215 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88af91-b035-4d64-a48c-49167f2ab324 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.617405 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc9e66-3969-4cc5-a9cb-ec4c5f22b215 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.617934 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88af91-b035-4d64-a48c-49167f2ab324 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:01.618236 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88af91-b035-4d64-a48c-49167f2ab324 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.619806 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88af91-b035-4d64-a48c-49167f2ab324 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.630374 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 254/510] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:01.630374 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc9e66-3969-4cc5-a9cb-ec4c5f22b215 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.635855 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 257/511] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:01.636383 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88af91-b035-4d64-a48c-49167f2ab324 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.643983 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc9e66-3969-4cc5-a9cb-ec4c5f22b215 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.646238 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88af91-b035-4d64-a48c-49167f2ab324 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.648237 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79f304-e808-406e-9df2-f14facbdb451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.649027 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79f304-e808-406e-9df2-f14facbdb451 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.649310 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79f304-e808-406e-9df2-f14facbdb451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.649587 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79f304-e808-406e-9df2-f14facbdb451 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.650778 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a75db-bab2-4b53-80cf-dec01f99b459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.651535 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a75db-bab2-4b53-80cf-dec01f99b459 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.651812 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a75db-bab2-4b53-80cf-dec01f99b459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.652085 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a75db-bab2-4b53-80cf-dec01f99b459 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.657189 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79f304-e808-406e-9df2-f14facbdb451 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.659134 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e79f304-e808-406e-9df2-f14facbdb451 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.660087 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a75db-bab2-4b53-80cf-dec01f99b459 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.662228 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a75db-bab2-4b53-80cf-dec01f99b459 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.672673 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-0e79f304-e808-406e-9df2-f14facbdb451 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:01.678439 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 255/512] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:01.678439 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79f304-e808-406e-9df2-f14facbdb451 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.678605 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-296a75db-bab2-4b53-80cf-dec01f99b459 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 09 04:28:01.679079 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 258/513] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:01.683550 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a75db-bab2-4b53-80cf-dec01f99b459 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.689611 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79f304-e808-406e-9df2-f14facbdb451 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.692429 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a75db-bab2-4b53-80cf-dec01f99b459 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.694135 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902bc43-1759-4403-8ca0-bec0c568442d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.694907 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902bc43-1759-4403-8ca0-bec0c568442d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.695160 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902bc43-1759-4403-8ca0-bec0c568442d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.695433 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902bc43-1759-4403-8ca0-bec0c568442d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.696661 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f93089-f9bc-4bda-8024-abfe4960df67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.697442 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f93089-f9bc-4bda-8024-abfe4960df67 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.697719 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f93089-f9bc-4bda-8024-abfe4960df67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.698001 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f93089-f9bc-4bda-8024-abfe4960df67 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.705240 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f93089-f9bc-4bda-8024-abfe4960df67 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.707204 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f93089-f9bc-4bda-8024-abfe4960df67 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.710429 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902bc43-1759-4403-8ca0-bec0c568442d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.712259 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902bc43-1759-4403-8ca0-bec0c568442d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.720425 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-29f93089-f9bc-4bda-8024-abfe4960df67 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:01.721812 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 259/514] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:01.722405 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f93089-f9bc-4bda-8024-abfe4960df67 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.732120 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f93089-f9bc-4bda-8024-abfe4960df67 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.736028 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-8902bc43-1759-4403-8ca0-bec0c568442d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:01.736313 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacc109-f2a8-40bb-a532-a597164f82a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.736929 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacc109-f2a8-40bb-a532-a597164f82a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.737238 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacc109-f2a8-40bb-a532-a597164f82a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.737730 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffacc109-f2a8-40bb-a532-a597164f82a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.737832 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 256/515] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:01.738323 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffacc109-f2a8-40bb-a532-a597164f82a4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:01.738594 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffacc109-f2a8-40bb-a532-a597164f82a4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.739605 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-ffacc109-f2a8-40bb-a532-a597164f82a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:28:01.739605 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 09 04:28:01.739605 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: Feb 09 04:28:01.740730 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffacc109-f2a8-40bb-a532-a597164f82a4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.742134 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902bc43-1759-4403-8ca0-bec0c568442d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.752621 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902bc43-1759-4403-8ca0-bec0c568442d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.757210 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cd4dd-0a59-463f-bb44-f7f8e9181338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.757964 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cd4dd-0a59-463f-bb44-f7f8e9181338 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.758255 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cd4dd-0a59-463f-bb44-f7f8e9181338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.758536 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cd4dd-0a59-463f-bb44-f7f8e9181338 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.759386 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477cd4dd-0a59-463f-bb44-f7f8e9181338 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:01.759696 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477cd4dd-0a59-463f-bb44-f7f8e9181338 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.760708 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING py.warnings [None req-477cd4dd-0a59-463f-bb44-f7f8e9181338 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:28:01.760708 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: warnings.warn(msg) Feb 09 04:28:01.760708 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: Feb 09 04:28:01.761851 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477cd4dd-0a59-463f-bb44-f7f8e9181338 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.762554 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 260/516] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:01.764152 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacc109-f2a8-40bb-a532-a597164f82a4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.776908 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffacc109-f2a8-40bb-a532-a597164f82a4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.781536 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09ef54-76bb-4796-adfa-2cb5b9fe4986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.782332 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09ef54-76bb-4796-adfa-2cb5b9fe4986 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.782748 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09ef54-76bb-4796-adfa-2cb5b9fe4986 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.783153 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09ef54-76bb-4796-adfa-2cb5b9fe4986 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.784064 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09ef54-76bb-4796-adfa-2cb5b9fe4986 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:01.784519 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09ef54-76bb-4796-adfa-2cb5b9fe4986 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.786538 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09ef54-76bb-4796-adfa-2cb5b9fe4986 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.799265 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 261/517] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:01.800229 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09ef54-76bb-4796-adfa-2cb5b9fe4986 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.803497 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 257/518] 10.222.0.36 () {56 vars in 1158 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:01.804503 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cd4dd-0a59-463f-bb44-f7f8e9181338 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.811256 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09ef54-76bb-4796-adfa-2cb5b9fe4986 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.815715 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de36b09-09c4-407e-a56f-ac464ca0cc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.815958 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cd4dd-0a59-463f-bb44-f7f8e9181338 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.816354 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de36b09-09c4-407e-a56f-ac464ca0cc9a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.816634 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de36b09-09c4-407e-a56f-ac464ca0cc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.816912 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de36b09-09c4-407e-a56f-ac464ca0cc9a admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.817669 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de36b09-09c4-407e-a56f-ac464ca0cc9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:01.817974 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de36b09-09c4-407e-a56f-ac464ca0cc9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.819554 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de36b09-09c4-407e-a56f-ac464ca0cc9a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.820524 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429beb0c-f914-4002-805e-371875af0581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.821186 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429beb0c-f914-4002-805e-371875af0581 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.821469 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429beb0c-f914-4002-805e-371875af0581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.822066 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429beb0c-f914-4002-805e-371875af0581 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.822571 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429beb0c-f914-4002-805e-371875af0581 admin admin] RBAC: Adding query filter params (role.id=0f98a58e4d884f4aa616093ea30cb15e, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=63fe98c10e974c019e05a2f68d012ba8) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:01.822880 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429beb0c-f914-4002-805e-371875af0581 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.824709 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429beb0c-f914-4002-805e-371875af0581 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.830869 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 258/519] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/role_assignments?user.id=63fe98c10e974c019e05a2f68d012ba8&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=0f98a58e4d884f4aa616093ea30cb15e => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:01.836123 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 262/520] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:01.836123 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de36b09-09c4-407e-a56f-ac464ca0cc9a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.836386 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429beb0c-f914-4002-805e-371875af0581 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.849028 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de36b09-09c4-407e-a56f-ac464ca0cc9a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.850238 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429beb0c-f914-4002-805e-371875af0581 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.855069 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b5b61-b778-4d59-aac9-50814284a5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.855481 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2e8ab-37d1-4a99-82a9-b991e60513f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.855733 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b5b61-b778-4d59-aac9-50814284a5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.856014 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b5b61-b778-4d59-aac9-50814284a5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.856284 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b5b61-b778-4d59-aac9-50814284a5b5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.857120 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2e8ab-37d1-4a99-82a9-b991e60513f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.857712 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2e8ab-37d1-4a99-82a9-b991e60513f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.858248 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2e8ab-37d1-4a99-82a9-b991e60513f5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.859379 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2e8ab-37d1-4a99-82a9-b991e60513f5 admin admin] RBAC: Adding query filter params (role.id=0f98a58e4d884f4aa616093ea30cb15e, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=6940472eb8e544c8aa3409328c804282) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:01.859897 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2e8ab-37d1-4a99-82a9-b991e60513f5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.863094 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2e8ab-37d1-4a99-82a9-b991e60513f5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.865130 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b5b61-b778-4d59-aac9-50814284a5b5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.866910 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b5b61-b778-4d59-aac9-50814284a5b5 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.877279 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 263/521] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/role_assignments?user.id=6940472eb8e544c8aa3409328c804282&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=0f98a58e4d884f4aa616093ea30cb15e => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:01.877279 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2e8ab-37d1-4a99-82a9-b991e60513f5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.887807 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 259/522] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:28:01.894533 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2e8ab-37d1-4a99-82a9-b991e60513f5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.896540 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b5b61-b778-4d59-aac9-50814284a5b5 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.908765 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b5b61-b778-4d59-aac9-50814284a5b5 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:01.910892 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25e76c-f15c-4a7a-8cba-cb679a52c43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.912319 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25e76c-f15c-4a7a-8cba-cb679a52c43e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.913463 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25e76c-f15c-4a7a-8cba-cb679a52c43e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.914671 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25e76c-f15c-4a7a-8cba-cb679a52c43e admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.919846 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222c78b-45a4-4488-894d-7b2e19600892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:01.923523 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222c78b-45a4-4488-894d-7b2e19600892 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:01.923948 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222c78b-45a4-4488-894d-7b2e19600892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:01.924291 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222c78b-45a4-4488-894d-7b2e19600892 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:01.931797 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25e76c-f15c-4a7a-8cba-cb679a52c43e admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.939221 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25e76c-f15c-4a7a-8cba-cb679a52c43e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.940622 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222c78b-45a4-4488-894d-7b2e19600892 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:01.942587 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222c78b-45a4-4488-894d-7b2e19600892 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:01.966281 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-c222c78b-45a4-4488-894d-7b2e19600892 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:01.968068 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 260/523] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:01.969798 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-cc25e76c-f15c-4a7a-8cba-cb679a52c43e admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 09 04:28:01.971059 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 264/524] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:01.982253 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25e76c-f15c-4a7a-8cba-cb679a52c43e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.982487 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222c78b-45a4-4488-894d-7b2e19600892 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:01.993373 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222c78b-45a4-4488-894d-7b2e19600892 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:02.007520 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25e76c-f15c-4a7a-8cba-cb679a52c43e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:02.010937 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72bb28-edc9-480f-8474-87c3be709c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:02.011676 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72bb28-edc9-480f-8474-87c3be709c6c admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:02.011966 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72bb28-edc9-480f-8474-87c3be709c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:02.012245 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72bb28-edc9-480f-8474-87c3be709c6c admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:02.014818 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72bb28-edc9-480f-8474-87c3be709c6c admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:02.015132 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72bb28-edc9-480f-8474-87c3be709c6c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:02.017707 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72bb28-edc9-480f-8474-87c3be709c6c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:02.021581 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb86ae-13ad-4ee5-a986-3397eef08d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:02.022321 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb86ae-13ad-4ee5-a986-3397eef08d6c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:02.022604 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb86ae-13ad-4ee5-a986-3397eef08d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:02.022881 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb86ae-13ad-4ee5-a986-3397eef08d6c admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:02.023691 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb86ae-13ad-4ee5-a986-3397eef08d6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:02.023999 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb86ae-13ad-4ee5-a986-3397eef08d6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:02.026861 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb86ae-13ad-4ee5-a986-3397eef08d6c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:02.044683 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 265/525] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:02.051308 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb86ae-13ad-4ee5-a986-3397eef08d6c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:02.053485 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 261/526] 10.222.0.36 () {56 vars in 1160 bytes} [Wed Feb 9 04:28:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:02.060697 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72bb28-edc9-480f-8474-87c3be709c6c admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:02.062450 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb86ae-13ad-4ee5-a986-3397eef08d6c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:02.067569 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34375869-86e9-412f-accb-1599a8692b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:02.069073 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34375869-86e9-412f-accb-1599a8692b24 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:02.069366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34375869-86e9-412f-accb-1599a8692b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:02.069936 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34375869-86e9-412f-accb-1599a8692b24 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:02.072264 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72bb28-edc9-480f-8474-87c3be709c6c admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:02.079174 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34375869-86e9-412f-accb-1599a8692b24 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:02.081878 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c16b94-0182-4bd6-a2bc-0c235f820ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:02.082100 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34375869-86e9-412f-accb-1599a8692b24 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:02.082699 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c16b94-0182-4bd6-a2bc-0c235f820ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:02.083843 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c16b94-0182-4bd6-a2bc-0c235f820ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:02.083843 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c16b94-0182-4bd6-a2bc-0c235f820ab4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:02.092440 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c16b94-0182-4bd6-a2bc-0c235f820ab4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:02.094491 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c16b94-0182-4bd6-a2bc-0c235f820ab4 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:02.099176 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-34375869-86e9-412f-accb-1599a8692b24 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:02.100555 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 266/527] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:02.106458 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34375869-86e9-412f-accb-1599a8692b24 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:02.111788 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 262/528] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 09 04:28:02.116841 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34375869-86e9-412f-accb-1599a8692b24 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:02.117466 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c16b94-0182-4bd6-a2bc-0c235f820ab4 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:02.127136 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd23ca-3752-4bb9-8db2-362e24e6d4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:02.127136 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd23ca-3752-4bb9-8db2-362e24e6d4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:02.127136 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd23ca-3752-4bb9-8db2-362e24e6d4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:02.127136 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd23ca-3752-4bb9-8db2-362e24e6d4c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:02.127540 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd23ca-3752-4bb9-8db2-362e24e6d4c8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:02.127540 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd23ca-3752-4bb9-8db2-362e24e6d4c8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:02.128617 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c16b94-0182-4bd6-a2bc-0c235f820ab4 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:02.129035 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd23ca-3752-4bb9-8db2-362e24e6d4c8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:02.141732 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9b176-d48b-48e1-a6cc-8d0fdc3e08ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:02.142544 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9b176-d48b-48e1-a6cc-8d0fdc3e08ad admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:02.142831 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9b176-d48b-48e1-a6cc-8d0fdc3e08ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:02.143110 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9b176-d48b-48e1-a6cc-8d0fdc3e08ad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:02.143698 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 267/529] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:02.149435 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd23ca-3752-4bb9-8db2-362e24e6d4c8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:02.160347 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd23ca-3752-4bb9-8db2-362e24e6d4c8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:02.165375 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9b176-d48b-48e1-a6cc-8d0fdc3e08ad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:02.167220 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9b176-d48b-48e1-a6cc-8d0fdc3e08ad admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:02.172301 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3b4d9-6635-4e01-a844-accd7ac79f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:02.172961 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3b4d9-6635-4e01-a844-accd7ac79f08 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:02.173276 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3b4d9-6635-4e01-a844-accd7ac79f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:02.173556 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3b4d9-6635-4e01-a844-accd7ac79f08 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:02.174403 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3b4d9-6635-4e01-a844-accd7ac79f08 admin admin] RBAC: Adding query filter params (role.id=0f98a58e4d884f4aa616093ea30cb15e, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=c2856d2356604d8192c8772e33c85d7c) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:02.174723 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3b4d9-6635-4e01-a844-accd7ac79f08 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:02.176583 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3b4d9-6635-4e01-a844-accd7ac79f08 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:02.192935 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 268/530] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:28:02 2022] GET /identity/v3/role_assignments?user.id=c2856d2356604d8192c8772e33c85d7c&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=0f98a58e4d884f4aa616093ea30cb15e => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:02.197211 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-f3f9b176-d48b-48e1-a6cc-8d0fdc3e08ad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:02.198815 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 263/531] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:02.204208 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3b4d9-6635-4e01-a844-accd7ac79f08 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:02.231745 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3b4d9-6635-4e01-a844-accd7ac79f08 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:02.243569 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892ef0d-7715-4cf2-98d1-4aea7cd71f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:02.244246 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892ef0d-7715-4cf2-98d1-4aea7cd71f2c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:02.244529 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892ef0d-7715-4cf2-98d1-4aea7cd71f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:02.244802 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892ef0d-7715-4cf2-98d1-4aea7cd71f2c admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:02.245567 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892ef0d-7715-4cf2-98d1-4aea7cd71f2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:02.245872 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892ef0d-7715-4cf2-98d1-4aea7cd71f2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:02.247499 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892ef0d-7715-4cf2-98d1-4aea7cd71f2c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:02.270759 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 269/532] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:02.276072 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9b176-d48b-48e1-a6cc-8d0fdc3e08ad admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:02.290564 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9b176-d48b-48e1-a6cc-8d0fdc3e08ad admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:02.296964 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8fcc5-8456-4233-ad9f-7e578127a905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:02.297825 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8fcc5-8456-4233-ad9f-7e578127a905 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:02.298103 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8fcc5-8456-4233-ad9f-7e578127a905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:02.298378 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8fcc5-8456-4233-ad9f-7e578127a905 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:02.307880 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8fcc5-8456-4233-ad9f-7e578127a905 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:02.309915 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8fcc5-8456-4233-ad9f-7e578127a905 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:02.326323 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-0cb8fcc5-8456-4233-ad9f-7e578127a905 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:02.327859 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 264/533] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:02.333523 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892ef0d-7715-4cf2-98d1-4aea7cd71f2c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:02.344200 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892ef0d-7715-4cf2-98d1-4aea7cd71f2c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:02.349060 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971ed06-404d-4580-a04b-e9cf59b1042a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:02.349795 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971ed06-404d-4580-a04b-e9cf59b1042a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:02.350082 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971ed06-404d-4580-a04b-e9cf59b1042a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:02.350353 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971ed06-404d-4580-a04b-e9cf59b1042a admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:02.351174 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971ed06-404d-4580-a04b-e9cf59b1042a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:02.351529 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971ed06-404d-4580-a04b-e9cf59b1042a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:02.353467 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971ed06-404d-4580-a04b-e9cf59b1042a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:02.366856 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 270/534] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:02.372639 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8fcc5-8456-4233-ad9f-7e578127a905 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:02.383889 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8fcc5-8456-4233-ad9f-7e578127a905 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:02.389109 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5575ddf-a241-40bb-b8c8-eb2bd9d8ca77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:02.389803 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5575ddf-a241-40bb-b8c8-eb2bd9d8ca77 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:02.390079 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5575ddf-a241-40bb-b8c8-eb2bd9d8ca77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:02.390349 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5575ddf-a241-40bb-b8c8-eb2bd9d8ca77 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:02.391193 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5575ddf-a241-40bb-b8c8-eb2bd9d8ca77 admin admin] RBAC: Adding query filter params (role.id=0f98a58e4d884f4aa616093ea30cb15e, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=80015d086ec24caf9414d2ef5f660f08) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:02.391548 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5575ddf-a241-40bb-b8c8-eb2bd9d8ca77 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:02.393499 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5575ddf-a241-40bb-b8c8-eb2bd9d8ca77 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:02.399936 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 265/535] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:28:02 2022] GET /identity/v3/role_assignments?user.id=80015d086ec24caf9414d2ef5f660f08&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=0f98a58e4d884f4aa616093ea30cb15e => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:02.544541 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07d19a-24cb-46b3-a246-43e99f050356 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:02.544823 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07d19a-24cb-46b3-a246-43e99f050356 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:02.545119 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07d19a-24cb-46b3-a246-43e99f050356 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:02.547241 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 271/536] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:02.553363 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d394-958c-4e08-87cc-a6d1c87ac405 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:02.553651 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d394-958c-4e08-87cc-a6d1c87ac405 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:02.553928 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2d394-958c-4e08-87cc-a6d1c87ac405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:02.577936 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-4de2d394-958c-4e08-87cc-a6d1c87ac405 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:02.579134 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-4de2d394-958c-4e08-87cc-a6d1c87ac405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:02.591117 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 266/537] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:28:02.629440 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07d19a-24cb-46b3-a246-43e99f050356 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:02.643713 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07d19a-24cb-46b3-a246-43e99f050356 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:02.653260 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d8941-3e55-43c7-94dd-f832f7f974e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:02.654026 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d8941-3e55-43c7-94dd-f832f7f974e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:02.654351 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d8941-3e55-43c7-94dd-f832f7f974e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:02.654626 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d8941-3e55-43c7-94dd-f832f7f974e2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:02.668676 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d8941-3e55-43c7-94dd-f832f7f974e2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:02.670622 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d8941-3e55-43c7-94dd-f832f7f974e2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:02.690138 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-4e6d8941-3e55-43c7-94dd-f832f7f974e2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:02.691342 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 272/538] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:02.701350 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2d394-958c-4e08-87cc-a6d1c87ac405 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:02.709948 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2d394-958c-4e08-87cc-a6d1c87ac405 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:02.721677 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e8e94-c86b-4373-8b65-c554691badad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:02.722561 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e8e94-c86b-4373-8b65-c554691badad admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:02.723093 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e8e94-c86b-4373-8b65-c554691badad admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:02.723524 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e8e94-c86b-4373-8b65-c554691badad admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:02.724417 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e8e94-c86b-4373-8b65-c554691badad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:02.724871 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e8e94-c86b-4373-8b65-c554691badad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:02.726623 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e8e94-c86b-4373-8b65-c554691badad admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:02.742168 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 267/539] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:02.747375 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d8941-3e55-43c7-94dd-f832f7f974e2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:02.762246 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d8941-3e55-43c7-94dd-f832f7f974e2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:02.773034 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f615e89-d384-4385-a88d-b04d9fcfeaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:02.773714 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f615e89-d384-4385-a88d-b04d9fcfeaa1 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:02.774044 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f615e89-d384-4385-a88d-b04d9fcfeaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:02.774318 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f615e89-d384-4385-a88d-b04d9fcfeaa1 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:02.775100 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f615e89-d384-4385-a88d-b04d9fcfeaa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:02.777109 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f615e89-d384-4385-a88d-b04d9fcfeaa1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:02.808681 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 273/540] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Feb 9 04:28:02 2022] POST /identity/v3/users => generated 247 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:28:04.487417 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9ddb5-32f3-4c6d-8cd4-c0fa0ecc6f6b None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:04.487934 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9ddb5-32f3-4c6d-8cd4-c0fa0ecc6f6b None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:04.488009 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9ddb5-32f3-4c6d-8cd4-c0fa0ecc6f6b None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:04.490202 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 268/541] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:04.499527 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37a381-2439-42bb-b94b-dddd24e9b18e None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:04.499996 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37a381-2439-42bb-b94b-dddd24e9b18e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:04.500072 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37a381-2439-42bb-b94b-dddd24e9b18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:04.519971 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-dd37a381-2439-42bb-b94b-dddd24e9b18e None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:04.521194 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-dd37a381-2439-42bb-b94b-dddd24e9b18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:04.535209 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 274/542] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:28:04.560144 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9ddb5-32f3-4c6d-8cd4-c0fa0ecc6f6b None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:04.573615 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9ddb5-32f3-4c6d-8cd4-c0fa0ecc6f6b None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:04.592161 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ea255-f6eb-42d9-8b71-cf97c007a6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:04.593381 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ea255-f6eb-42d9-8b71-cf97c007a6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:04.593893 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ea255-f6eb-42d9-8b71-cf97c007a6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:04.594366 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ea255-f6eb-42d9-8b71-cf97c007a6a7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:04.603466 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3a78f-7fa6-4719-82c4-0b80b9b9d774 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:04.603798 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3a78f-7fa6-4719-82c4-0b80b9b9d774 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:04.604038 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3a78f-7fa6-4719-82c4-0b80b9b9d774 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:04.606124 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 275/543] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:04.618130 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ea255-f6eb-42d9-8b71-cf97c007a6a7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:04.625915 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-a41ea255-f6eb-42d9-8b71-cf97c007a6a7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 09 04:28:04.632003 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 269/544] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:28:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:04.634222 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3a78f-7fa6-4719-82c4-0b80b9b9d774 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:04.634824 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d2952-a59f-48ab-afb7-325730a8c180 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:04.635330 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d2952-a59f-48ab-afb7-325730a8c180 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:04.635799 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d2952-a59f-48ab-afb7-325730a8c180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:04.654126 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-299d2952-a59f-48ab-afb7-325730a8c180 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:04.655638 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-299d2952-a59f-48ab-afb7-325730a8c180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:04.656437 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3a78f-7fa6-4719-82c4-0b80b9b9d774 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:04.667053 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8313919-960a-45ef-bfb6-be87dc7e0239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:04.669147 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8313919-960a-45ef-bfb6-be87dc7e0239 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:04.670493 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8313919-960a-45ef-bfb6-be87dc7e0239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:04.670970 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8313919-960a-45ef-bfb6-be87dc7e0239 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:04.671945 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8313919-960a-45ef-bfb6-be87dc7e0239 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:04.672960 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8313919-960a-45ef-bfb6-be87dc7e0239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:04.674413 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 270/545] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:28:04.676299 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8313919-960a-45ef-bfb6-be87dc7e0239 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:04.690328 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 276/546] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Feb 9 04:28:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:04.691843 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d2952-a59f-48ab-afb7-325730a8c180 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:04.701540 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d2952-a59f-48ab-afb7-325730a8c180 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:04.706300 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76f06b-bb68-45f6-8609-aa502383aade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:04.707311 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76f06b-bb68-45f6-8609-aa502383aade admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:04.707812 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76f06b-bb68-45f6-8609-aa502383aade admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:04.708303 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76f06b-bb68-45f6-8609-aa502383aade admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:04.714226 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8313919-960a-45ef-bfb6-be87dc7e0239 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:04.729043 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76f06b-bb68-45f6-8609-aa502383aade admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:04.729247 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8313919-960a-45ef-bfb6-be87dc7e0239 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:04.729327 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b9de6-e32e-4c2b-93b6-de8e6bfc6d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:04.730209 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b9de6-e32e-4c2b-93b6-de8e6bfc6d4b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:04.730590 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b9de6-e32e-4c2b-93b6-de8e6bfc6d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:04.730884 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b9de6-e32e-4c2b-93b6-de8e6bfc6d4b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:04.732970 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b76f06b-bb68-45f6-8609-aa502383aade admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:04.744024 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b9de6-e32e-4c2b-93b6-de8e6bfc6d4b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:04.753623 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-925b9de6-e32e-4c2b-93b6-de8e6bfc6d4b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 09 04:28:04.753623 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 277/547] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:28:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:04.759373 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b9de6-e32e-4c2b-93b6-de8e6bfc6d4b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:04.762463 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-0b76f06b-bb68-45f6-8609-aa502383aade admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:04.768466 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 271/548] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:04.769941 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76f06b-bb68-45f6-8609-aa502383aade admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:04.770374 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b9de6-e32e-4c2b-93b6-de8e6bfc6d4b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:04.775063 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e9392-6f5f-4e88-a6cd-76a17ca4662d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:04.775732 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e9392-6f5f-4e88-a6cd-76a17ca4662d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:04.776004 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e9392-6f5f-4e88-a6cd-76a17ca4662d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:04.776285 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e9392-6f5f-4e88-a6cd-76a17ca4662d admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:04.777076 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e9392-6f5f-4e88-a6cd-76a17ca4662d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:04.777389 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e9392-6f5f-4e88-a6cd-76a17ca4662d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:04.779521 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e9392-6f5f-4e88-a6cd-76a17ca4662d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:04.788464 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76f06b-bb68-45f6-8609-aa502383aade admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:04.788628 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 278/549] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Feb 9 04:28:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:04.793854 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e9392-6f5f-4e88-a6cd-76a17ca4662d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:04.802672 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3378f0-6d2a-4b5b-8750-26f9900dadc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:04.803661 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3378f0-6d2a-4b5b-8750-26f9900dadc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:04.804141 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3378f0-6d2a-4b5b-8750-26f9900dadc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:04.804265 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e9392-6f5f-4e88-a6cd-76a17ca4662d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:04.804732 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3378f0-6d2a-4b5b-8750-26f9900dadc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:04.805715 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3378f0-6d2a-4b5b-8750-26f9900dadc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:04.806226 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3378f0-6d2a-4b5b-8750-26f9900dadc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:04.808033 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3378f0-6d2a-4b5b-8750-26f9900dadc2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:04.808686 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe97bb-2f4c-47a9-9843-b77e9f41a327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:04.809525 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe97bb-2f4c-47a9-9843-b77e9f41a327 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:04.809811 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe97bb-2f4c-47a9-9843-b77e9f41a327 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:04.810090 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debe97bb-2f4c-47a9-9843-b77e9f41a327 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:04.822670 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe97bb-2f4c-47a9-9843-b77e9f41a327 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:04.824055 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debe97bb-2f4c-47a9-9843-b77e9f41a327 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:04.833094 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 272/550] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:04.837991 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3378f0-6d2a-4b5b-8750-26f9900dadc2 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:04.842567 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-debe97bb-2f4c-47a9-9843-b77e9f41a327 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:04.844220 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 279/551] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:04.852587 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3378f0-6d2a-4b5b-8750-26f9900dadc2 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:04.854326 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe97bb-2f4c-47a9-9843-b77e9f41a327 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:04.858585 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc0a28-53f2-4b79-bf45-6c3ff23f5e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:04.859695 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc0a28-53f2-4b79-bf45-6c3ff23f5e2e admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:04.860184 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc0a28-53f2-4b79-bf45-6c3ff23f5e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:04.860721 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc0a28-53f2-4b79-bf45-6c3ff23f5e2e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:04.869485 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc0a28-53f2-4b79-bf45-6c3ff23f5e2e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:04.871861 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc0a28-53f2-4b79-bf45-6c3ff23f5e2e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:04.875302 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debe97bb-2f4c-47a9-9843-b77e9f41a327 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:04.886229 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-4ecc0a28-53f2-4b79-bf45-6c3ff23f5e2e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 09 04:28:04.891304 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4cd27-ef96-48bb-9a5d-2013555f35b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:04.891304 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4cd27-ef96-48bb-9a5d-2013555f35b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:04.891719 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4cd27-ef96-48bb-9a5d-2013555f35b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:04.891816 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4cd27-ef96-48bb-9a5d-2013555f35b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:04.892025 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 273/552] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Feb 9 04:28:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:04.893045 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4cd27-ef96-48bb-9a5d-2013555f35b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:04.893045 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4cd27-ef96-48bb-9a5d-2013555f35b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:04.894678 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc0a28-53f2-4b79-bf45-6c3ff23f5e2e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:04.894784 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4cd27-ef96-48bb-9a5d-2013555f35b4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:04.904988 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc0a28-53f2-4b79-bf45-6c3ff23f5e2e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:04.913669 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2fcf1-f188-488c-8d4b-bfb6b351fd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:04.914340 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2fcf1-f188-488c-8d4b-bfb6b351fd26 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:04.914628 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2fcf1-f188-488c-8d4b-bfb6b351fd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:04.914906 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2fcf1-f188-488c-8d4b-bfb6b351fd26 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:04.915567 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 280/553] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:04.921077 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2fcf1-f188-488c-8d4b-bfb6b351fd26 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:04.921407 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2fcf1-f188-488c-8d4b-bfb6b351fd26 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:04.921928 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4cd27-ef96-48bb-9a5d-2013555f35b4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:04.923397 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2fcf1-f188-488c-8d4b-bfb6b351fd26 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:04.931370 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4cd27-ef96-48bb-9a5d-2013555f35b4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:04.935955 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc9b2e-78a8-4f56-9f89-e0797fa80f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:04.936791 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc9b2e-78a8-4f56-9f89-e0797fa80f77 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:04.937102 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc9b2e-78a8-4f56-9f89-e0797fa80f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:04.937378 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc9b2e-78a8-4f56-9f89-e0797fa80f77 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:04.946387 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc9b2e-78a8-4f56-9f89-e0797fa80f77 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:04.946892 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 274/554] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Feb 9 04:28:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:04.948107 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2fcf1-f188-488c-8d4b-bfb6b351fd26 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:04.948543 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc9b2e-78a8-4f56-9f89-e0797fa80f77 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:04.957629 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2fcf1-f188-488c-8d4b-bfb6b351fd26 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:04.962875 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254be34-b088-4d11-b706-68616adf6a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:04.963646 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254be34-b088-4d11-b706-68616adf6a62 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:04.963928 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254be34-b088-4d11-b706-68616adf6a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:04.964204 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254be34-b088-4d11-b706-68616adf6a62 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:04.975164 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254be34-b088-4d11-b706-68616adf6a62 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:04.977015 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254be34-b088-4d11-b706-68616adf6a62 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:04.979123 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-4afc9b2e-78a8-4f56-9f89-e0797fa80f77 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 09 04:28:04.980637 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 281/555] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:28:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:04.988118 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc9b2e-78a8-4f56-9f89-e0797fa80f77 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:04.997977 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-5254be34-b088-4d11-b706-68616adf6a62 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:05.003508 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 275/556] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:05.004706 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254be34-b088-4d11-b706-68616adf6a62 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.006218 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc9b2e-78a8-4f56-9f89-e0797fa80f77 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.014465 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254be34-b088-4d11-b706-68616adf6a62 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.014593 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0e002-9997-4516-ab61-4c7f1e72c187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.015262 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0e002-9997-4516-ab61-4c7f1e72c187 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.015549 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0e002-9997-4516-ab61-4c7f1e72c187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.015828 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0e002-9997-4516-ab61-4c7f1e72c187 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.016679 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0e002-9997-4516-ab61-4c7f1e72c187 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:05.016982 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0e002-9997-4516-ab61-4c7f1e72c187 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.018878 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0e002-9997-4516-ab61-4c7f1e72c187 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.026164 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31a5bd-4152-451f-a316-093591ef8efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.027107 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31a5bd-4152-451f-a316-093591ef8efc admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.027637 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31a5bd-4152-451f-a316-093591ef8efc admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.027960 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31a5bd-4152-451f-a316-093591ef8efc admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.028757 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31a5bd-4152-451f-a316-093591ef8efc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:05.029631 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31a5bd-4152-451f-a316-093591ef8efc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.032238 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31a5bd-4152-451f-a316-093591ef8efc admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.039834 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 282/557] 10.222.0.36 () {56 vars in 1158 bytes} [Wed Feb 9 04:28:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:05.041402 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155866b-5fd5-48eb-9c5e-c7585cf5c05c None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.041861 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155866b-5fd5-48eb-9c5e-c7585cf5c05c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.042415 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155866b-5fd5-48eb-9c5e-c7585cf5c05c None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.045065 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 283/558] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:05.049325 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 276/559] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:05.050056 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155866b-5fd5-48eb-9c5e-c7585cf5c05c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.052161 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341050f5-ee3e-4098-ae5d-ea6c37dbb281 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.052452 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341050f5-ee3e-4098-ae5d-ea6c37dbb281 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.052728 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341050f5-ee3e-4098-ae5d-ea6c37dbb281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.063788 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155866b-5fd5-48eb-9c5e-c7585cf5c05c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.068087 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7387f7-b07e-4c34-9382-1d3aa2496858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.068853 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7387f7-b07e-4c34-9382-1d3aa2496858 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.069163 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7387f7-b07e-4c34-9382-1d3aa2496858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.069431 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7387f7-b07e-4c34-9382-1d3aa2496858 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.072893 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-341050f5-ee3e-4098-ae5d-ea6c37dbb281 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:05.074123 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-341050f5-ee3e-4098-ae5d-ea6c37dbb281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:05.079440 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7387f7-b07e-4c34-9382-1d3aa2496858 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.081299 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7387f7-b07e-4c34-9382-1d3aa2496858 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.083203 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 277/560] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:28:05.084032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341050f5-ee3e-4098-ae5d-ea6c37dbb281 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.093731 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341050f5-ee3e-4098-ae5d-ea6c37dbb281 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.099153 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b15f8-4fa2-4abc-bb6a-aa209902766e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.099901 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b15f8-4fa2-4abc-bb6a-aa209902766e admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.100184 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b15f8-4fa2-4abc-bb6a-aa209902766e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.100460 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b15f8-4fa2-4abc-bb6a-aa209902766e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.106594 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-5a7387f7-b07e-4c34-9382-1d3aa2496858 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:05.108065 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b15f8-4fa2-4abc-bb6a-aa209902766e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.108617 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 284/561] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:05.109808 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1bcaf-2fb4-485c-9445-a427e7fb1622 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.110171 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1bcaf-2fb4-485c-9445-a427e7fb1622 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.110426 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b15f8-4fa2-4abc-bb6a-aa209902766e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.110578 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1bcaf-2fb4-485c-9445-a427e7fb1622 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.113159 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 285/562] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:05.114623 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1bcaf-2fb4-485c-9445-a427e7fb1622 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.126303 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-8f9b15f8-4fa2-4abc-bb6a-aa209902766e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:05.127589 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 278/563] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:05.128294 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b15f8-4fa2-4abc-bb6a-aa209902766e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.132681 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1bcaf-2fb4-485c-9445-a427e7fb1622 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.137017 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b69e6-fc78-4735-b4c7-846c2052faa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.138845 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b69e6-fc78-4735-b4c7-846c2052faa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.138845 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b69e6-fc78-4735-b4c7-846c2052faa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.139104 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b69e6-fc78-4735-b4c7-846c2052faa4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.141995 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b15f8-4fa2-4abc-bb6a-aa209902766e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.146452 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b480a61-b00a-41ee-84d4-3e03289bec8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.147072 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b480a61-b00a-41ee-84d4-3e03289bec8b admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.147364 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b480a61-b00a-41ee-84d4-3e03289bec8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.147636 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b480a61-b00a-41ee-84d4-3e03289bec8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.148393 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b480a61-b00a-41ee-84d4-3e03289bec8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:05.148700 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b480a61-b00a-41ee-84d4-3e03289bec8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.149934 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b69e6-fc78-4735-b4c7-846c2052faa4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:05.150303 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b480a61-b00a-41ee-84d4-3e03289bec8b admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.157641 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-593b69e6-fc78-4735-b4c7-846c2052faa4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 09 04:28:05.159171 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 286/564] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:05.164112 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc3101-8417-49a9-8252-bc53ae87c141 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.164112 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc3101-8417-49a9-8252-bc53ae87c141 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.164112 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc3101-8417-49a9-8252-bc53ae87c141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.166810 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 279/565] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:05.171147 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b480a61-b00a-41ee-84d4-3e03289bec8b admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.181282 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b480a61-b00a-41ee-84d4-3e03289bec8b admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.185226 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-c0cc3101-8417-49a9-8252-bc53ae87c141 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:05.185593 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cd701-9397-41b1-94b8-36d8138468c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.186226 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cd701-9397-41b1-94b8-36d8138468c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.186509 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cd701-9397-41b1-94b8-36d8138468c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.186690 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c0cc3101-8417-49a9-8252-bc53ae87c141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:05.186843 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cd701-9397-41b1-94b8-36d8138468c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.187636 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cd701-9397-41b1-94b8-36d8138468c5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:05.187863 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cd701-9397-41b1-94b8-36d8138468c5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.188863 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING py.warnings [None req-725cd701-9397-41b1-94b8-36d8138468c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:28:05.188863 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: warnings.warn(msg) Feb 09 04:28:05.188863 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: Feb 09 04:28:05.190399 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cd701-9397-41b1-94b8-36d8138468c5 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.195185 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 287/566] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:28:05.196019 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc3101-8417-49a9-8252-bc53ae87c141 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.208993 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc3101-8417-49a9-8252-bc53ae87c141 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.214625 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8f155-dc92-4350-9037-5b718c65379f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.215463 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8f155-dc92-4350-9037-5b718c65379f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.215848 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8f155-dc92-4350-9037-5b718c65379f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.216220 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8f155-dc92-4350-9037-5b718c65379f admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.222346 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8f155-dc92-4350-9037-5b718c65379f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:05.222346 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8f155-dc92-4350-9037-5b718c65379f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.222346 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8f155-dc92-4350-9037-5b718c65379f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.223103 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 280/567] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:05.224300 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cd701-9397-41b1-94b8-36d8138468c5 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.229841 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 288/568] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:05.230696 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8f155-dc92-4350-9037-5b718c65379f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.236843 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cd701-9397-41b1-94b8-36d8138468c5 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.240494 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8f155-dc92-4350-9037-5b718c65379f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.241263 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452577ad-67a2-4688-83ee-97ef612068ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.242098 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452577ad-67a2-4688-83ee-97ef612068ec admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.242451 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452577ad-67a2-4688-83ee-97ef612068ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.242799 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452577ad-67a2-4688-83ee-97ef612068ec admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.245313 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33736a84-2bd8-49bf-a553-65fb1546a3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.246079 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33736a84-2bd8-49bf-a553-65fb1546a3be admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.246356 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33736a84-2bd8-49bf-a553-65fb1546a3be admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.246624 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33736a84-2bd8-49bf-a553-65fb1546a3be admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.250076 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452577ad-67a2-4688-83ee-97ef612068ec admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.251987 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452577ad-67a2-4688-83ee-97ef612068ec admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.256893 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33736a84-2bd8-49bf-a553-65fb1546a3be admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:05.264314 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-33736a84-2bd8-49bf-a553-65fb1546a3be admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 09 04:28:05.265392 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-452577ad-67a2-4688-83ee-97ef612068ec admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:05.265495 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 289/569] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:05.270429 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33736a84-2bd8-49bf-a553-65fb1546a3be admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.270564 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 281/570] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:05.270564 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452577ad-67a2-4688-83ee-97ef612068ec admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.277907 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452577ad-67a2-4688-83ee-97ef612068ec admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.281261 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33736a84-2bd8-49bf-a553-65fb1546a3be admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.284805 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e6617-cc91-42f5-9bfd-26e0b60f574d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.285605 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e6617-cc91-42f5-9bfd-26e0b60f574d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.285743 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4887c86-1830-4978-b85b-d7b9f7dbdf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.285890 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e6617-cc91-42f5-9bfd-26e0b60f574d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.286170 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e6617-cc91-42f5-9bfd-26e0b60f574d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.286880 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4887c86-1830-4978-b85b-d7b9f7dbdf37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.287258 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4887c86-1830-4978-b85b-d7b9f7dbdf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.287883 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4887c86-1830-4978-b85b-d7b9f7dbdf37 admin admin] PATH_INFO: `/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/63fe98c10e974c019e05a2f68d012ba8/roles/0f98a58e4d884f4aa616093ea30cb15e` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.296600 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e6617-cc91-42f5-9bfd-26e0b60f574d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.298463 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e6617-cc91-42f5-9bfd-26e0b60f574d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.304695 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4887c86-1830-4978-b85b-d7b9f7dbdf37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e618c4377ec64e2e8a6d332696019fac, user_id=63fe98c10e974c019e05a2f68d012ba8, role_id=0f98a58e4d884f4aa616093ea30cb15e)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.307389 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4887c86-1830-4978-b85b-d7b9f7dbdf37 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.315819 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-3f0e6617-cc91-42f5-9bfd-26e0b60f574d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:05.317509 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 282/571] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:05.318222 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e6617-cc91-42f5-9bfd-26e0b60f574d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.324585 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 290/572] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:28:05 2022] PUT /identity/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/63fe98c10e974c019e05a2f68d012ba8/roles/0f98a58e4d884f4aa616093ea30cb15e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:28:05.328612 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e6617-cc91-42f5-9bfd-26e0b60f574d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.330089 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4887c86-1830-4978-b85b-d7b9f7dbdf37 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.399199 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccba91d-973e-44e9-93b9-3f6c08bf7c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.400256 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccba91d-973e-44e9-93b9-3f6c08bf7c37 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.400766 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccba91d-973e-44e9-93b9-3f6c08bf7c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.401303 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccba91d-973e-44e9-93b9-3f6c08bf7c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.402294 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccba91d-973e-44e9-93b9-3f6c08bf7c37 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:05.402905 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccba91d-973e-44e9-93b9-3f6c08bf7c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.405484 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccba91d-973e-44e9-93b9-3f6c08bf7c37 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.415801 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 283/573] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:05.420665 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4887c86-1830-4978-b85b-d7b9f7dbdf37 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.420750 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccba91d-973e-44e9-93b9-3f6c08bf7c37 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.424765 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e030f-3b8e-4cfb-a57d-9e00c366a263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.425493 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e030f-3b8e-4cfb-a57d-9e00c366a263 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.425788 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e030f-3b8e-4cfb-a57d-9e00c366a263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.426063 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e030f-3b8e-4cfb-a57d-9e00c366a263 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.427160 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e030f-3b8e-4cfb-a57d-9e00c366a263 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:05.427484 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e030f-3b8e-4cfb-a57d-9e00c366a263 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.430113 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e030f-3b8e-4cfb-a57d-9e00c366a263 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.435140 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccba91d-973e-44e9-93b9-3f6c08bf7c37 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.440815 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0be3f7-a698-4f0a-a16f-de5ee902b643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.441550 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0be3f7-a698-4f0a-a16f-de5ee902b643 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.441874 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0be3f7-a698-4f0a-a16f-de5ee902b643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.442185 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0be3f7-a698-4f0a-a16f-de5ee902b643 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.443435 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0be3f7-a698-4f0a-a16f-de5ee902b643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:05.443749 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0be3f7-a698-4f0a-a16f-de5ee902b643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.445862 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0be3f7-a698-4f0a-a16f-de5ee902b643 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.446723 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 291/574] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:05.447820 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e030f-3b8e-4cfb-a57d-9e00c366a263 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.460552 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e030f-3b8e-4cfb-a57d-9e00c366a263 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.461684 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 284/575] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:05.462685 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0be3f7-a698-4f0a-a16f-de5ee902b643 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.467182 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb6a99-7adb-476e-a5df-9647f4da5f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.468275 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb6a99-7adb-476e-a5df-9647f4da5f56 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.469101 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb6a99-7adb-476e-a5df-9647f4da5f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.469584 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdb6a99-7adb-476e-a5df-9647f4da5f56 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.474809 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0be3f7-a698-4f0a-a16f-de5ee902b643 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.480065 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02981380-3cbf-4fac-b77f-c5ae41029f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.480984 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02981380-3cbf-4fac-b77f-c5ae41029f28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.481313 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02981380-3cbf-4fac-b77f-c5ae41029f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.481593 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02981380-3cbf-4fac-b77f-c5ae41029f28 admin admin] PATH_INFO: `/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/6940472eb8e544c8aa3409328c804282/roles/0f98a58e4d884f4aa616093ea30cb15e` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.485620 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb6a99-7adb-476e-a5df-9647f4da5f56 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.488685 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdb6a99-7adb-476e-a5df-9647f4da5f56 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.501672 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02981380-3cbf-4fac-b77f-c5ae41029f28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e618c4377ec64e2e8a6d332696019fac, user_id=6940472eb8e544c8aa3409328c804282, role_id=0f98a58e4d884f4aa616093ea30cb15e)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.504750 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02981380-3cbf-4fac-b77f-c5ae41029f28 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.513206 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-7cdb6a99-7adb-476e-a5df-9647f4da5f56 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:05.515738 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 292/576] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:05.516746 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb6a99-7adb-476e-a5df-9647f4da5f56 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.522739 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 285/577] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:28:05 2022] PUT /identity/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/6940472eb8e544c8aa3409328c804282/roles/0f98a58e4d884f4aa616093ea30cb15e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:28:05.529958 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02981380-3cbf-4fac-b77f-c5ae41029f28 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.531535 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdb6a99-7adb-476e-a5df-9647f4da5f56 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.627425 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02981380-3cbf-4fac-b77f-c5ae41029f28 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.633490 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fc733-36ac-41af-83bd-5cf7d8531123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.634347 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fc733-36ac-41af-83bd-5cf7d8531123 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.634628 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fc733-36ac-41af-83bd-5cf7d8531123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.634895 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fc733-36ac-41af-83bd-5cf7d8531123 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.644631 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091dc82-8e58-4046-a242-ce3fce51b37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.645277 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622fc733-36ac-41af-83bd-5cf7d8531123 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.645412 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091dc82-8e58-4046-a242-ce3fce51b37a admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.645615 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091dc82-8e58-4046-a242-ce3fce51b37a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.645899 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091dc82-8e58-4046-a242-ce3fce51b37a admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.646647 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091dc82-8e58-4046-a242-ce3fce51b37a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:05.646955 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091dc82-8e58-4046-a242-ce3fce51b37a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.647414 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622fc733-36ac-41af-83bd-5cf7d8531123 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.648768 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091dc82-8e58-4046-a242-ce3fce51b37a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.662948 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-622fc733-36ac-41af-83bd-5cf7d8531123 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 09 04:28:05.664436 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 293/578] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:05.670044 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fc733-36ac-41af-83bd-5cf7d8531123 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.670652 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 286/579] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:05.676069 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091dc82-8e58-4046-a242-ce3fce51b37a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.680742 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fc733-36ac-41af-83bd-5cf7d8531123 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.690261 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a7ff1-a938-4242-a34c-42d7b7fd8d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.691002 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a7ff1-a938-4242-a34c-42d7b7fd8d19 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.691279 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a7ff1-a938-4242-a34c-42d7b7fd8d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.691553 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a7ff1-a938-4242-a34c-42d7b7fd8d19 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.692620 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a7ff1-a938-4242-a34c-42d7b7fd8d19 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:05.694157 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a7ff1-a938-4242-a34c-42d7b7fd8d19 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.697350 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a7ff1-a938-4242-a34c-42d7b7fd8d19 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.702317 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091dc82-8e58-4046-a242-ce3fce51b37a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.711965 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6090f8-1c02-4568-854f-27ddf7b62847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.713547 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6090f8-1c02-4568-854f-27ddf7b62847 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.714087 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6090f8-1c02-4568-854f-27ddf7b62847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.714367 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6090f8-1c02-4568-854f-27ddf7b62847 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.727765 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 294/580] 10.222.0.36 () {56 vars in 1158 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:05.728321 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6090f8-1c02-4568-854f-27ddf7b62847 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.732189 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6090f8-1c02-4568-854f-27ddf7b62847 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.735167 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a7ff1-a938-4242-a34c-42d7b7fd8d19 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.746726 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a7ff1-a938-4242-a34c-42d7b7fd8d19 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.752260 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d1f90-0ff9-46f3-a5ec-f91391449aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.753307 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d1f90-0ff9-46f3-a5ec-f91391449aad admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.753772 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d1f90-0ff9-46f3-a5ec-f91391449aad admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.754201 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d1f90-0ff9-46f3-a5ec-f91391449aad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.758297 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-2f6090f8-1c02-4568-854f-27ddf7b62847 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 09 04:28:05.759972 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 287/581] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:05.768527 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6090f8-1c02-4568-854f-27ddf7b62847 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.769911 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d1f90-0ff9-46f3-a5ec-f91391449aad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.772284 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70d1f90-0ff9-46f3-a5ec-f91391449aad admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.783992 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6090f8-1c02-4568-854f-27ddf7b62847 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.790020 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2dad6-056c-4a6a-8f9b-64cdfeb61254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.790859 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2dad6-056c-4a6a-8f9b-64cdfeb61254 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.791316 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2dad6-056c-4a6a-8f9b-64cdfeb61254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.791712 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b2dad6-056c-4a6a-8f9b-64cdfeb61254 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.792793 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2dad6-056c-4a6a-8f9b-64cdfeb61254 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:05.793259 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2dad6-056c-4a6a-8f9b-64cdfeb61254 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.795411 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b2dad6-056c-4a6a-8f9b-64cdfeb61254 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.804350 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-a70d1f90-0ff9-46f3-a5ec-f91391449aad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:05.805922 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 295/582] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:05.817741 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d1f90-0ff9-46f3-a5ec-f91391449aad admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.836665 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 288/583] 10.222.0.36 () {56 vars in 1160 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:05.838910 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70d1f90-0ff9-46f3-a5ec-f91391449aad admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.842139 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2dad6-056c-4a6a-8f9b-64cdfeb61254 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.851111 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd1a9a-fcc1-4b68-9c4a-781f9544ece7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.851783 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd1a9a-fcc1-4b68-9c4a-781f9544ece7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.852069 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd1a9a-fcc1-4b68-9c4a-781f9544ece7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.852347 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd1a9a-fcc1-4b68-9c4a-781f9544ece7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.852928 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b2dad6-056c-4a6a-8f9b-64cdfeb61254 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.853115 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd1a9a-fcc1-4b68-9c4a-781f9544ece7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:05.853426 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd1a9a-fcc1-4b68-9c4a-781f9544ece7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.861078 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd1a9a-fcc1-4b68-9c4a-781f9544ece7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.865623 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fc234-29ef-4e83-a5c8-10cad1cc6874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.866408 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fc234-29ef-4e83-a5c8-10cad1cc6874 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.866691 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fc234-29ef-4e83-a5c8-10cad1cc6874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.866965 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fc234-29ef-4e83-a5c8-10cad1cc6874 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.877043 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 296/584] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:05.883791 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fc234-29ef-4e83-a5c8-10cad1cc6874 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.885858 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fc234-29ef-4e83-a5c8-10cad1cc6874 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.885972 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd1a9a-fcc1-4b68-9c4a-781f9544ece7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.897689 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd1a9a-fcc1-4b68-9c4a-781f9544ece7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.914586 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-187fc234-29ef-4e83-a5c8-10cad1cc6874 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:05.915305 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81beba11-7b11-4711-a3a7-d4e3ee3f99a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.916081 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 289/585] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:05.916416 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81beba11-7b11-4711-a3a7-d4e3ee3f99a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.916850 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81beba11-7b11-4711-a3a7-d4e3ee3f99a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.917286 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81beba11-7b11-4711-a3a7-d4e3ee3f99a2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.924343 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fc234-29ef-4e83-a5c8-10cad1cc6874 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.935962 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81beba11-7b11-4711-a3a7-d4e3ee3f99a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.938324 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81beba11-7b11-4711-a3a7-d4e3ee3f99a2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.942228 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fc234-29ef-4e83-a5c8-10cad1cc6874 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.955849 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-81beba11-7b11-4711-a3a7-d4e3ee3f99a2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:05.958891 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e9922-9f1b-45bf-a176-31f4fb2514a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:05.959697 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e9922-9f1b-45bf-a176-31f4fb2514a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:05.960113 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e9922-9f1b-45bf-a176-31f4fb2514a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:05.960542 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e9922-9f1b-45bf-a176-31f4fb2514a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:05.961438 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e9922-9f1b-45bf-a176-31f4fb2514a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:05.961873 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e9922-9f1b-45bf-a176-31f4fb2514a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:05.963570 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e9922-9f1b-45bf-a176-31f4fb2514a9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:05.977309 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 297/586] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:05.982409 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 290/587] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:05.988149 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81beba11-7b11-4711-a3a7-d4e3ee3f99a2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.988280 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e9922-9f1b-45bf-a176-31f4fb2514a9 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:05.994767 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81beba11-7b11-4711-a3a7-d4e3ee3f99a2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:05.999995 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3708f-4bbb-4404-baed-38fcc0b16c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:06.000650 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3708f-4bbb-4404-baed-38fcc0b16c38 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:06.000982 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3708f-4bbb-4404-baed-38fcc0b16c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:06.001408 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3708f-4bbb-4404-baed-38fcc0b16c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:06.002153 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3708f-4bbb-4404-baed-38fcc0b16c38 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:06.002516 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3708f-4bbb-4404-baed-38fcc0b16c38 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:06.004389 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3708f-4bbb-4404-baed-38fcc0b16c38 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:06.004503 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e9922-9f1b-45bf-a176-31f4fb2514a9 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:06.016945 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1147be1-dd99-486d-8d6e-7773eb492627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:06.019018 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1147be1-dd99-486d-8d6e-7773eb492627 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:06.019301 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1147be1-dd99-486d-8d6e-7773eb492627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:06.019580 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1147be1-dd99-486d-8d6e-7773eb492627 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:06.029398 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 298/588] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:06.031650 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1147be1-dd99-486d-8d6e-7773eb492627 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:06.033701 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1147be1-dd99-486d-8d6e-7773eb492627 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:06.035605 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3708f-4bbb-4404-baed-38fcc0b16c38 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:06.050789 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3708f-4bbb-4404-baed-38fcc0b16c38 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:06.058473 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abee58-878f-4169-ac7e-6bb22035e6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:06.061050 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abee58-878f-4169-ac7e-6bb22035e6c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:06.061343 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abee58-878f-4169-ac7e-6bb22035e6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:06.061623 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abee58-878f-4169-ac7e-6bb22035e6c9 admin admin] PATH_INFO: `/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/c2856d2356604d8192c8772e33c85d7c/roles/0f98a58e4d884f4aa616093ea30cb15e` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:06.065761 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-f1147be1-dd99-486d-8d6e-7773eb492627 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:06.067306 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 291/589] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:06.068641 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297517c4-25a8-4540-8959-79f7d39b818c None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:06.068931 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297517c4-25a8-4540-8959-79f7d39b818c None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:06.069242 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297517c4-25a8-4540-8959-79f7d39b818c None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:06.076701 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 292/590] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:06.076701 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297517c4-25a8-4540-8959-79f7d39b818c None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:06.084813 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abee58-878f-4169-ac7e-6bb22035e6c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e618c4377ec64e2e8a6d332696019fac, user_id=c2856d2356604d8192c8772e33c85d7c, role_id=0f98a58e4d884f4aa616093ea30cb15e)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:06.088576 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abee58-878f-4169-ac7e-6bb22035e6c9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:06.089927 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297517c4-25a8-4540-8959-79f7d39b818c None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:06.094769 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82535996-209d-446f-9dd6-b3fbf98b4f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:06.095518 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82535996-209d-446f-9dd6-b3fbf98b4f21 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:06.095880 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82535996-209d-446f-9dd6-b3fbf98b4f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:06.096129 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82535996-209d-446f-9dd6-b3fbf98b4f21 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:06.097067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82535996-209d-446f-9dd6-b3fbf98b4f21 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:06.097421 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82535996-209d-446f-9dd6-b3fbf98b4f21 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:06.099673 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82535996-209d-446f-9dd6-b3fbf98b4f21 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:06.112174 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 299/591] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:28:06 2022] PUT /identity/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/c2856d2356604d8192c8772e33c85d7c/roles/0f98a58e4d884f4aa616093ea30cb15e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:28:06.112811 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd04d8-2f89-46c4-b60d-e2915798c8e2 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:06.114502 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd04d8-2f89-46c4-b60d-e2915798c8e2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:06.114800 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd04d8-2f89-46c4-b60d-e2915798c8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:06.122067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 293/592] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:06.127955 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82535996-209d-446f-9dd6-b3fbf98b4f21 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:06.144582 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82535996-209d-446f-9dd6-b3fbf98b4f21 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:06.156733 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-affd04d8-2f89-46c4-b60d-e2915798c8e2 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:06.161074 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-affd04d8-2f89-46c4-b60d-e2915798c8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:06.246391 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68729ec7-fb44-47cf-96c4-635a543e2e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:06.247361 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68729ec7-fb44-47cf-96c4-635a543e2e6f admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:06.248198 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68729ec7-fb44-47cf-96c4-635a543e2e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:06.248525 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68729ec7-fb44-47cf-96c4-635a543e2e6f admin admin] PATH_INFO: `/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/80015d086ec24caf9414d2ef5f660f08/roles/0f98a58e4d884f4aa616093ea30cb15e` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:06.265141 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68729ec7-fb44-47cf-96c4-635a543e2e6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e618c4377ec64e2e8a6d332696019fac, user_id=80015d086ec24caf9414d2ef5f660f08, role_id=0f98a58e4d884f4aa616093ea30cb15e)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:06.267831 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68729ec7-fb44-47cf-96c4-635a543e2e6f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:06.285343 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 294/593] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:28:06 2022] PUT /identity/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/80015d086ec24caf9414d2ef5f660f08/roles/0f98a58e4d884f4aa616093ea30cb15e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:28:06.308134 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 300/594] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:28:06.334453 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68729ec7-fb44-47cf-96c4-635a543e2e6f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:06.407013 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68729ec7-fb44-47cf-96c4-635a543e2e6f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:06.411764 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e7cf1-8c2e-4cfd-b213-5de9df22b05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:06.412897 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e7cf1-8c2e-4cfd-b213-5de9df22b05a admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:06.413297 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e7cf1-8c2e-4cfd-b213-5de9df22b05a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:06.413580 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e7cf1-8c2e-4cfd-b213-5de9df22b05a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:06.426483 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e7cf1-8c2e-4cfd-b213-5de9df22b05a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:06.433929 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-d76e7cf1-8c2e-4cfd-b213-5de9df22b05a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 09 04:28:06.436260 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 295/595] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:28:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:06.448015 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd04d8-2f89-46c4-b60d-e2915798c8e2 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:06.461223 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd04d8-2f89-46c4-b60d-e2915798c8e2 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:06.476662 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d0a0a-1f8b-4e6b-9ee2-f7efc3b5da5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:06.477482 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d0a0a-1f8b-4e6b-9ee2-f7efc3b5da5e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:06.477835 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d0a0a-1f8b-4e6b-9ee2-f7efc3b5da5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:06.478181 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d0a0a-1f8b-4e6b-9ee2-f7efc3b5da5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:06.479057 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d0a0a-1f8b-4e6b-9ee2-f7efc3b5da5e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:06.479371 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d0a0a-1f8b-4e6b-9ee2-f7efc3b5da5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:06.481021 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d0a0a-1f8b-4e6b-9ee2-f7efc3b5da5e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:06.493689 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 301/596] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Feb 9 04:28:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:06.500932 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e7cf1-8c2e-4cfd-b213-5de9df22b05a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:06.511111 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e7cf1-8c2e-4cfd-b213-5de9df22b05a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:06.516440 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d411e5-e801-422e-b477-adc6caf68dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:06.517334 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d411e5-e801-422e-b477-adc6caf68dea admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:06.517736 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d411e5-e801-422e-b477-adc6caf68dea admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:06.518117 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d411e5-e801-422e-b477-adc6caf68dea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:06.529711 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d411e5-e801-422e-b477-adc6caf68dea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:06.531639 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d411e5-e801-422e-b477-adc6caf68dea admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:06.550849 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-59d411e5-e801-422e-b477-adc6caf68dea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:06.552394 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 296/597] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:06.557614 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d0a0a-1f8b-4e6b-9ee2-f7efc3b5da5e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:06.577574 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d0a0a-1f8b-4e6b-9ee2-f7efc3b5da5e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:06.585879 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867e40a-3290-4ae4-a59e-06d54ce50895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:06.586562 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867e40a-3290-4ae4-a59e-06d54ce50895 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:06.586844 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867e40a-3290-4ae4-a59e-06d54ce50895 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:06.587118 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9867e40a-3290-4ae4-a59e-06d54ce50895 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:06.587872 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867e40a-3290-4ae4-a59e-06d54ce50895 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:06.588179 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867e40a-3290-4ae4-a59e-06d54ce50895 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:06.590139 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9867e40a-3290-4ae4-a59e-06d54ce50895 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:06.605145 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 302/598] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:06.610189 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d411e5-e801-422e-b477-adc6caf68dea admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:06.620462 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d411e5-e801-422e-b477-adc6caf68dea admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:06.625670 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b12dc1-f382-4396-b6a2-d7b9c1cfcad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:06.626463 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b12dc1-f382-4396-b6a2-d7b9c1cfcad1 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:06.626741 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b12dc1-f382-4396-b6a2-d7b9c1cfcad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:06.627012 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b12dc1-f382-4396-b6a2-d7b9c1cfcad1 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:06.640472 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b12dc1-f382-4396-b6a2-d7b9c1cfcad1 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:06.642501 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b12dc1-f382-4396-b6a2-d7b9c1cfcad1 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:06.665242 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-57b12dc1-f382-4396-b6a2-d7b9c1cfcad1 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 09 04:28:06.666458 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 297/599] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:28:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:06.672552 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867e40a-3290-4ae4-a59e-06d54ce50895 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:06.687233 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9867e40a-3290-4ae4-a59e-06d54ce50895 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:06.701659 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ee11f-b42f-42b5-9001-7c0a5c9d5be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:06.702342 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ee11f-b42f-42b5-9001-7c0a5c9d5be1 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:06.702627 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ee11f-b42f-42b5-9001-7c0a5c9d5be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:06.702905 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ee11f-b42f-42b5-9001-7c0a5c9d5be1 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:06.703775 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ee11f-b42f-42b5-9001-7c0a5c9d5be1 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:06.704083 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ee11f-b42f-42b5-9001-7c0a5c9d5be1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:06.706024 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ee11f-b42f-42b5-9001-7c0a5c9d5be1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:06.728271 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 303/600] 10.222.0.36 () {56 vars in 1156 bytes} [Wed Feb 9 04:28:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:06.734278 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b12dc1-f382-4396-b6a2-d7b9c1cfcad1 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:06.744137 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b12dc1-f382-4396-b6a2-d7b9c1cfcad1 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:06.749134 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de27463-d834-485c-90cf-bcb0547f9891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:06.749762 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de27463-d834-485c-90cf-bcb0547f9891 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:06.750046 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de27463-d834-485c-90cf-bcb0547f9891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:06.750318 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de27463-d834-485c-90cf-bcb0547f9891 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:06.758421 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de27463-d834-485c-90cf-bcb0547f9891 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:06.760218 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de27463-d834-485c-90cf-bcb0547f9891 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:06.769552 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 298/601] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:28:06.774577 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ee11f-b42f-42b5-9001-7c0a5c9d5be1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:06.787055 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ee11f-b42f-42b5-9001-7c0a5c9d5be1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:06.797992 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4589c-cedf-418c-98ce-cf8e3ac4c81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:06.798804 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4589c-cedf-418c-98ce-cf8e3ac4c81c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:06.802952 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4589c-cedf-418c-98ce-cf8e3ac4c81c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:06.803234 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4589c-cedf-418c-98ce-cf8e3ac4c81c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:06.820545 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4589c-cedf-418c-98ce-cf8e3ac4c81c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:06.822424 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4589c-cedf-418c-98ce-cf8e3ac4c81c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:06.850959 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-25d4589c-cedf-418c-98ce-cf8e3ac4c81c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:06.852328 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 304/602] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:06.858144 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de27463-d834-485c-90cf-bcb0547f9891 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:06.869879 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de27463-d834-485c-90cf-bcb0547f9891 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:06.878976 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2e28e-feb4-4a76-ae98-50af761dcae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:06.879630 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2e28e-feb4-4a76-ae98-50af761dcae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:06.879915 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2e28e-feb4-4a76-ae98-50af761dcae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:06.880193 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2e28e-feb4-4a76-ae98-50af761dcae3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:06.880937 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2e28e-feb4-4a76-ae98-50af761dcae3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:06.881277 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2e28e-feb4-4a76-ae98-50af761dcae3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:06.882870 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2e28e-feb4-4a76-ae98-50af761dcae3 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:06.900013 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 299/603] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:06.905274 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4589c-cedf-418c-98ce-cf8e3ac4c81c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:06.915312 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4589c-cedf-418c-98ce-cf8e3ac4c81c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:06.925076 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebf4d9-5dfa-4732-aeb4-c10ead48b2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:06.925861 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebf4d9-5dfa-4732-aeb4-c10ead48b2cc admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:06.926146 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebf4d9-5dfa-4732-aeb4-c10ead48b2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:06.926424 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebf4d9-5dfa-4732-aeb4-c10ead48b2cc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:06.933511 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebf4d9-5dfa-4732-aeb4-c10ead48b2cc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:06.936046 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebf4d9-5dfa-4732-aeb4-c10ead48b2cc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:06.954172 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-beebf4d9-5dfa-4732-aeb4-c10ead48b2cc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:06.955334 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 305/604] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:06.960809 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2e28e-feb4-4a76-ae98-50af761dcae3 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:06.974496 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2e28e-feb4-4a76-ae98-50af761dcae3 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:06.985688 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8132fbf-ab7e-4ef2-9fe0-baacacc00b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:06.986339 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8132fbf-ab7e-4ef2-9fe0-baacacc00b0d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:06.986624 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8132fbf-ab7e-4ef2-9fe0-baacacc00b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:06.986903 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8132fbf-ab7e-4ef2-9fe0-baacacc00b0d admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:06.987704 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8132fbf-ab7e-4ef2-9fe0-baacacc00b0d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:06.988013 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8132fbf-ab7e-4ef2-9fe0-baacacc00b0d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:06.989892 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8132fbf-ab7e-4ef2-9fe0-baacacc00b0d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:07.006232 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 300/605] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:07.011530 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebf4d9-5dfa-4732-aeb4-c10ead48b2cc admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:07.022002 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebf4d9-5dfa-4732-aeb4-c10ead48b2cc admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:07.037935 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f7c0f-0ff3-41af-9c95-4ec9a29977bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:07.038600 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f7c0f-0ff3-41af-9c95-4ec9a29977bb admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:07.038886 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f7c0f-0ff3-41af-9c95-4ec9a29977bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:07.039169 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f7c0f-0ff3-41af-9c95-4ec9a29977bb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:07.040024 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f7c0f-0ff3-41af-9c95-4ec9a29977bb admin admin] RBAC: Adding query filter params (role.id=0f98a58e4d884f4aa616093ea30cb15e, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=66fd482451f743cdb692677e57508764) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:07.040338 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f7c0f-0ff3-41af-9c95-4ec9a29977bb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:07.042228 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f7c0f-0ff3-41af-9c95-4ec9a29977bb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:07.049156 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 306/606] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:28:07 2022] GET /identity/v3/role_assignments?user.id=66fd482451f743cdb692677e57508764&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=0f98a58e4d884f4aa616093ea30cb15e => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:07.792984 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2cdec-fc4f-4095-9f40-3d24a7ccb57b None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:07.793680 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2cdec-fc4f-4095-9f40-3d24a7ccb57b None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:07.793680 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2cdec-fc4f-4095-9f40-3d24a7ccb57b None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:07.795750 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 301/607] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:07.801125 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce312961-fead-41a3-843d-4753465fa86d None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:07.801622 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce312961-fead-41a3-843d-4753465fa86d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:07.801622 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce312961-fead-41a3-843d-4753465fa86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:07.822933 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ce312961-fead-41a3-843d-4753465fa86d None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:07.824119 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ce312961-fead-41a3-843d-4753465fa86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:07.837183 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 307/608] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:28:07.857828 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2cdec-fc4f-4095-9f40-3d24a7ccb57b None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:07.869976 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2cdec-fc4f-4095-9f40-3d24a7ccb57b None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:07.874842 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f990d50-62cf-4537-a7a5-d89c6cec1deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:07.875618 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f990d50-62cf-4537-a7a5-d89c6cec1deb admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:07.875906 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f990d50-62cf-4537-a7a5-d89c6cec1deb admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:07.876178 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f990d50-62cf-4537-a7a5-d89c6cec1deb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:07.886382 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f990d50-62cf-4537-a7a5-d89c6cec1deb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:07.893850 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-6f990d50-62cf-4537-a7a5-d89c6cec1deb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 09 04:28:07.899578 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 302/609] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:28:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:07.900886 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce312961-fead-41a3-843d-4753465fa86d None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:07.911388 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce312961-fead-41a3-843d-4753465fa86d None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:07.926136 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5d839-213b-4bfb-b25a-c7f5449f75b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:07.926807 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5d839-213b-4bfb-b25a-c7f5449f75b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:07.927091 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5d839-213b-4bfb-b25a-c7f5449f75b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:07.927367 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5d839-213b-4bfb-b25a-c7f5449f75b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:07.928135 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5d839-213b-4bfb-b25a-c7f5449f75b3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:07.928442 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5d839-213b-4bfb-b25a-c7f5449f75b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:07.930074 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5d839-213b-4bfb-b25a-c7f5449f75b3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:07.947396 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 308/610] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Feb 9 04:28:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:07.953145 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f990d50-62cf-4537-a7a5-d89c6cec1deb admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:07.971280 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f990d50-62cf-4537-a7a5-d89c6cec1deb admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:07.981143 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7a2d1-4bd2-42ae-928e-f5e448562b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:07.981955 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7a2d1-4bd2-42ae-928e-f5e448562b93 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:07.982212 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7a2d1-4bd2-42ae-928e-f5e448562b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:07.982492 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7a2d1-4bd2-42ae-928e-f5e448562b93 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:08.004614 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7a2d1-4bd2-42ae-928e-f5e448562b93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:08.006489 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7a2d1-4bd2-42ae-928e-f5e448562b93 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:08.035390 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-f9d7a2d1-4bd2-42ae-928e-f5e448562b93 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:08.041109 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 303/611] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:08.042640 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5d839-213b-4bfb-b25a-c7f5449f75b3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:08.056317 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5d839-213b-4bfb-b25a-c7f5449f75b3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:08.065620 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf34d21-a079-42f4-b1a7-c57b2b83332c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:08.066289 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf34d21-a079-42f4-b1a7-c57b2b83332c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:08.066574 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf34d21-a079-42f4-b1a7-c57b2b83332c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:08.066850 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf34d21-a079-42f4-b1a7-c57b2b83332c admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:08.067594 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf34d21-a079-42f4-b1a7-c57b2b83332c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:08.067899 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf34d21-a079-42f4-b1a7-c57b2b83332c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:08.069542 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf34d21-a079-42f4-b1a7-c57b2b83332c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:08.082380 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 309/612] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:08.088196 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7a2d1-4bd2-42ae-928e-f5e448562b93 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:08.102584 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7a2d1-4bd2-42ae-928e-f5e448562b93 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:08.112774 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745d470-0936-4256-a836-e59cc060eebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:08.113616 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745d470-0936-4256-a836-e59cc060eebd admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:08.113898 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745d470-0936-4256-a836-e59cc060eebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:08.114156 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745d470-0936-4256-a836-e59cc060eebd admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:08.126266 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745d470-0936-4256-a836-e59cc060eebd admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:08.128303 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8745d470-0936-4256-a836-e59cc060eebd admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:08.148499 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-8745d470-0936-4256-a836-e59cc060eebd admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 09 04:28:08.149795 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 304/613] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Feb 9 04:28:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:08.155447 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf34d21-a079-42f4-b1a7-c57b2b83332c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:08.166008 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf34d21-a079-42f4-b1a7-c57b2b83332c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:08.171015 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64603b4-f24b-475d-ac1f-243acbaa1c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:08.171680 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64603b4-f24b-475d-ac1f-243acbaa1c42 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:08.171964 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64603b4-f24b-475d-ac1f-243acbaa1c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:08.172241 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64603b4-f24b-475d-ac1f-243acbaa1c42 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:08.173124 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64603b4-f24b-475d-ac1f-243acbaa1c42 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:08.173435 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64603b4-f24b-475d-ac1f-243acbaa1c42 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:08.175283 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64603b4-f24b-475d-ac1f-243acbaa1c42 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:08.198137 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 310/614] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Feb 9 04:28:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:08.199471 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745d470-0936-4256-a836-e59cc060eebd admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:08.209550 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745d470-0936-4256-a836-e59cc060eebd admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:08.218153 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528bb21-42b2-43ec-bb79-18dcaba194d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:08.218849 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528bb21-42b2-43ec-bb79-18dcaba194d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:08.219129 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528bb21-42b2-43ec-bb79-18dcaba194d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:08.219404 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528bb21-42b2-43ec-bb79-18dcaba194d5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:08.233504 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528bb21-42b2-43ec-bb79-18dcaba194d5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:08.235329 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528bb21-42b2-43ec-bb79-18dcaba194d5 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:08.245974 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 305/615] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:28:08.252372 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64603b4-f24b-475d-ac1f-243acbaa1c42 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:08.263755 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64603b4-f24b-475d-ac1f-243acbaa1c42 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:08.269337 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb79a3-d2c2-4a3f-a183-47592f49891a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:08.270127 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb79a3-d2c2-4a3f-a183-47592f49891a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:08.270409 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb79a3-d2c2-4a3f-a183-47592f49891a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:08.270735 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb79a3-d2c2-4a3f-a183-47592f49891a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:08.287805 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb79a3-d2c2-4a3f-a183-47592f49891a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:08.289736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb79a3-d2c2-4a3f-a183-47592f49891a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:08.307701 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-d7bb79a3-d2c2-4a3f-a183-47592f49891a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:08.313123 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 311/616] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:08.315165 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528bb21-42b2-43ec-bb79-18dcaba194d5 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:08.324077 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528bb21-42b2-43ec-bb79-18dcaba194d5 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:08.328756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771b5d3-5602-4d9a-8e3b-70f9959547dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:08.329469 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771b5d3-5602-4d9a-8e3b-70f9959547dd admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:08.329804 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771b5d3-5602-4d9a-8e3b-70f9959547dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:08.330077 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771b5d3-5602-4d9a-8e3b-70f9959547dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:08.330808 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771b5d3-5602-4d9a-8e3b-70f9959547dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:08.331110 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771b5d3-5602-4d9a-8e3b-70f9959547dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:08.332784 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771b5d3-5602-4d9a-8e3b-70f9959547dd admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:08.348762 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 306/617] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:08.350128 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb79a3-d2c2-4a3f-a183-47592f49891a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:08.361222 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb79a3-d2c2-4a3f-a183-47592f49891a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:08.369311 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6f7fc-1282-42c9-86b6-0cfe995c59b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:08.370145 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6f7fc-1282-42c9-86b6-0cfe995c59b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:08.370426 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6f7fc-1282-42c9-86b6-0cfe995c59b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:08.370705 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6f7fc-1282-42c9-86b6-0cfe995c59b0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:08.382401 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6f7fc-1282-42c9-86b6-0cfe995c59b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:08.384542 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6f7fc-1282-42c9-86b6-0cfe995c59b0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:08.404822 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-13f6f7fc-1282-42c9-86b6-0cfe995c59b0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:08.406246 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 312/618] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:08.412215 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef9cd9-5c6b-462b-94e1-93e1dfde6e5e None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:08.412766 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef9cd9-5c6b-462b-94e1-93e1dfde6e5e None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:08.413066 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef9cd9-5c6b-462b-94e1-93e1dfde6e5e None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:08.414985 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 307/619] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:08.416202 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6f7fc-1282-42c9-86b6-0cfe995c59b0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:08.422836 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a5f1f-df1c-469a-8b30-09078f3eca57 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:08.422836 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a5f1f-df1c-469a-8b30-09078f3eca57 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:08.422836 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a5f1f-df1c-469a-8b30-09078f3eca57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:08.427487 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6f7fc-1282-42c9-86b6-0cfe995c59b0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:08.443674 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d567f-9a6d-4c51-a41b-7b74b1a70617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:08.444376 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d567f-9a6d-4c51-a41b-7b74b1a70617 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:08.444656 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d567f-9a6d-4c51-a41b-7b74b1a70617 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:08.444981 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d567f-9a6d-4c51-a41b-7b74b1a70617 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:08.445812 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d567f-9a6d-4c51-a41b-7b74b1a70617 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:08.446166 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d567f-9a6d-4c51-a41b-7b74b1a70617 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:08.450540 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d567f-9a6d-4c51-a41b-7b74b1a70617 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:08.460284 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-748a5f1f-df1c-469a-8b30-09078f3eca57 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:08.461525 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-748a5f1f-df1c-469a-8b30-09078f3eca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:08.470437 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 313/620] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:08.476833 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d567f-9a6d-4c51-a41b-7b74b1a70617 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:08.477420 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 308/621] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:28:08.491303 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d567f-9a6d-4c51-a41b-7b74b1a70617 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:08.496065 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a823b-53cf-41c9-a720-2c0eed42d1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:08.496846 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a823b-53cf-41c9-a720-2c0eed42d1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:08.497170 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a823b-53cf-41c9-a720-2c0eed42d1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:08.497497 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a823b-53cf-41c9-a720-2c0eed42d1e0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:08.498880 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a823b-53cf-41c9-a720-2c0eed42d1e0 admin admin] RBAC: Adding query filter params (role.id=0f98a58e4d884f4aa616093ea30cb15e, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=63fe98c10e974c019e05a2f68d012ba8) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:08.499250 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a823b-53cf-41c9-a720-2c0eed42d1e0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:08.501374 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a823b-53cf-41c9-a720-2c0eed42d1e0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:08.513062 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a5f1f-df1c-469a-8b30-09078f3eca57 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:08.517414 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 314/622] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:28:08 2022] GET /identity/v3/role_assignments?user.id=63fe98c10e974c019e05a2f68d012ba8&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=0f98a58e4d884f4aa616093ea30cb15e => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:08.524995 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a5f1f-df1c-469a-8b30-09078f3eca57 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:08.531221 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ff820-e459-4c65-8400-071b2348765f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:08.532070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ff820-e459-4c65-8400-071b2348765f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:08.532354 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ff820-e459-4c65-8400-071b2348765f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:08.532635 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ff820-e459-4c65-8400-071b2348765f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:08.549385 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ff820-e459-4c65-8400-071b2348765f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:08.556891 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-df1ff820-e459-4c65-8400-071b2348765f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 09 04:28:08.558641 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 309/623] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:28:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:08.566558 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a823b-53cf-41c9-a720-2c0eed42d1e0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:08.581126 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a823b-53cf-41c9-a720-2c0eed42d1e0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:08.587802 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd3e21-ff23-450a-97c8-c2a683993e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:08.588594 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd3e21-ff23-450a-97c8-c2a683993e95 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:08.588931 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd3e21-ff23-450a-97c8-c2a683993e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:08.589232 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd3e21-ff23-450a-97c8-c2a683993e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:08.590073 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd3e21-ff23-450a-97c8-c2a683993e95 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:08.590383 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd3e21-ff23-450a-97c8-c2a683993e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:08.592701 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd3e21-ff23-450a-97c8-c2a683993e95 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:08.603058 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 315/624] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Feb 9 04:28:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:08.609802 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ff820-e459-4c65-8400-071b2348765f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:08.622412 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ff820-e459-4c65-8400-071b2348765f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:08.632210 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149f695-af52-4efb-a03b-16e72be91b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:08.633094 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149f695-af52-4efb-a03b-16e72be91b90 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:08.633423 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149f695-af52-4efb-a03b-16e72be91b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:08.633749 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149f695-af52-4efb-a03b-16e72be91b90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:08.648772 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149f695-af52-4efb-a03b-16e72be91b90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:08.650800 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149f695-af52-4efb-a03b-16e72be91b90 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:08.673659 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-0149f695-af52-4efb-a03b-16e72be91b90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:08.675002 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 310/625] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:08.680665 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd3e21-ff23-450a-97c8-c2a683993e95 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:08.691286 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd3e21-ff23-450a-97c8-c2a683993e95 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:08.696535 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52266897-4c62-4371-a196-1231c88d8875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:08.697291 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52266897-4c62-4371-a196-1231c88d8875 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:08.697646 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52266897-4c62-4371-a196-1231c88d8875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:08.697850 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52266897-4c62-4371-a196-1231c88d8875 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:08.698716 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52266897-4c62-4371-a196-1231c88d8875 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:08.699138 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52266897-4c62-4371-a196-1231c88d8875 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:08.700887 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52266897-4c62-4371-a196-1231c88d8875 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:08.717113 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 316/626] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:08.720739 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149f695-af52-4efb-a03b-16e72be91b90 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:08.731101 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149f695-af52-4efb-a03b-16e72be91b90 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:08.736450 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d78275-40be-4029-8ed4-ed90bfa510c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:08.737334 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d78275-40be-4029-8ed4-ed90bfa510c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:08.737617 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d78275-40be-4029-8ed4-ed90bfa510c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:08.737946 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d78275-40be-4029-8ed4-ed90bfa510c8 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:08.746772 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d78275-40be-4029-8ed4-ed90bfa510c8 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:08.748922 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d78275-40be-4029-8ed4-ed90bfa510c8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:08.764155 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-30d78275-40be-4029-8ed4-ed90bfa510c8 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 09 04:28:08.769153 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 311/627] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:28:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:08.771327 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52266897-4c62-4371-a196-1231c88d8875 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:08.782091 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52266897-4c62-4371-a196-1231c88d8875 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:08.786819 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423d90c-5860-4146-a226-d9328e9ac868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:08.787830 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423d90c-5860-4146-a226-d9328e9ac868 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:08.788152 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423d90c-5860-4146-a226-d9328e9ac868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:08.788438 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423d90c-5860-4146-a226-d9328e9ac868 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:08.789377 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423d90c-5860-4146-a226-d9328e9ac868 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:08.789685 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423d90c-5860-4146-a226-d9328e9ac868 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:08.791634 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423d90c-5860-4146-a226-d9328e9ac868 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:08.815766 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 317/628] 10.222.0.36 () {56 vars in 1158 bytes} [Wed Feb 9 04:28:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:08.819032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d78275-40be-4029-8ed4-ed90bfa510c8 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:08.830297 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d78275-40be-4029-8ed4-ed90bfa510c8 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:08.835001 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d9ea0-2186-4ff8-be1b-31cec23d0444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:08.835652 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d9ea0-2186-4ff8-be1b-31cec23d0444 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:08.836027 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d9ea0-2186-4ff8-be1b-31cec23d0444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:08.836347 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d9ea0-2186-4ff8-be1b-31cec23d0444 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:08.845938 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d9ea0-2186-4ff8-be1b-31cec23d0444 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:08.847738 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d9ea0-2186-4ff8-be1b-31cec23d0444 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:08.862104 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 312/629] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:28:08.865229 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423d90c-5860-4146-a226-d9328e9ac868 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:08.875164 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423d90c-5860-4146-a226-d9328e9ac868 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:08.879812 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fa8ed-2639-4e72-98a4-1d4dcc5084ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:08.880645 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fa8ed-2639-4e72-98a4-1d4dcc5084ad admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:08.880975 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fa8ed-2639-4e72-98a4-1d4dcc5084ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:08.881333 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fa8ed-2639-4e72-98a4-1d4dcc5084ad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:08.892633 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fa8ed-2639-4e72-98a4-1d4dcc5084ad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:08.894533 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365fa8ed-2639-4e72-98a4-1d4dcc5084ad admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:08.913458 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-365fa8ed-2639-4e72-98a4-1d4dcc5084ad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:08.920019 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 318/630] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:08.921484 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d9ea0-2186-4ff8-be1b-31cec23d0444 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:08.930953 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d9ea0-2186-4ff8-be1b-31cec23d0444 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:08.936405 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab21d8-ed39-4ecb-8fbf-6b2a6d2fb297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:08.937173 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab21d8-ed39-4ecb-8fbf-6b2a6d2fb297 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:08.937508 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab21d8-ed39-4ecb-8fbf-6b2a6d2fb297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:08.937783 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab21d8-ed39-4ecb-8fbf-6b2a6d2fb297 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:08.938583 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab21d8-ed39-4ecb-8fbf-6b2a6d2fb297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:08.938890 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab21d8-ed39-4ecb-8fbf-6b2a6d2fb297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:08.940549 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab21d8-ed39-4ecb-8fbf-6b2a6d2fb297 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:08.957137 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 313/631] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:08.959353 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fa8ed-2639-4e72-98a4-1d4dcc5084ad admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:08.969700 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fa8ed-2639-4e72-98a4-1d4dcc5084ad admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:08.974331 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79a595-6114-495f-860b-1ebe22961799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:08.975159 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79a595-6114-495f-860b-1ebe22961799 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:08.975445 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79a595-6114-495f-860b-1ebe22961799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:08.975776 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f79a595-6114-495f-860b-1ebe22961799 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:08.983800 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79a595-6114-495f-860b-1ebe22961799 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:08.985870 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f79a595-6114-495f-860b-1ebe22961799 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.000030 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-8f79a595-6114-495f-860b-1ebe22961799 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:09.004064 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 319/632] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:09.007314 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab21d8-ed39-4ecb-8fbf-6b2a6d2fb297 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.017323 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab21d8-ed39-4ecb-8fbf-6b2a6d2fb297 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.021870 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d39d24-a97b-49bb-855b-4be90fba616d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.022567 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d39d24-a97b-49bb-855b-4be90fba616d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.022849 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d39d24-a97b-49bb-855b-4be90fba616d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.023129 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d39d24-a97b-49bb-855b-4be90fba616d admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.024072 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d39d24-a97b-49bb-855b-4be90fba616d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:09.024384 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d39d24-a97b-49bb-855b-4be90fba616d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.026311 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d39d24-a97b-49bb-855b-4be90fba616d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.042810 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 314/633] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:09.047254 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79a595-6114-495f-860b-1ebe22961799 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.059168 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f79a595-6114-495f-860b-1ebe22961799 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.064490 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753ef0f-0d11-468a-985a-e07cf7a10d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.065286 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753ef0f-0d11-468a-985a-e07cf7a10d5c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.065506 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753ef0f-0d11-468a-985a-e07cf7a10d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.065830 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753ef0f-0d11-468a-985a-e07cf7a10d5c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.066692 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753ef0f-0d11-468a-985a-e07cf7a10d5c admin admin] RBAC: Adding query filter params (role.id=0f98a58e4d884f4aa616093ea30cb15e, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=6940472eb8e544c8aa3409328c804282) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:09.066997 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753ef0f-0d11-468a-985a-e07cf7a10d5c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.068911 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753ef0f-0d11-468a-985a-e07cf7a10d5c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.081201 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 320/634] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/role_assignments?user.id=6940472eb8e544c8aa3409328c804282&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=0f98a58e4d884f4aa616093ea30cb15e => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:09.100702 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca7b25-2f32-4e9d-a0a1-9c2ee94a2b7a None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.101075 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca7b25-2f32-4e9d-a0a1-9c2ee94a2b7a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.101285 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca7b25-2f32-4e9d-a0a1-9c2ee94a2b7a None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.103751 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 315/635] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:09.109887 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a377ac1-0639-4797-8ba4-5fa18c9e1d63 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.110192 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a377ac1-0639-4797-8ba4-5fa18c9e1d63 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.110436 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a377ac1-0639-4797-8ba4-5fa18c9e1d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.130501 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-6a377ac1-0639-4797-8ba4-5fa18c9e1d63 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:09.131724 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6a377ac1-0639-4797-8ba4-5fa18c9e1d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:09.140108 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 321/636] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:28:09.164377 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca7b25-2f32-4e9d-a0a1-9c2ee94a2b7a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.178622 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca7b25-2f32-4e9d-a0a1-9c2ee94a2b7a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.183551 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3928661-0dd0-4486-be25-bb69ff35da7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.184495 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3928661-0dd0-4486-be25-bb69ff35da7e admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.184783 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3928661-0dd0-4486-be25-bb69ff35da7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.185711 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3928661-0dd0-4486-be25-bb69ff35da7e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.199112 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3928661-0dd0-4486-be25-bb69ff35da7e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:09.206621 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-e3928661-0dd0-4486-be25-bb69ff35da7e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 09 04:28:09.208271 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 316/637] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:09.213139 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e3521-e1d6-400b-83a7-4712654b31e2 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.213431 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e3521-e1d6-400b-83a7-4712654b31e2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.213756 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e3521-e1d6-400b-83a7-4712654b31e2 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.215886 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 322/638] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:09.216617 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3928661-0dd0-4486-be25-bb69ff35da7e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.223154 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf0643-f9b3-4d6c-8f33-f03b2b5839a1 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.223469 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf0643-f9b3-4d6c-8f33-f03b2b5839a1 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.223711 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf0643-f9b3-4d6c-8f33-f03b2b5839a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.231126 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3928661-0dd0-4486-be25-bb69ff35da7e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.238766 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c787c-d2e8-444e-aa91-9b32668cc0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.239861 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c787c-d2e8-444e-aa91-9b32668cc0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.240375 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c787c-d2e8-444e-aa91-9b32668cc0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.240715 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c787c-d2e8-444e-aa91-9b32668cc0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.241618 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c787c-d2e8-444e-aa91-9b32668cc0f3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:09.241930 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c787c-d2e8-444e-aa91-9b32668cc0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.243657 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c787c-d2e8-444e-aa91-9b32668cc0f3 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.247245 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-90bf0643-f9b3-4d6c-8f33-f03b2b5839a1 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:09.248934 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-90bf0643-f9b3-4d6c-8f33-f03b2b5839a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:09.258829 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 317/639] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:09.260102 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c787c-d2e8-444e-aa91-9b32668cc0f3 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.266238 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 323/640] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:28:09.270475 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c787c-d2e8-444e-aa91-9b32668cc0f3 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.274999 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1b374-6e4d-4cf4-939a-cd83150c7266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.275785 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1b374-6e4d-4cf4-939a-cd83150c7266 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.276068 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1b374-6e4d-4cf4-939a-cd83150c7266 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.276345 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1b374-6e4d-4cf4-939a-cd83150c7266 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.288607 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1b374-6e4d-4cf4-939a-cd83150c7266 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.293027 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1b374-6e4d-4cf4-939a-cd83150c7266 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.297365 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf0643-f9b3-4d6c-8f33-f03b2b5839a1 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.307087 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf0643-f9b3-4d6c-8f33-f03b2b5839a1 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.312145 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0bced-9d48-4835-928a-807382d79b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.312921 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0bced-9d48-4835-928a-807382d79b22 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.313238 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0bced-9d48-4835-928a-807382d79b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.313510 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0bced-9d48-4835-928a-807382d79b22 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.315076 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-61a1b374-6e4d-4cf4-939a-cd83150c7266 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:09.316670 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 318/641] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:09.322167 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1b374-6e4d-4cf4-939a-cd83150c7266 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.325234 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0bced-9d48-4835-928a-807382d79b22 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:09.333049 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1b374-6e4d-4cf4-939a-cd83150c7266 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.334784 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-5bd0bced-9d48-4835-928a-807382d79b22 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 09 04:28:09.337087 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 324/642] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:09.342739 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0bced-9d48-4835-928a-807382d79b22 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.346348 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a55b6-91ca-4799-97f4-011b046e9f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.347289 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a55b6-91ca-4799-97f4-011b046e9f91 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.347800 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a55b6-91ca-4799-97f4-011b046e9f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.348269 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a55b6-91ca-4799-97f4-011b046e9f91 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.349429 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a55b6-91ca-4799-97f4-011b046e9f91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:09.349807 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a55b6-91ca-4799-97f4-011b046e9f91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.351982 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a55b6-91ca-4799-97f4-011b046e9f91 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.354394 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0bced-9d48-4835-928a-807382d79b22 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.359539 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cccd501-7b32-4057-919a-e205df56c06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.360893 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccd501-7b32-4057-919a-e205df56c06f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.361389 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccd501-7b32-4057-919a-e205df56c06f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.361834 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccd501-7b32-4057-919a-e205df56c06f admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.363661 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cccd501-7b32-4057-919a-e205df56c06f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:09.364162 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cccd501-7b32-4057-919a-e205df56c06f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.365882 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 319/643] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:09.366135 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cccd501-7b32-4057-919a-e205df56c06f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.371129 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a55b6-91ca-4799-97f4-011b046e9f91 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.380460 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 325/644] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:09.381598 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a55b6-91ca-4799-97f4-011b046e9f91 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.387492 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cccd501-7b32-4057-919a-e205df56c06f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.391444 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1315f88-b88a-4dd7-b316-31354b92d852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.392337 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1315f88-b88a-4dd7-b316-31354b92d852 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.392678 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1315f88-b88a-4dd7-b316-31354b92d852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.393070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1315f88-b88a-4dd7-b316-31354b92d852 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.401444 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cccd501-7b32-4057-919a-e205df56c06f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.402263 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1315f88-b88a-4dd7-b316-31354b92d852 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.404825 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1315f88-b88a-4dd7-b316-31354b92d852 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.406638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfa5fc-828a-4ca6-a61d-5930b1165f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.407877 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfa5fc-828a-4ca6-a61d-5930b1165f44 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.408893 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfa5fc-828a-4ca6-a61d-5930b1165f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.409368 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfa5fc-828a-4ca6-a61d-5930b1165f44 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.420113 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-b1315f88-b88a-4dd7-b316-31354b92d852 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 09 04:28:09.421720 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 320/645] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:09.422173 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfa5fc-828a-4ca6-a61d-5930b1165f44 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.424322 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abfa5fc-828a-4ca6-a61d-5930b1165f44 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.427014 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1315f88-b88a-4dd7-b316-31354b92d852 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.438017 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1315f88-b88a-4dd7-b316-31354b92d852 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.442520 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c62476-5bb4-4bed-822c-cc5394662a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.443374 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c62476-5bb4-4bed-822c-cc5394662a55 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.443921 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c62476-5bb4-4bed-822c-cc5394662a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.444454 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c62476-5bb4-4bed-822c-cc5394662a55 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.445669 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c62476-5bb4-4bed-822c-cc5394662a55 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:09.446044 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c62476-5bb4-4bed-822c-cc5394662a55 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.446236 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-4abfa5fc-828a-4ca6-a61d-5930b1165f44 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:09.448000 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 326/646] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:09.452816 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c62476-5bb4-4bed-822c-cc5394662a55 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.453742 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfa5fc-828a-4ca6-a61d-5930b1165f44 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.466329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfa5fc-828a-4ca6-a61d-5930b1165f44 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.471547 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 321/647] 10.222.0.36 () {56 vars in 1160 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:09.472598 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05606fad-b44b-49ce-96db-78d27fe0ee51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.473559 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05606fad-b44b-49ce-96db-78d27fe0ee51 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.474036 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05606fad-b44b-49ce-96db-78d27fe0ee51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.474548 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05606fad-b44b-49ce-96db-78d27fe0ee51 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.475499 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05606fad-b44b-49ce-96db-78d27fe0ee51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:09.476064 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05606fad-b44b-49ce-96db-78d27fe0ee51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.476781 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c62476-5bb4-4bed-822c-cc5394662a55 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.478372 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05606fad-b44b-49ce-96db-78d27fe0ee51 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.486739 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c62476-5bb4-4bed-822c-cc5394662a55 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.492081 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f56a9-c7cd-4f48-a585-a3dd68c10f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.492720 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f56a9-c7cd-4f48-a585-a3dd68c10f30 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.493021 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f56a9-c7cd-4f48-a585-a3dd68c10f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.493294 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f56a9-c7cd-4f48-a585-a3dd68c10f30 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.493592 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 327/648] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:09.499647 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05606fad-b44b-49ce-96db-78d27fe0ee51 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.506422 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f56a9-c7cd-4f48-a585-a3dd68c10f30 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.508182 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f56a9-c7cd-4f48-a585-a3dd68c10f30 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.511337 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05606fad-b44b-49ce-96db-78d27fe0ee51 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.518423 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973c0a5-a917-4cce-8b15-634e428bbb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.519567 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973c0a5-a917-4cce-8b15-634e428bbb7d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.520043 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973c0a5-a917-4cce-8b15-634e428bbb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.520538 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973c0a5-a917-4cce-8b15-634e428bbb7d admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.522776 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 322/649] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 09 04:28:09.523662 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f56a9-c7cd-4f48-a585-a3dd68c10f30 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.530839 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973c0a5-a917-4cce-8b15-634e428bbb7d admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.532077 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f56a9-c7cd-4f48-a585-a3dd68c10f30 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.533660 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973c0a5-a917-4cce-8b15-634e428bbb7d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.536563 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ac8e4-46a9-48be-905c-8e67df966668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.537622 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ac8e4-46a9-48be-905c-8e67df966668 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.537904 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ac8e4-46a9-48be-905c-8e67df966668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.538170 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ac8e4-46a9-48be-905c-8e67df966668 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.550243 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ac8e4-46a9-48be-905c-8e67df966668 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.552058 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ac8e4-46a9-48be-905c-8e67df966668 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.558165 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-1973c0a5-a917-4cce-8b15-634e428bbb7d admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 09 04:28:09.560633 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 328/650] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:09.567516 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973c0a5-a917-4cce-8b15-634e428bbb7d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.577620 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973c0a5-a917-4cce-8b15-634e428bbb7d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.582011 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf97546-4d35-465b-9f5b-36bee8454501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.582661 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf97546-4d35-465b-9f5b-36bee8454501 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.582941 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf97546-4d35-465b-9f5b-36bee8454501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.583214 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf97546-4d35-465b-9f5b-36bee8454501 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.583763 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-9e8ac8e4-46a9-48be-905c-8e67df966668 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:09.584055 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf97546-4d35-465b-9f5b-36bee8454501 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:09.584359 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf97546-4d35-465b-9f5b-36bee8454501 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.585666 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 323/651] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:09.587116 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf97546-4d35-465b-9f5b-36bee8454501 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.594036 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ac8e4-46a9-48be-905c-8e67df966668 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.607019 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 329/652] 10.222.0.36 () {56 vars in 1158 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:09.609664 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ac8e4-46a9-48be-905c-8e67df966668 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.613336 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf97546-4d35-465b-9f5b-36bee8454501 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.621180 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157beaf0-f153-4c89-aefb-42ad41017ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.621868 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157beaf0-f153-4c89-aefb-42ad41017ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.622147 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157beaf0-f153-4c89-aefb-42ad41017ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.622964 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157beaf0-f153-4c89-aefb-42ad41017ae8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.624043 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157beaf0-f153-4c89-aefb-42ad41017ae8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:09.624353 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157beaf0-f153-4c89-aefb-42ad41017ae8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.626050 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157beaf0-f153-4c89-aefb-42ad41017ae8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.626727 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf97546-4d35-465b-9f5b-36bee8454501 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.632039 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08386434-a41b-4be5-b6fa-e3512c86d855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.633143 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08386434-a41b-4be5-b6fa-e3512c86d855 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.633877 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08386434-a41b-4be5-b6fa-e3512c86d855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.634429 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08386434-a41b-4be5-b6fa-e3512c86d855 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.640060 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 324/653] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:09.645644 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157beaf0-f153-4c89-aefb-42ad41017ae8 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.649119 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08386434-a41b-4be5-b6fa-e3512c86d855 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.651091 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08386434-a41b-4be5-b6fa-e3512c86d855 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.659107 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157beaf0-f153-4c89-aefb-42ad41017ae8 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.661105 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 330/654] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:28:09.666401 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08386434-a41b-4be5-b6fa-e3512c86d855 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.668120 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6362b25-b86f-46c2-a1a2-60b9cf313704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.669146 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6362b25-b86f-46c2-a1a2-60b9cf313704 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.670199 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6362b25-b86f-46c2-a1a2-60b9cf313704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.670675 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6362b25-b86f-46c2-a1a2-60b9cf313704 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.676536 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08386434-a41b-4be5-b6fa-e3512c86d855 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.679393 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6362b25-b86f-46c2-a1a2-60b9cf313704 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.681410 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85cbe3-b7b5-442e-9bc0-4b97069dd92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.682227 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85cbe3-b7b5-442e-9bc0-4b97069dd92a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.682509 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85cbe3-b7b5-442e-9bc0-4b97069dd92a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.682781 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85cbe3-b7b5-442e-9bc0-4b97069dd92a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.682878 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6362b25-b86f-46c2-a1a2-60b9cf313704 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.696017 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85cbe3-b7b5-442e-9bc0-4b97069dd92a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.697868 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85cbe3-b7b5-442e-9bc0-4b97069dd92a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.699939 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-a6362b25-b86f-46c2-a1a2-60b9cf313704 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:09.701690 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 325/655] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:09.709857 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6362b25-b86f-46c2-a1a2-60b9cf313704 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.721231 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6362b25-b86f-46c2-a1a2-60b9cf313704 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.724685 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-5d85cbe3-b7b5-442e-9bc0-4b97069dd92a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:09.725955 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 331/656] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:09.726684 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe0e6a-d2ad-44f8-be97-0ef36008be23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.727575 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe0e6a-d2ad-44f8-be97-0ef36008be23 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.728094 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe0e6a-d2ad-44f8-be97-0ef36008be23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.728555 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe0e6a-d2ad-44f8-be97-0ef36008be23 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.729646 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe0e6a-d2ad-44f8-be97-0ef36008be23 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:09.730143 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe0e6a-d2ad-44f8-be97-0ef36008be23 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.731111 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85cbe3-b7b5-442e-9bc0-4b97069dd92a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.733131 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe0e6a-d2ad-44f8-be97-0ef36008be23 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.742621 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85cbe3-b7b5-442e-9bc0-4b97069dd92a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.748486 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f66d1-37a4-4b18-8c99-65221083a459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.748764 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 326/657] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:09.749167 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f66d1-37a4-4b18-8c99-65221083a459 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.749442 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f66d1-37a4-4b18-8c99-65221083a459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.749703 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f66d1-37a4-4b18-8c99-65221083a459 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.750446 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f66d1-37a4-4b18-8c99-65221083a459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:09.750745 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f66d1-37a4-4b18-8c99-65221083a459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.752336 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f66d1-37a4-4b18-8c99-65221083a459 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.758800 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe0e6a-d2ad-44f8-be97-0ef36008be23 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.769929 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 332/658] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:09.771094 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe0e6a-d2ad-44f8-be97-0ef36008be23 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.775113 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f66d1-37a4-4b18-8c99-65221083a459 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.777397 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a971e-7169-48fe-969f-1739ab2345bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.778329 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a971e-7169-48fe-969f-1739ab2345bc admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.778864 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a971e-7169-48fe-969f-1739ab2345bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.779398 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a971e-7169-48fe-969f-1739ab2345bc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.780725 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a971e-7169-48fe-969f-1739ab2345bc admin admin] RBAC: Adding query filter params (role.id=0f98a58e4d884f4aa616093ea30cb15e, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=80015d086ec24caf9414d2ef5f660f08) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:09.781853 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a971e-7169-48fe-969f-1739ab2345bc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.784170 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a971e-7169-48fe-969f-1739ab2345bc admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.789260 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f66d1-37a4-4b18-8c99-65221083a459 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.801213 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5920e-3f28-4866-98b6-7f0cc88b49b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.802264 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5920e-3f28-4866-98b6-7f0cc88b49b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.802541 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5920e-3f28-4866-98b6-7f0cc88b49b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.802858 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5920e-3f28-4866-98b6-7f0cc88b49b1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.803813 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 327/659] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/role_assignments?user.id=80015d086ec24caf9414d2ef5f660f08&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=0f98a58e4d884f4aa616093ea30cb15e => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:09.822662 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a5920e-3f28-4866-98b6-7f0cc88b49b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.824656 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a5920e-3f28-4866-98b6-7f0cc88b49b1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.845139 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-59a5920e-3f28-4866-98b6-7f0cc88b49b1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:09.846499 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 333/660] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:09.852086 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a971e-7169-48fe-969f-1739ab2345bc admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.863931 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a971e-7169-48fe-969f-1739ab2345bc admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.868687 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2619bf-d307-49f2-8a67-a21466036fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.869409 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2619bf-d307-49f2-8a67-a21466036fcb admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.869740 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2619bf-d307-49f2-8a67-a21466036fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.870015 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2619bf-d307-49f2-8a67-a21466036fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.870943 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2619bf-d307-49f2-8a67-a21466036fcb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:09.871249 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2619bf-d307-49f2-8a67-a21466036fcb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.873894 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2619bf-d307-49f2-8a67-a21466036fcb admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.888433 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 328/661] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:09.894142 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5920e-3f28-4866-98b6-7f0cc88b49b1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:09.904544 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5920e-3f28-4866-98b6-7f0cc88b49b1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:09.909387 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654fa2c-51b3-4ce2-b2d7-5f788e8644ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:09.910138 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654fa2c-51b3-4ce2-b2d7-5f788e8644ec admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.910425 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654fa2c-51b3-4ce2-b2d7-5f788e8644ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.910745 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654fa2c-51b3-4ce2-b2d7-5f788e8644ec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.911601 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654fa2c-51b3-4ce2-b2d7-5f788e8644ec admin admin] RBAC: Adding query filter params (role.id=0f98a58e4d884f4aa616093ea30cb15e, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=c2856d2356604d8192c8772e33c85d7c) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:09.912003 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654fa2c-51b3-4ce2-b2d7-5f788e8644ec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:09.914256 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b654fa2c-51b3-4ce2-b2d7-5f788e8644ec admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:09.922185 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 334/662] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:28:09 2022] GET /identity/v3/role_assignments?user.id=c2856d2356604d8192c8772e33c85d7c&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=0f98a58e4d884f4aa616093ea30cb15e => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:09.947382 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dc551-3157-49ff-a852-d8a0dd42cc82 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.948024 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dc551-3157-49ff-a852-d8a0dd42cc82 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.948498 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dc551-3157-49ff-a852-d8a0dd42cc82 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.953661 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 329/663] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:09.962906 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64eff6-4554-4c43-b1b5-d439f4c377ed None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:09.963241 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64eff6-4554-4c43-b1b5-d439f4c377ed None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:09.963462 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64eff6-4554-4c43-b1b5-d439f4c377ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:09.993739 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-9b64eff6-4554-4c43-b1b5-d439f4c377ed None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:09.994937 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9b64eff6-4554-4c43-b1b5-d439f4c377ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:10.003996 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 335/664] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:28:10.029923 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dc551-3157-49ff-a852-d8a0dd42cc82 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:10.043805 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dc551-3157-49ff-a852-d8a0dd42cc82 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:10.057145 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc2636-5fd7-4d61-bd26-9b7ffc9945e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:10.058682 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc2636-5fd7-4d61-bd26-9b7ffc9945e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:10.059168 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc2636-5fd7-4d61-bd26-9b7ffc9945e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:10.059675 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc2636-5fd7-4d61-bd26-9b7ffc9945e8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:10.076552 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc2636-5fd7-4d61-bd26-9b7ffc9945e8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:10.083711 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-7edc2636-5fd7-4d61-bd26-9b7ffc9945e8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 09 04:28:10.087096 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 330/665] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:28:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:10.091658 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64eff6-4554-4c43-b1b5-d439f4c377ed None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:10.102269 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64eff6-4554-4c43-b1b5-d439f4c377ed None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:10.108615 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0b7b0-3d50-4485-bbc6-ac089540823f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:10.109708 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0b7b0-3d50-4485-bbc6-ac089540823f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:10.110486 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0b7b0-3d50-4485-bbc6-ac089540823f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:10.111184 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0b7b0-3d50-4485-bbc6-ac089540823f admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:10.112803 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0b7b0-3d50-4485-bbc6-ac089540823f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:10.113406 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0b7b0-3d50-4485-bbc6-ac089540823f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:10.115292 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0b7b0-3d50-4485-bbc6-ac089540823f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:10.125711 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 336/666] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Feb 9 04:28:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:10.131590 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc2636-5fd7-4d61-bd26-9b7ffc9945e8 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:10.146642 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc2636-5fd7-4d61-bd26-9b7ffc9945e8 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:10.155372 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35813143-f7a8-49ed-9d02-5a8cc7a7748a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:10.156166 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35813143-f7a8-49ed-9d02-5a8cc7a7748a admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:10.156444 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35813143-f7a8-49ed-9d02-5a8cc7a7748a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:10.156711 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35813143-f7a8-49ed-9d02-5a8cc7a7748a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:10.168815 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35813143-f7a8-49ed-9d02-5a8cc7a7748a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:10.171367 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35813143-f7a8-49ed-9d02-5a8cc7a7748a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:10.188037 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-35813143-f7a8-49ed-9d02-5a8cc7a7748a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:10.189581 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 331/667] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:10.196547 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0b7b0-3d50-4485-bbc6-ac089540823f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:10.206580 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0b7b0-3d50-4485-bbc6-ac089540823f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:10.211105 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dfada-4414-4df3-9654-ae7efd0bb1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:10.211750 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dfada-4414-4df3-9654-ae7efd0bb1dc admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:10.212084 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dfada-4414-4df3-9654-ae7efd0bb1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:10.212362 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dfada-4414-4df3-9654-ae7efd0bb1dc admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:10.213188 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99dfada-4414-4df3-9654-ae7efd0bb1dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:10.213539 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99dfada-4414-4df3-9654-ae7efd0bb1dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:10.215218 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99dfada-4414-4df3-9654-ae7efd0bb1dc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:10.228652 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 337/668] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:10.235612 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35813143-f7a8-49ed-9d02-5a8cc7a7748a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:10.246470 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35813143-f7a8-49ed-9d02-5a8cc7a7748a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:10.251180 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bba38-a409-4ef1-9a07-6ce776a5f7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:10.252052 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bba38-a409-4ef1-9a07-6ce776a5f7da admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:10.252333 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bba38-a409-4ef1-9a07-6ce776a5f7da admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:10.252608 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bba38-a409-4ef1-9a07-6ce776a5f7da admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:10.261887 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7bba38-a409-4ef1-9a07-6ce776a5f7da admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:10.264037 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7bba38-a409-4ef1-9a07-6ce776a5f7da admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:10.277825 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-dc7bba38-a409-4ef1-9a07-6ce776a5f7da admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 09 04:28:10.279892 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 332/669] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:28:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:10.285523 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dfada-4414-4df3-9654-ae7efd0bb1dc admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:10.301991 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dfada-4414-4df3-9654-ae7efd0bb1dc admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:10.311570 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226134c-66d6-49c9-a471-02b0a68b707a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:10.312246 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226134c-66d6-49c9-a471-02b0a68b707a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:10.312529 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226134c-66d6-49c9-a471-02b0a68b707a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:10.312811 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226134c-66d6-49c9-a471-02b0a68b707a admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:10.313705 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226134c-66d6-49c9-a471-02b0a68b707a admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:10.314013 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226134c-66d6-49c9-a471-02b0a68b707a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:10.315878 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226134c-66d6-49c9-a471-02b0a68b707a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:10.345310 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 338/670] 10.222.0.36 () {56 vars in 1156 bytes} [Wed Feb 9 04:28:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:10.350444 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bba38-a409-4ef1-9a07-6ce776a5f7da admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:10.366197 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bba38-a409-4ef1-9a07-6ce776a5f7da admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:10.373688 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbc2a2-b262-41d4-b9a8-237cbd6b80f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:10.374525 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbc2a2-b262-41d4-b9a8-237cbd6b80f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:10.374802 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbc2a2-b262-41d4-b9a8-237cbd6b80f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:10.375118 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dbc2a2-b262-41d4-b9a8-237cbd6b80f7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:10.394670 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dbc2a2-b262-41d4-b9a8-237cbd6b80f7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:10.396564 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dbc2a2-b262-41d4-b9a8-237cbd6b80f7 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:10.420285 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-b0dbc2a2-b262-41d4-b9a8-237cbd6b80f7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:10.421924 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 333/671] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:10.427255 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226134c-66d6-49c9-a471-02b0a68b707a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:10.446038 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226134c-66d6-49c9-a471-02b0a68b707a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:10.459024 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbc87e-4612-4c62-9974-768095ce3f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:10.459704 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbc87e-4612-4c62-9974-768095ce3f15 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:10.459980 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbc87e-4612-4c62-9974-768095ce3f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:10.460253 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbc87e-4612-4c62-9974-768095ce3f15 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:10.461020 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbc87e-4612-4c62-9974-768095ce3f15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:10.461337 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbc87e-4612-4c62-9974-768095ce3f15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:10.462960 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbc87e-4612-4c62-9974-768095ce3f15 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:10.482642 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 339/672] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:10.488185 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbc2a2-b262-41d4-b9a8-237cbd6b80f7 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:10.502646 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dbc2a2-b262-41d4-b9a8-237cbd6b80f7 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:10.510123 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed537c-428e-4a17-adea-02bb2d3f46ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:10.510976 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed537c-428e-4a17-adea-02bb2d3f46ca admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:10.511255 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed537c-428e-4a17-adea-02bb2d3f46ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:10.511765 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed537c-428e-4a17-adea-02bb2d3f46ca admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:10.524427 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed537c-428e-4a17-adea-02bb2d3f46ca admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:10.526457 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed537c-428e-4a17-adea-02bb2d3f46ca admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:10.548054 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-6fed537c-428e-4a17-adea-02bb2d3f46ca admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:10.548754 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 334/673] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:10.554307 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbc87e-4612-4c62-9974-768095ce3f15 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:10.571990 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbc87e-4612-4c62-9974-768095ce3f15 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:10.583407 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5bedce-53cc-4934-881e-259e2713e9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:10.584079 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bedce-53cc-4934-881e-259e2713e9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:10.584364 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bedce-53cc-4934-881e-259e2713e9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:10.584638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bedce-53cc-4934-881e-259e2713e9d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:10.585469 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5bedce-53cc-4934-881e-259e2713e9d0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:10.585779 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5bedce-53cc-4934-881e-259e2713e9d0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:10.587660 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5bedce-53cc-4934-881e-259e2713e9d0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:10.606280 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 340/674] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:10.611650 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed537c-428e-4a17-adea-02bb2d3f46ca admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:10.625978 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed537c-428e-4a17-adea-02bb2d3f46ca admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:10.634081 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182b6ee4-08d6-4784-a348-a40187af07fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:10.635007 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b6ee4-08d6-4784-a348-a40187af07fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:10.635284 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b6ee4-08d6-4784-a348-a40187af07fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:10.635605 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182b6ee4-08d6-4784-a348-a40187af07fa admin admin] PATH_INFO: `/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/66fd482451f743cdb692677e57508764/roles/0f98a58e4d884f4aa616093ea30cb15e` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:10.663490 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b6ee4-08d6-4784-a348-a40187af07fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e618c4377ec64e2e8a6d332696019fac, user_id=66fd482451f743cdb692677e57508764, role_id=0f98a58e4d884f4aa616093ea30cb15e)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:10.663490 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182b6ee4-08d6-4784-a348-a40187af07fa admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:10.688538 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 335/675] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:28:10 2022] PUT /identity/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/66fd482451f743cdb692677e57508764/roles/0f98a58e4d884f4aa616093ea30cb15e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:28:11.901236 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208fd89-4019-42c9-a288-755a885a4b56 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:11.901236 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208fd89-4019-42c9-a288-755a885a4b56 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:11.901236 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208fd89-4019-42c9-a288-755a885a4b56 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:11.901236 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 341/676] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:11.907840 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456444e-d203-49a9-af0a-6818b44a9d91 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:11.908313 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456444e-d203-49a9-af0a-6818b44a9d91 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:11.908386 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456444e-d203-49a9-af0a-6818b44a9d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:11.938003 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-8456444e-d203-49a9-af0a-6818b44a9d91 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:11.939203 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-8456444e-d203-49a9-af0a-6818b44a9d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:12.057405 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 336/677] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 09 04:28:12.093378 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208fd89-4019-42c9-a288-755a885a4b56 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:12.109741 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208fd89-4019-42c9-a288-755a885a4b56 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:12.114358 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f47ae0-b222-4706-96f5-01b69d8f620d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:12.115150 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f47ae0-b222-4706-96f5-01b69d8f620d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.115429 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f47ae0-b222-4706-96f5-01b69d8f620d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.115701 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f47ae0-b222-4706-96f5-01b69d8f620d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.129890 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f47ae0-b222-4706-96f5-01b69d8f620d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:12.136719 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-d0f47ae0-b222-4706-96f5-01b69d8f620d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:28:12.142960 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 342/678] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:28:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:12.148157 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456444e-d203-49a9-af0a-6818b44a9d91 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:12.164043 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456444e-d203-49a9-af0a-6818b44a9d91 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:12.173098 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19c6c5-9319-4069-a738-d4f92eac2ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:12.173771 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19c6c5-9319-4069-a738-d4f92eac2ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.174054 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19c6c5-9319-4069-a738-d4f92eac2ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.174329 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19c6c5-9319-4069-a738-d4f92eac2ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.175099 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19c6c5-9319-4069-a738-d4f92eac2ee6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:12.175403 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19c6c5-9319-4069-a738-d4f92eac2ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:12.177025 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19c6c5-9319-4069-a738-d4f92eac2ee6 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:12.192542 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 337/679] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:28:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:12.201731 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19c6c5-9319-4069-a738-d4f92eac2ee6 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:12.202258 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1396a-9aa4-4ede-bee2-4fbb3578dd49 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.202925 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1396a-9aa4-4ede-bee2-4fbb3578dd49 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.203182 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c1396a-9aa4-4ede-bee2-4fbb3578dd49 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.205409 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 343/680] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:12.221032 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61749cee-5026-4de2-a663-08a2e0daccd6 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.221032 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61749cee-5026-4de2-a663-08a2e0daccd6 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.221032 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61749cee-5026-4de2-a663-08a2e0daccd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.221366 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19c6c5-9319-4069-a738-d4f92eac2ee6 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:12.229035 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325100be-6a4d-44d3-b38c-6f85b5f121e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:12.229035 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325100be-6a4d-44d3-b38c-6f85b5f121e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.229035 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325100be-6a4d-44d3-b38c-6f85b5f121e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.229035 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325100be-6a4d-44d3-b38c-6f85b5f121e7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.244017 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325100be-6a4d-44d3-b38c-6f85b5f121e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:12.249034 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325100be-6a4d-44d3-b38c-6f85b5f121e7 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:12.249158 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-61749cee-5026-4de2-a663-08a2e0daccd6 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:12.249158 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-61749cee-5026-4de2-a663-08a2e0daccd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:12.267473 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 344/681] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:28:12.272544 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-325100be-6a4d-44d3-b38c-6f85b5f121e7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:12.272961 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 338/682] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:12.282027 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61749cee-5026-4de2-a663-08a2e0daccd6 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:12.297595 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325100be-6a4d-44d3-b38c-6f85b5f121e7 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:12.311747 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61749cee-5026-4de2-a663-08a2e0daccd6 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:12.312031 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325100be-6a4d-44d3-b38c-6f85b5f121e7 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:12.321027 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b1aff-5f4e-4113-bda3-9a04437ce10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:12.321194 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4312a-3c4a-444c-bcf3-daa0e7b07faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:12.325031 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b1aff-5f4e-4113-bda3-9a04437ce10b admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.325169 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4312a-3c4a-444c-bcf3-daa0e7b07faa admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.325247 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b1aff-5f4e-4113-bda3-9a04437ce10b admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.325247 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b1aff-5f4e-4113-bda3-9a04437ce10b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.325408 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4312a-3c4a-444c-bcf3-daa0e7b07faa admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.325408 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4312a-3c4a-444c-bcf3-daa0e7b07faa admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.325408 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4312a-3c4a-444c-bcf3-daa0e7b07faa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:12.326120 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4312a-3c4a-444c-bcf3-daa0e7b07faa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:12.331803 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c4312a-3c4a-444c-bcf3-daa0e7b07faa admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:12.351662 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b1aff-5f4e-4113-bda3-9a04437ce10b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:12.360571 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b1aff-5f4e-4113-bda3-9a04437ce10b admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:12.368151 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 345/683] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:12.373554 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4312a-3c4a-444c-bcf3-daa0e7b07faa admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:12.401090 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4312a-3c4a-444c-bcf3-daa0e7b07faa admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:12.414821 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbd6fd-3dde-40e9-b9b5-954e030997e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:12.415549 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbd6fd-3dde-40e9-b9b5-954e030997e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.415825 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbd6fd-3dde-40e9-b9b5-954e030997e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.416095 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbd6fd-3dde-40e9-b9b5-954e030997e3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.419364 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-cc2b1aff-5f4e-4113-bda3-9a04437ce10b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:12.421960 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 339/684] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:12.429820 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b1aff-5f4e-4113-bda3-9a04437ce10b admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:12.445576 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbd6fd-3dde-40e9-b9b5-954e030997e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:12.453650 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b1aff-5f4e-4113-bda3-9a04437ce10b admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:12.455395 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbd6fd-3dde-40e9-b9b5-954e030997e3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:12.465949 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bdfb2-e89e-43a2-be42-9fb22cc0c3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:12.468604 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bdfb2-e89e-43a2-be42-9fb22cc0c3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.468925 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bdfb2-e89e-43a2-be42-9fb22cc0c3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.469830 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bdfb2-e89e-43a2-be42-9fb22cc0c3e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.477059 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-adbbd6fd-3dde-40e9-b9b5-954e030997e3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 09 04:28:12.478166 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bdfb2-e89e-43a2-be42-9fb22cc0c3e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:12.478475 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bdfb2-e89e-43a2-be42-9fb22cc0c3e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:12.480061 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bdfb2-e89e-43a2-be42-9fb22cc0c3e7 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:12.489420 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 346/685] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Feb 9 04:28:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:12.494784 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbd6fd-3dde-40e9-b9b5-954e030997e3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:12.502382 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 340/686] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:12.513544 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bdfb2-e89e-43a2-be42-9fb22cc0c3e7 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:12.517028 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbd6fd-3dde-40e9-b9b5-954e030997e3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:12.528217 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bdfb2-e89e-43a2-be42-9fb22cc0c3e7 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:12.533026 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0edbc-077b-4c7c-a373-bc6959316e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:12.533026 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0edbc-077b-4c7c-a373-bc6959316e85 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.533026 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0edbc-077b-4c7c-a373-bc6959316e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.533026 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0edbc-077b-4c7c-a373-bc6959316e85 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.533673 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0edbc-077b-4c7c-a373-bc6959316e85 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:12.533673 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0edbc-077b-4c7c-a373-bc6959316e85 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:12.533987 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0edbc-077b-4c7c-a373-bc6959316e85 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:12.540786 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69459f-7ebb-4482-a537-6b489b038631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:12.541491 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69459f-7ebb-4482-a537-6b489b038631 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.545026 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69459f-7ebb-4482-a537-6b489b038631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.545026 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69459f-7ebb-4482-a537-6b489b038631 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.545026 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69459f-7ebb-4482-a537-6b489b038631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:12.561038 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69459f-7ebb-4482-a537-6b489b038631 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:12.591232 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 347/687] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Feb 9 04:28:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:12.598322 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0edbc-077b-4c7c-a373-bc6959316e85 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:12.614727 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 341/688] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Feb 9 04:28:12 2022] POST /identity/v3/users => generated 254 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:28:12.635438 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0edbc-077b-4c7c-a373-bc6959316e85 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:12.652766 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d33eb-95b5-474d-ab99-64375d229afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:12.653888 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d33eb-95b5-474d-ab99-64375d229afb admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.654379 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d33eb-95b5-474d-ab99-64375d229afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.654873 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d33eb-95b5-474d-ab99-64375d229afb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.657042 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b801173-c765-43c0-8ccd-652e05d66159 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.657321 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b801173-c765-43c0-8ccd-652e05d66159 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.657594 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b801173-c765-43c0-8ccd-652e05d66159 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.659721 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 342/689] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:28:12.667292 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed2bec-45f1-48d2-aa1f-f774162e0dd6 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.667292 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed2bec-45f1-48d2-aa1f-f774162e0dd6 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.667292 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed2bec-45f1-48d2-aa1f-f774162e0dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.673776 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d33eb-95b5-474d-ab99-64375d229afb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:12.683180 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0d33eb-95b5-474d-ab99-64375d229afb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:12.699329 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-40ed2bec-45f1-48d2-aa1f-f774162e0dd6 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:12.700733 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-40ed2bec-45f1-48d2-aa1f-f774162e0dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:12.705517 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 348/690] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:28:12.706538 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d33eb-95b5-474d-ab99-64375d229afb admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:12.721412 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d33eb-95b5-474d-ab99-64375d229afb admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:12.724254 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 343/691] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 09 04:28:12.735164 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c5b57-a81b-4370-9dbb-ee3076c8f2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:12.735983 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c5b57-a81b-4370-9dbb-ee3076c8f2ef admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.736319 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c5b57-a81b-4370-9dbb-ee3076c8f2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.736602 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c5b57-a81b-4370-9dbb-ee3076c8f2ef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.748851 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed2bec-45f1-48d2-aa1f-f774162e0dd6 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:12.756334 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c5b57-a81b-4370-9dbb-ee3076c8f2ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:12.758025 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed2bec-45f1-48d2-aa1f-f774162e0dd6 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:12.758217 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c5b57-a81b-4370-9dbb-ee3076c8f2ef admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:12.762544 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aec8d6-980c-4aeb-9e28-b6e9da2fdc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:12.763381 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aec8d6-980c-4aeb-9e28-b6e9da2fdc37 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.763661 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aec8d6-980c-4aeb-9e28-b6e9da2fdc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.763927 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aec8d6-980c-4aeb-9e28-b6e9da2fdc37 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.764602 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aec8d6-980c-4aeb-9e28-b6e9da2fdc37 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:12.765653 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING py.warnings [None req-01aec8d6-980c-4aeb-9e28-b6e9da2fdc37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:28:12.765653 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: warnings.warn(msg) Feb 09 04:28:12.765653 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: Feb 09 04:28:12.766538 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aec8d6-980c-4aeb-9e28-b6e9da2fdc37 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:12.780142 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-01aec8d6-980c-4aeb-9e28-b6e9da2fdc37 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 09 04:28:12.781707 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 344/692] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:12 2022] GET /identity/v3/services/network => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:12.783717 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-176c5b57-a81b-4370-9dbb-ee3076c8f2ef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:12.785127 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 349/693] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:12.787759 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aec8d6-980c-4aeb-9e28-b6e9da2fdc37 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:12.791109 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c5b57-a81b-4370-9dbb-ee3076c8f2ef admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:12.798523 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aec8d6-980c-4aeb-9e28-b6e9da2fdc37 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:12.806232 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c5b57-a81b-4370-9dbb-ee3076c8f2ef admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:12.812427 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722eb7c-9d2f-49ec-b598-bf44584881f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:12.812427 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722eb7c-9d2f-49ec-b598-bf44584881f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.812809 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722eb7c-9d2f-49ec-b598-bf44584881f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.812950 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722eb7c-9d2f-49ec-b598-bf44584881f6 admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.813679 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722eb7c-9d2f-49ec-b598-bf44584881f6 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:12.814002 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722eb7c-9d2f-49ec-b598-bf44584881f6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:12.814981 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING py.warnings [None req-2722eb7c-9d2f-49ec-b598-bf44584881f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:28:12.814981 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: warnings.warn(msg) Feb 09 04:28:12.814981 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: Feb 09 04:28:12.817042 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2722eb7c-9d2f-49ec-b598-bf44584881f6 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:12.817862 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199e9d5-a1cf-4c83-a61b-c5b08cb85e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:12.818786 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199e9d5-a1cf-4c83-a61b-c5b08cb85e71 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.819258 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199e9d5-a1cf-4c83-a61b-c5b08cb85e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.819719 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199e9d5-a1cf-4c83-a61b-c5b08cb85e71 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.820656 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199e9d5-a1cf-4c83-a61b-c5b08cb85e71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:12.821893 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 345/694] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Feb 9 04:28:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:12.822372 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199e9d5-a1cf-4c83-a61b-c5b08cb85e71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:12.824188 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199e9d5-a1cf-4c83-a61b-c5b08cb85e71 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:12.826998 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722eb7c-9d2f-49ec-b598-bf44584881f6 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:12.842776 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 350/695] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:12.845197 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199e9d5-a1cf-4c83-a61b-c5b08cb85e71 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:12.846901 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722eb7c-9d2f-49ec-b598-bf44584881f6 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:12.853261 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e120e66-d33f-4c03-923f-ce113c716949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:12.854234 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e120e66-d33f-4c03-923f-ce113c716949 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.854732 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e120e66-d33f-4c03-923f-ce113c716949 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.855251 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e120e66-d33f-4c03-923f-ce113c716949 admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.856284 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e120e66-d33f-4c03-923f-ce113c716949 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:12.857344 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e120e66-d33f-4c03-923f-ce113c716949 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:12.858802 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199e9d5-a1cf-4c83-a61b-c5b08cb85e71 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:12.859617 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e120e66-d33f-4c03-923f-ce113c716949 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:12.869274 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 346/696] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Feb 9 04:28:12 2022] GET /identity/v3/services?type=network => generated 124 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:12.870481 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25168fc-cbee-4b86-86d2-465186e70f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:12.870481 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25168fc-cbee-4b86-86d2-465186e70f2a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.870832 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25168fc-cbee-4b86-86d2-465186e70f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.871542 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25168fc-cbee-4b86-86d2-465186e70f2a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.881541 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25168fc-cbee-4b86-86d2-465186e70f2a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:12.883551 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25168fc-cbee-4b86-86d2-465186e70f2a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:12.901057 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-a25168fc-cbee-4b86-86d2-465186e70f2a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:12.902572 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 351/697] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:12.906909 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec668a71-2f0e-4a4a-a9a1-77b89087cca6 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.907167 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec668a71-2f0e-4a4a-a9a1-77b89087cca6 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.907422 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec668a71-2f0e-4a4a-a9a1-77b89087cca6 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.907803 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25168fc-cbee-4b86-86d2-465186e70f2a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:12.909685 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 347/698] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:12.915656 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d83c3e-17df-401c-a0ec-28ed5e4f26d7 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.915946 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d83c3e-17df-401c-a0ec-28ed5e4f26d7 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.916226 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d83c3e-17df-401c-a0ec-28ed5e4f26d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.918386 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25168fc-cbee-4b86-86d2-465186e70f2a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:12.923712 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602370f-671e-4ecb-9398-ac1e626ab160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:12.924380 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602370f-671e-4ecb-9398-ac1e626ab160 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.924707 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602370f-671e-4ecb-9398-ac1e626ab160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.924985 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602370f-671e-4ecb-9398-ac1e626ab160 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.925927 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602370f-671e-4ecb-9398-ac1e626ab160 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:12.926232 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602370f-671e-4ecb-9398-ac1e626ab160 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:12.928213 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602370f-671e-4ecb-9398-ac1e626ab160 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:12.936940 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-a1d83c3e-17df-401c-a0ec-28ed5e4f26d7 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:12.938690 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-a1d83c3e-17df-401c-a0ec-28ed5e4f26d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:12.942036 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 352/699] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:12.948270 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602370f-671e-4ecb-9398-ac1e626ab160 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:12.950759 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 348/700] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:28:12.958415 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602370f-671e-4ecb-9398-ac1e626ab160 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:12.962999 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a9259-175e-4b70-ac15-32f2028170ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:12.963667 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a9259-175e-4b70-ac15-32f2028170ad admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.963976 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a9259-175e-4b70-ac15-32f2028170ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.964237 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a9259-175e-4b70-ac15-32f2028170ad admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:12.965097 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a9259-175e-4b70-ac15-32f2028170ad admin admin] RBAC: Adding query filter params (role.id=05ca9a16ef2a450b8cc73ade47f5c7d0, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=63fe98c10e974c019e05a2f68d012ba8) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:12.965408 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a9259-175e-4b70-ac15-32f2028170ad admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:12.967332 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a9259-175e-4b70-ac15-32f2028170ad admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:12.973568 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 353/701] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:28:12 2022] GET /identity/v3/role_assignments?user.id=63fe98c10e974c019e05a2f68d012ba8&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:12.978900 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d83c3e-17df-401c-a0ec-28ed5e4f26d7 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:12.991259 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d83c3e-17df-401c-a0ec-28ed5e4f26d7 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:12.996677 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcac5d-01a8-419f-8b8d-eb8d5d53da72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:12.998650 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcac5d-01a8-419f-8b8d-eb8d5d53da72 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:12.999243 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcac5d-01a8-419f-8b8d-eb8d5d53da72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:12.999723 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcac5d-01a8-419f-8b8d-eb8d5d53da72 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:13.000704 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcac5d-01a8-419f-8b8d-eb8d5d53da72 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:13.002776 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fcac5d-01a8-419f-8b8d-eb8d5d53da72 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:13.016087 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-b1fcac5d-01a8-419f-8b8d-eb8d5d53da72 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 09 04:28:13.018166 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 349/702] 10.222.0.36 () {56 vars in 1150 bytes} [Wed Feb 9 04:28:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:13.024497 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a9259-175e-4b70-ac15-32f2028170ad admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:13.039430 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a9259-175e-4b70-ac15-32f2028170ad admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:13.045977 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7bb5d-e8c5-4d5f-be70-890c11bd0efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:13.046669 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7bb5d-e8c5-4d5f-be70-890c11bd0efb admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:13.047003 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7bb5d-e8c5-4d5f-be70-890c11bd0efb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:13.047282 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7bb5d-e8c5-4d5f-be70-890c11bd0efb admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:13.048031 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7bb5d-e8c5-4d5f-be70-890c11bd0efb admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:13.048392 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7bb5d-e8c5-4d5f-be70-890c11bd0efb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:13.049606 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-46b7bb5d-e8c5-4d5f-be70-890c11bd0efb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:28:13.049606 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 09 04:28:13.049606 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: Feb 09 04:28:13.050511 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b7bb5d-e8c5-4d5f-be70-890c11bd0efb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:13.058596 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 354/703] 10.222.0.36 () {56 vars in 1145 bytes} [Wed Feb 9 04:28:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:13.064122 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcac5d-01a8-419f-8b8d-eb8d5d53da72 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:13.075469 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fcac5d-01a8-419f-8b8d-eb8d5d53da72 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:13.080319 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a1cf4-164b-4738-a197-714444685418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:13.080987 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a1cf4-164b-4738-a197-714444685418 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:13.081312 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a1cf4-164b-4738-a197-714444685418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:13.081588 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a1cf4-164b-4738-a197-714444685418 admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:13.082325 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a1cf4-164b-4738-a197-714444685418 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:13.082631 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a1cf4-164b-4738-a197-714444685418 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:13.084241 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a1cf4-164b-4738-a197-714444685418 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:13.089683 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 350/704] 10.222.0.36 () {56 vars in 1145 bytes} [Wed Feb 9 04:28:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:13.964945 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402264d3-3f08-4622-8e6f-0a017a454467 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:13.965480 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402264d3-3f08-4622-8e6f-0a017a454467 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:13.965480 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402264d3-3f08-4622-8e6f-0a017a454467 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:13.968836 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 355/705] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:13.974557 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4364d-04a2-4474-856c-d21200c31c71 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:13.975358 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4364d-04a2-4474-856c-d21200c31c71 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:13.975822 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4364d-04a2-4474-856c-d21200c31c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:14.002003 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-b1a4364d-04a2-4474-856c-d21200c31c71 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:14.003459 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-b1a4364d-04a2-4474-856c-d21200c31c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:14.011767 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 351/706] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:28:14.055132 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402264d3-3f08-4622-8e6f-0a017a454467 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:14.070481 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402264d3-3f08-4622-8e6f-0a017a454467 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:14.075149 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083024c-0430-4678-a06b-b52694c9e987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:14.076278 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083024c-0430-4678-a06b-b52694c9e987 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:14.076780 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083024c-0430-4678-a06b-b52694c9e987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:14.077277 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083024c-0430-4678-a06b-b52694c9e987 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:14.095121 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083024c-0430-4678-a06b-b52694c9e987 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:14.102399 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-2083024c-0430-4678-a06b-b52694c9e987 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 09 04:28:14.103780 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 356/707] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:28:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:14.110082 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4364d-04a2-4474-856c-d21200c31c71 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:14.121873 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4364d-04a2-4474-856c-d21200c31c71 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:14.130388 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4044f67-9c9f-414e-81f0-c9796ab068a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:14.131041 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4044f67-9c9f-414e-81f0-c9796ab068a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:14.131321 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4044f67-9c9f-414e-81f0-c9796ab068a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:14.131593 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4044f67-9c9f-414e-81f0-c9796ab068a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:14.132353 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4044f67-9c9f-414e-81f0-c9796ab068a3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:14.132657 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4044f67-9c9f-414e-81f0-c9796ab068a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:14.134321 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4044f67-9c9f-414e-81f0-c9796ab068a3 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:14.145208 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 352/708] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Feb 9 04:28:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:14.150187 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083024c-0430-4678-a06b-b52694c9e987 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:14.166414 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083024c-0430-4678-a06b-b52694c9e987 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:14.177128 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ec63b-9921-4ead-8ff0-c5c2387ddb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:14.178159 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ec63b-9921-4ead-8ff0-c5c2387ddb72 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:14.178661 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ec63b-9921-4ead-8ff0-c5c2387ddb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:14.179139 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ec63b-9921-4ead-8ff0-c5c2387ddb72 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:14.198156 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ec63b-9921-4ead-8ff0-c5c2387ddb72 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:14.201084 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ec63b-9921-4ead-8ff0-c5c2387ddb72 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:14.230551 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-6c8ec63b-9921-4ead-8ff0-c5c2387ddb72 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:14.232503 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 357/709] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:14.237630 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4044f67-9c9f-414e-81f0-c9796ab068a3 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:14.250219 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4044f67-9c9f-414e-81f0-c9796ab068a3 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:14.265695 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e79a6-b0cf-4d1e-a242-cb5870867da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:14.266459 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e79a6-b0cf-4d1e-a242-cb5870867da5 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:14.266770 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e79a6-b0cf-4d1e-a242-cb5870867da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:14.267045 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e79a6-b0cf-4d1e-a242-cb5870867da5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:14.267791 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e79a6-b0cf-4d1e-a242-cb5870867da5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:14.268096 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e79a6-b0cf-4d1e-a242-cb5870867da5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:14.269715 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e79a6-b0cf-4d1e-a242-cb5870867da5 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:14.287790 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 353/710] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:14.293248 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ec63b-9921-4ead-8ff0-c5c2387ddb72 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:14.305867 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ec63b-9921-4ead-8ff0-c5c2387ddb72 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:14.313063 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb66fb8-f914-469d-bc58-90ce24636bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:14.314094 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb66fb8-f914-469d-bc58-90ce24636bbf admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:14.314595 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb66fb8-f914-469d-bc58-90ce24636bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:14.315062 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb66fb8-f914-469d-bc58-90ce24636bbf admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:14.328847 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb66fb8-f914-469d-bc58-90ce24636bbf admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:14.331308 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb66fb8-f914-469d-bc58-90ce24636bbf admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:14.350637 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-acb66fb8-f914-469d-bc58-90ce24636bbf admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 09 04:28:14.352248 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 358/711] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:28:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:14.358082 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e79a6-b0cf-4d1e-a242-cb5870867da5 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:14.374930 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e79a6-b0cf-4d1e-a242-cb5870867da5 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:14.385632 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79c04c-0f2e-4a1b-9b79-4b6117e14ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:14.386308 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79c04c-0f2e-4a1b-9b79-4b6117e14ecc admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:14.386591 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79c04c-0f2e-4a1b-9b79-4b6117e14ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:14.386866 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79c04c-0f2e-4a1b-9b79-4b6117e14ecc admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:14.387720 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79c04c-0f2e-4a1b-9b79-4b6117e14ecc admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:14.388569 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79c04c-0f2e-4a1b-9b79-4b6117e14ecc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:14.390440 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79c04c-0f2e-4a1b-9b79-4b6117e14ecc admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:14.408951 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 354/712] 10.222.0.36 () {56 vars in 1156 bytes} [Wed Feb 9 04:28:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:14.414236 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb66fb8-f914-469d-bc58-90ce24636bbf admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:14.429764 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb66fb8-f914-469d-bc58-90ce24636bbf admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:14.436599 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59735a8a-9972-4887-add2-e0c57fde65eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:14.437491 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59735a8a-9972-4887-add2-e0c57fde65eb admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:14.437995 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59735a8a-9972-4887-add2-e0c57fde65eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:14.438461 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59735a8a-9972-4887-add2-e0c57fde65eb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:14.453015 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59735a8a-9972-4887-add2-e0c57fde65eb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:14.454783 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59735a8a-9972-4887-add2-e0c57fde65eb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:14.467038 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 359/713] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:28:14.472432 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79c04c-0f2e-4a1b-9b79-4b6117e14ecc admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:14.486018 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79c04c-0f2e-4a1b-9b79-4b6117e14ecc admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:14.491902 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09def6-b398-494e-bd00-480d16ebb791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:14.492689 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09def6-b398-494e-bd00-480d16ebb791 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:14.492968 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09def6-b398-494e-bd00-480d16ebb791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:14.493269 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca09def6-b398-494e-bd00-480d16ebb791 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:14.509756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09def6-b398-494e-bd00-480d16ebb791 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:14.511588 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca09def6-b398-494e-bd00-480d16ebb791 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:14.536543 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-ca09def6-b398-494e-bd00-480d16ebb791 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:14.538291 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 355/714] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:14.546032 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59735a8a-9972-4887-add2-e0c57fde65eb admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:14.557820 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59735a8a-9972-4887-add2-e0c57fde65eb admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:14.567886 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18c077-da0b-4dd3-b200-4306030126d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:14.568541 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18c077-da0b-4dd3-b200-4306030126d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:14.568826 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18c077-da0b-4dd3-b200-4306030126d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:14.569139 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18c077-da0b-4dd3-b200-4306030126d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:14.572245 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18c077-da0b-4dd3-b200-4306030126d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:14.572245 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18c077-da0b-4dd3-b200-4306030126d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:14.572245 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18c077-da0b-4dd3-b200-4306030126d9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:14.591870 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 360/715] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:14.597362 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09def6-b398-494e-bd00-480d16ebb791 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:14.610491 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca09def6-b398-494e-bd00-480d16ebb791 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:14.620397 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45c7dc-5902-4ba4-b338-b0f901fa7d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:14.621230 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45c7dc-5902-4ba4-b338-b0f901fa7d0a admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:14.621511 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45c7dc-5902-4ba4-b338-b0f901fa7d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:14.621788 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45c7dc-5902-4ba4-b338-b0f901fa7d0a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:14.634474 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45c7dc-5902-4ba4-b338-b0f901fa7d0a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:14.636419 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45c7dc-5902-4ba4-b338-b0f901fa7d0a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:14.652419 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-fd45c7dc-5902-4ba4-b338-b0f901fa7d0a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:14.653916 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 356/716] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:14.659439 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18c077-da0b-4dd3-b200-4306030126d9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:14.670107 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18c077-da0b-4dd3-b200-4306030126d9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:14.682472 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a3b3e3-cf35-4898-9664-7d5d321c32b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:14.683127 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3b3e3-cf35-4898-9664-7d5d321c32b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:14.683412 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3b3e3-cf35-4898-9664-7d5d321c32b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:14.683688 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3b3e3-cf35-4898-9664-7d5d321c32b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:14.684490 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3b3e3-cf35-4898-9664-7d5d321c32b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:14.685352 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3b3e3-cf35-4898-9664-7d5d321c32b2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:14.687225 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a3b3e3-cf35-4898-9664-7d5d321c32b2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:14.704412 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 361/717] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:14.710127 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45c7dc-5902-4ba4-b338-b0f901fa7d0a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:14.725852 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45c7dc-5902-4ba4-b338-b0f901fa7d0a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:14.734430 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13703c53-9294-4872-b3a4-e0ab60f51d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:14.735069 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13703c53-9294-4872-b3a4-e0ab60f51d7e admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:14.735344 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13703c53-9294-4872-b3a4-e0ab60f51d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:14.735614 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13703c53-9294-4872-b3a4-e0ab60f51d7e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:14.736504 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13703c53-9294-4872-b3a4-e0ab60f51d7e admin admin] RBAC: Adding query filter params (role.id=0f98a58e4d884f4aa616093ea30cb15e, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=66fd482451f743cdb692677e57508764) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:14.736762 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13703c53-9294-4872-b3a4-e0ab60f51d7e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:14.738621 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13703c53-9294-4872-b3a4-e0ab60f51d7e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:14.749916 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 357/718] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:28:14 2022] GET /identity/v3/role_assignments?user.id=66fd482451f743cdb692677e57508764&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=0f98a58e4d884f4aa616093ea30cb15e => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:15.449598 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cd3f5-6111-48b6-9ffe-2a1f5a436d9c None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:15.450111 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cd3f5-6111-48b6-9ffe-2a1f5a436d9c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:15.450193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cd3f5-6111-48b6-9ffe-2a1f5a436d9c None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:15.452193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 362/719] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:15.457337 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e7c11-a82f-4a3b-a58f-b4eb297a6278 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:15.457737 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e7c11-a82f-4a3b-a58f-b4eb297a6278 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:15.457903 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e7c11-a82f-4a3b-a58f-b4eb297a6278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:15.480784 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-961e7c11-a82f-4a3b-a58f-b4eb297a6278 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:15.482578 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-961e7c11-a82f-4a3b-a58f-b4eb297a6278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:15.490489 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 358/720] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:28:15.514474 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cd3f5-6111-48b6-9ffe-2a1f5a436d9c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:15.526944 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cd3f5-6111-48b6-9ffe-2a1f5a436d9c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:15.531868 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65fcaa-18b5-46ab-b350-f0061a461f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:15.532667 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65fcaa-18b5-46ab-b350-f0061a461f45 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:15.532950 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65fcaa-18b5-46ab-b350-f0061a461f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:15.533254 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65fcaa-18b5-46ab-b350-f0061a461f45 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:15.544305 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65fcaa-18b5-46ab-b350-f0061a461f45 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:15.551270 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-5e65fcaa-18b5-46ab-b350-f0061a461f45 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 09 04:28:15.554447 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 363/721] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:28:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:15.560747 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e7c11-a82f-4a3b-a58f-b4eb297a6278 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:15.570923 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e7c11-a82f-4a3b-a58f-b4eb297a6278 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:15.571102 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15b28e-c9e3-4d05-80f3-40e3259e4f2d None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:15.571335 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15b28e-c9e3-4d05-80f3-40e3259e4f2d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:15.571614 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15b28e-c9e3-4d05-80f3-40e3259e4f2d None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:15.577030 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 364/722] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:28:15.579685 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e5da6-43e7-4645-9bab-f03ccbe428eb None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:15.579969 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e5da6-43e7-4645-9bab-f03ccbe428eb None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:15.580350 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e5da6-43e7-4645-9bab-f03ccbe428eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:15.582662 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf5f54-9bd4-4d3f-8a06-e4914015b52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:15.583328 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf5f54-9bd4-4d3f-8a06-e4914015b52d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:15.583603 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf5f54-9bd4-4d3f-8a06-e4914015b52d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:15.583873 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf5f54-9bd4-4d3f-8a06-e4914015b52d admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:15.584637 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf5f54-9bd4-4d3f-8a06-e4914015b52d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:15.584937 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf5f54-9bd4-4d3f-8a06-e4914015b52d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:15.586549 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf5f54-9bd4-4d3f-8a06-e4914015b52d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:15.599184 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 359/723] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Feb 9 04:28:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:15.604893 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf5f54-9bd4-4d3f-8a06-e4914015b52d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:15.610174 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-558e5da6-43e7-4645-9bab-f03ccbe428eb None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:15.611261 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-558e5da6-43e7-4645-9bab-f03ccbe428eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:15.615569 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf5f54-9bd4-4d3f-8a06-e4914015b52d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:15.626961 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 365/724] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:28:15.627788 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d067d-58cb-4035-b19e-93990fb383f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:15.628588 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d067d-58cb-4035-b19e-93990fb383f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:15.628873 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d067d-58cb-4035-b19e-93990fb383f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:15.629178 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d067d-58cb-4035-b19e-93990fb383f2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:15.644380 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d067d-58cb-4035-b19e-93990fb383f2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:15.646502 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d067d-58cb-4035-b19e-93990fb383f2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:15.658055 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e5da6-43e7-4645-9bab-f03ccbe428eb None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:15.666201 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-a24d067d-58cb-4035-b19e-93990fb383f2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:15.667748 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 360/725] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:15.675645 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e5da6-43e7-4645-9bab-f03ccbe428eb None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:15.677178 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d067d-58cb-4035-b19e-93990fb383f2 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:15.686959 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62010f-ec4b-41ea-8e56-68e3d09143db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:15.687769 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62010f-ec4b-41ea-8e56-68e3d09143db admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:15.687970 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d067d-58cb-4035-b19e-93990fb383f2 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:15.688073 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62010f-ec4b-41ea-8e56-68e3d09143db admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:15.688306 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62010f-ec4b-41ea-8e56-68e3d09143db admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:15.701278 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4eea1-b380-475e-9149-1dd8b193d171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:15.702009 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4eea1-b380-475e-9149-1dd8b193d171 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:15.702296 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4eea1-b380-475e-9149-1dd8b193d171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:15.702569 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4eea1-b380-475e-9149-1dd8b193d171 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:15.704487 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4eea1-b380-475e-9149-1dd8b193d171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:15.704804 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4eea1-b380-475e-9149-1dd8b193d171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:15.708759 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4eea1-b380-475e-9149-1dd8b193d171 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:15.714391 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62010f-ec4b-41ea-8e56-68e3d09143db admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:15.726627 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-2b62010f-ec4b-41ea-8e56-68e3d09143db admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:28:15.728173 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 366/726] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:28:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:15.729468 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3634c-7dc7-4a16-afb2-65526da76148 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:15.729808 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3634c-7dc7-4a16-afb2-65526da76148 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:15.730091 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3634c-7dc7-4a16-afb2-65526da76148 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:15.732311 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 367/727] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:15.733175 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 361/728] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:15.737169 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3634c-7dc7-4a16-afb2-65526da76148 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:15.737929 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e63f4-8e2c-41d8-a280-f6b7be944dd0 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:15.738420 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e63f4-8e2c-41d8-a280-f6b7be944dd0 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:15.738934 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e63f4-8e2c-41d8-a280-f6b7be944dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:15.750041 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3634c-7dc7-4a16-afb2-65526da76148 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:15.754739 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb9158-cee5-4c87-b6e5-fd3150d90ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:15.755441 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb9158-cee5-4c87-b6e5-fd3150d90ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:15.755726 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb9158-cee5-4c87-b6e5-fd3150d90ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:15.756059 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb9158-cee5-4c87-b6e5-fd3150d90ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:15.756918 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb9158-cee5-4c87-b6e5-fd3150d90ee1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:15.757264 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb9158-cee5-4c87-b6e5-fd3150d90ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:15.759047 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb9158-cee5-4c87-b6e5-fd3150d90ee1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:15.760364 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-6e2e63f4-8e2c-41d8-a280-f6b7be944dd0 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:15.761776 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-6e2e63f4-8e2c-41d8-a280-f6b7be944dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:15.769192 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 368/729] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:28:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:15.770189 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb9158-cee5-4c87-b6e5-fd3150d90ee1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:15.770396 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 362/730] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 09 04:28:15.774210 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e63f4-8e2c-41d8-a280-f6b7be944dd0 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:15.791321 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e63f4-8e2c-41d8-a280-f6b7be944dd0 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:15.793719 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb9158-cee5-4c87-b6e5-fd3150d90ee1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:15.801924 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2a551-c968-47ca-99a7-898ade00d5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:15.802724 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2a551-c968-47ca-99a7-898ade00d5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:15.803003 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2a551-c968-47ca-99a7-898ade00d5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:15.803273 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2a551-c968-47ca-99a7-898ade00d5a9 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:15.804304 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4def0d-aa24-4012-b52a-fae838635fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:15.805083 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4def0d-aa24-4012-b52a-fae838635fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:15.805365 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4def0d-aa24-4012-b52a-fae838635fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:15.805645 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4def0d-aa24-4012-b52a-fae838635fd9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:15.817324 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2a551-c968-47ca-99a7-898ade00d5a9 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:15.819481 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2a551-c968-47ca-99a7-898ade00d5a9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:15.821513 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4def0d-aa24-4012-b52a-fae838635fd9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:15.823552 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4def0d-aa24-4012-b52a-fae838635fd9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:15.835340 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-b1e2a551-c968-47ca-99a7-898ade00d5a9 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 09 04:28:15.836522 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 369/731] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Feb 9 04:28:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:15.837289 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2a551-c968-47ca-99a7-898ade00d5a9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:15.842275 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-ca4def0d-aa24-4012-b52a-fae838635fd9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:15.843714 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 363/732] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:15.844443 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4def0d-aa24-4012-b52a-fae838635fd9 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:15.847587 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2a551-c968-47ca-99a7-898ade00d5a9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:15.852737 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37062d92-d210-4c54-b77c-d34942fe19a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:15.853679 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37062d92-d210-4c54-b77c-d34942fe19a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:15.854145 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37062d92-d210-4c54-b77c-d34942fe19a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:15.854618 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37062d92-d210-4c54-b77c-d34942fe19a6 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:15.855021 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4def0d-aa24-4012-b52a-fae838635fd9 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:15.855727 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37062d92-d210-4c54-b77c-d34942fe19a6 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:15.857574 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-37062d92-d210-4c54-b77c-d34942fe19a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:28:15.857574 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 09 04:28:15.857574 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: Feb 09 04:28:15.858791 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37062d92-d210-4c54-b77c-d34942fe19a6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:15.860279 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f2891-f53e-4cff-8a85-f981716a5887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:15.860988 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f2891-f53e-4cff-8a85-f981716a5887 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:15.861362 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f2891-f53e-4cff-8a85-f981716a5887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:15.861728 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f2891-f53e-4cff-8a85-f981716a5887 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:15.862627 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f2891-f53e-4cff-8a85-f981716a5887 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:15.862999 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f2891-f53e-4cff-8a85-f981716a5887 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:15.865077 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f2891-f53e-4cff-8a85-f981716a5887 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:15.879393 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 370/733] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Feb 9 04:28:15 2022] POST /identity/v3/services => generated 240 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:28:15.880502 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37062d92-d210-4c54-b77c-d34942fe19a6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:15.901353 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 364/734] 10.222.0.36 () {56 vars in 1170 bytes} [Wed Feb 9 04:28:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:15.908211 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f2891-f53e-4cff-8a85-f981716a5887 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:15.926701 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37062d92-d210-4c54-b77c-d34942fe19a6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:15.928562 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f2891-f53e-4cff-8a85-f981716a5887 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:15.936867 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5eaec-85c5-4e5a-9d33-f624983ac4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:15.937929 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5eaec-85c5-4e5a-9d33-f624983ac4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:15.938788 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5eaec-85c5-4e5a-9d33-f624983ac4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:15.939841 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5eaec-85c5-4e5a-9d33-f624983ac4e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:15.941311 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5eaec-85c5-4e5a-9d33-f624983ac4e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:15.941809 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9574351-46a8-43ad-9f67-5f3cd0f80bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:15.942696 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9574351-46a8-43ad-9f67-5f3cd0f80bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:15.943281 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5eaec-85c5-4e5a-9d33-f624983ac4e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:15.944346 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9574351-46a8-43ad-9f67-5f3cd0f80bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:15.944823 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9574351-46a8-43ad-9f67-5f3cd0f80bf9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:15.946248 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd5eaec-85c5-4e5a-9d33-f624983ac4e4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:15.962991 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9574351-46a8-43ad-9f67-5f3cd0f80bf9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:15.967864 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9574351-46a8-43ad-9f67-5f3cd0f80bf9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:15.976263 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 371/735] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:15.982710 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5eaec-85c5-4e5a-9d33-f624983ac4e4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:15.991557 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 365/736] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:15 2022] GET /identity/v3/auth/tokens => generated 1013 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:28:15.998637 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9574351-46a8-43ad-9f67-5f3cd0f80bf9 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:16.003194 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5eaec-85c5-4e5a-9d33-f624983ac4e4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:16.012331 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9574351-46a8-43ad-9f67-5f3cd0f80bf9 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:16.012549 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0bc2cb-a53c-407b-bce7-7f80a0cf89a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:16.013328 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bc2cb-a53c-407b-bce7-7f80a0cf89a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:16.013691 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bc2cb-a53c-407b-bce7-7f80a0cf89a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:16.013930 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bc2cb-a53c-407b-bce7-7f80a0cf89a7 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:16.018070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d924a9-98b5-48b5-9ed6-be93e71a32de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:16.019196 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d924a9-98b5-48b5-9ed6-be93e71a32de admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:16.019714 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d924a9-98b5-48b5-9ed6-be93e71a32de admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:16.020180 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d924a9-98b5-48b5-9ed6-be93e71a32de admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:16.022577 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0bc2cb-a53c-407b-bce7-7f80a0cf89a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:16.024673 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0bc2cb-a53c-407b-bce7-7f80a0cf89a7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:16.032915 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d924a9-98b5-48b5-9ed6-be93e71a32de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:16.036627 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d924a9-98b5-48b5-9ed6-be93e71a32de admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:16.040441 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-2e0bc2cb-a53c-407b-bce7-7f80a0cf89a7 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 09 04:28:16.046946 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 372/737] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Feb 9 04:28:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:16.048582 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6e710-6bf0-4201-82b9-e4e1e8c1ee9f None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:16.049236 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6e710-6bf0-4201-82b9-e4e1e8c1ee9f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:16.049236 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a6e710-6bf0-4201-82b9-e4e1e8c1ee9f None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:16.050925 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 373/738] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:16.051706 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6e710-6bf0-4201-82b9-e4e1e8c1ee9f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:16.058891 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-62d924a9-98b5-48b5-9ed6-be93e71a32de admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:16.060834 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 366/739] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:16.062289 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e47629-d19a-4de5-bf97-8f7ac8803f6c None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:16.062827 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e47629-d19a-4de5-bf97-8f7ac8803f6c None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:16.063201 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e47629-d19a-4de5-bf97-8f7ac8803f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:16.069418 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a6e710-6bf0-4201-82b9-e4e1e8c1ee9f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:16.074451 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53252794-d6e4-4f83-aa73-141f754f164c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:16.075378 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53252794-d6e4-4f83-aa73-141f754f164c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:16.075799 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53252794-d6e4-4f83-aa73-141f754f164c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:16.076198 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53252794-d6e4-4f83-aa73-141f754f164c admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:16.077317 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53252794-d6e4-4f83-aa73-141f754f164c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:16.077799 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53252794-d6e4-4f83-aa73-141f754f164c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:16.079647 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53252794-d6e4-4f83-aa73-141f754f164c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:16.082002 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-65e47629-d19a-4de5-bf97-8f7ac8803f6c None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:16.083177 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-65e47629-d19a-4de5-bf97-8f7ac8803f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:16.093372 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 367/740] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:16 2022] POST /identity/v3/auth/tokens => generated 1013 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:16.094354 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e47629-d19a-4de5-bf97-8f7ac8803f6c None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:16.098161 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 374/741] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Feb 9 04:28:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:16.105794 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53252794-d6e4-4f83-aa73-141f754f164c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:16.111326 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e47629-d19a-4de5-bf97-8f7ac8803f6c None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:16.116177 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5571d-7a34-43fc-98ad-8e96c015db43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:16.117486 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5571d-7a34-43fc-98ad-8e96c015db43 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:16.117805 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53252794-d6e4-4f83-aa73-141f754f164c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:16.117920 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5571d-7a34-43fc-98ad-8e96c015db43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:16.118368 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5571d-7a34-43fc-98ad-8e96c015db43 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:16.119986 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5571d-7a34-43fc-98ad-8e96c015db43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:16.119986 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5571d-7a34-43fc-98ad-8e96c015db43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:16.122555 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae5571d-7a34-43fc-98ad-8e96c015db43 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:16.124291 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d943b-985e-41fa-8f6d-c27d3957b0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:16.125109 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d943b-985e-41fa-8f6d-c27d3957b0dc admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:16.125388 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d943b-985e-41fa-8f6d-c27d3957b0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:16.125659 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d943b-985e-41fa-8f6d-c27d3957b0dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:16.135535 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 368/742] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:16.136616 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5571d-7a34-43fc-98ad-8e96c015db43 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:16.141049 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d943b-985e-41fa-8f6d-c27d3957b0dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:16.141049 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d943b-985e-41fa-8f6d-c27d3957b0dc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:16.150581 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae5571d-7a34-43fc-98ad-8e96c015db43 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:16.156909 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920fe53-7767-424f-b0c0-b27e611dd543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:16.157157 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-681d943b-985e-41fa-8f6d-c27d3957b0dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:16.157582 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920fe53-7767-424f-b0c0-b27e611dd543 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:16.157865 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920fe53-7767-424f-b0c0-b27e611dd543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:16.158140 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920fe53-7767-424f-b0c0-b27e611dd543 admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:16.159089 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920fe53-7767-424f-b0c0-b27e611dd543 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:16.159187 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 375/743] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:16.160281 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d943b-985e-41fa-8f6d-c27d3957b0dc admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:16.160394 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING py.warnings [None req-6920fe53-7767-424f-b0c0-b27e611dd543 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:28:16.160394 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: warnings.warn(msg) Feb 09 04:28:16.160394 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: Feb 09 04:28:16.160741 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920fe53-7767-424f-b0c0-b27e611dd543 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:16.174354 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d943b-985e-41fa-8f6d-c27d3957b0dc admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:16.177217 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 369/744] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Feb 9 04:28:16 2022] POST /identity/v3/services => generated 251 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:28:16.177947 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920fe53-7767-424f-b0c0-b27e611dd543 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:16.195971 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc99ce-0fdd-4cc0-8330-873d64de95ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:16.196783 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc99ce-0fdd-4cc0-8330-873d64de95ce admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:16.197158 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc99ce-0fdd-4cc0-8330-873d64de95ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:16.197487 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc99ce-0fdd-4cc0-8330-873d64de95ce admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:16.210306 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc99ce-0fdd-4cc0-8330-873d64de95ce admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:16.212411 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc99ce-0fdd-4cc0-8330-873d64de95ce admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:16.217939 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920fe53-7767-424f-b0c0-b27e611dd543 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:16.222675 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c0e9e-f9d4-49e2-8f36-f6054b4c94e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:16.223520 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c0e9e-f9d4-49e2-8f36-f6054b4c94e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:16.223803 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c0e9e-f9d4-49e2-8f36-f6054b4c94e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:16.224074 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c0e9e-f9d4-49e2-8f36-f6054b4c94e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:16.224875 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c0e9e-f9d4-49e2-8f36-f6054b4c94e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:16.225215 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c0e9e-f9d4-49e2-8f36-f6054b4c94e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:16.226936 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c0e9e-f9d4-49e2-8f36-f6054b4c94e9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:16.227683 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-d2fc99ce-0fdd-4cc0-8330-873d64de95ce admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:16.228947 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 376/745] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:16.236080 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc99ce-0fdd-4cc0-8330-873d64de95ce admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:16.241265 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 370/746] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:16.246745 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc99ce-0fdd-4cc0-8330-873d64de95ce admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:16.248509 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c0e9e-f9d4-49e2-8f36-f6054b4c94e9 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:16.252071 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9c70a-9386-424f-9b16-5af5f141ff4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:16.252857 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9c70a-9386-424f-9b16-5af5f141ff4f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:16.253212 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9c70a-9386-424f-9b16-5af5f141ff4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:16.253483 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9c70a-9386-424f-9b16-5af5f141ff4f admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:16.254359 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9c70a-9386-424f-9b16-5af5f141ff4f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:16.254663 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9c70a-9386-424f-9b16-5af5f141ff4f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:16.256626 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9c70a-9386-424f-9b16-5af5f141ff4f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:16.270328 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 377/747] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:16.272111 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c0e9e-f9d4-49e2-8f36-f6054b4c94e9 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:16.276439 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9c70a-9386-424f-9b16-5af5f141ff4f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:16.283220 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787efc5-34b6-4d04-afcc-a598875e1310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:16.284136 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787efc5-34b6-4d04-afcc-a598875e1310 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:16.284498 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787efc5-34b6-4d04-afcc-a598875e1310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:16.284848 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787efc5-34b6-4d04-afcc-a598875e1310 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:16.287677 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9c70a-9386-424f-9b16-5af5f141ff4f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:16.292650 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7009927-0444-4970-ade6-b8625dbb49e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:16.293696 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7009927-0444-4970-ade6-b8625dbb49e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:16.294168 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7009927-0444-4970-ade6-b8625dbb49e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:16.294602 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7009927-0444-4970-ade6-b8625dbb49e0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:16.295667 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7009927-0444-4970-ade6-b8625dbb49e0 admin admin] RBAC: Adding query filter params (role.id=0f98a58e4d884f4aa616093ea30cb15e, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=98a27dbe620c4aff967363a7d48c46e6) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:16.296245 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7009927-0444-4970-ade6-b8625dbb49e0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:16.298407 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7009927-0444-4970-ade6-b8625dbb49e0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:16.302336 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787efc5-34b6-4d04-afcc-a598875e1310 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:16.304320 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787efc5-34b6-4d04-afcc-a598875e1310 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:16.305509 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 378/748] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:28:16 2022] GET /identity/v3/role_assignments?user.id=98a27dbe620c4aff967363a7d48c46e6&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=0f98a58e4d884f4aa616093ea30cb15e => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:16.328385 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-c787efc5-34b6-4d04-afcc-a598875e1310 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:16.330030 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 371/749] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:16.336155 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7009927-0444-4970-ade6-b8625dbb49e0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:16.351346 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7009927-0444-4970-ade6-b8625dbb49e0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:16.360565 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5fb13-1fc4-4bf5-8781-a095eb956650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:16.361572 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5fb13-1fc4-4bf5-8781-a095eb956650 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:16.361995 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5fb13-1fc4-4bf5-8781-a095eb956650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:16.362412 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5fb13-1fc4-4bf5-8781-a095eb956650 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:16.363444 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5fb13-1fc4-4bf5-8781-a095eb956650 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:16.363900 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5fb13-1fc4-4bf5-8781-a095eb956650 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:16.366139 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5fb13-1fc4-4bf5-8781-a095eb956650 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:16.380205 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 379/750] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:16.389133 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787efc5-34b6-4d04-afcc-a598875e1310 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:16.399759 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787efc5-34b6-4d04-afcc-a598875e1310 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:16.404734 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcda72-da76-4830-b9f7-a338d6748787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:16.405684 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcda72-da76-4830-b9f7-a338d6748787 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:16.405965 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcda72-da76-4830-b9f7-a338d6748787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:16.406235 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcda72-da76-4830-b9f7-a338d6748787 admin admin] PATH_INFO: `/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/63fe98c10e974c019e05a2f68d012ba8/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:16.408283 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcda72-da76-4830-b9f7-a338d6748787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e618c4377ec64e2e8a6d332696019fac, user_id=63fe98c10e974c019e05a2f68d012ba8, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:16.413021 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcda72-da76-4830-b9f7-a338d6748787 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:16.431166 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 372/751] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:28:16 2022] PUT /identity/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/63fe98c10e974c019e05a2f68d012ba8/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:28:17.999772 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126027d-e575-4ff2-b311-6bd81e2bce18 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:18.000444 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126027d-e575-4ff2-b311-6bd81e2bce18 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:18.000444 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126027d-e575-4ff2-b311-6bd81e2bce18 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:18.002346 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 380/752] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:18.007999 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6532f9-e1bc-49ea-93d3-9d8f003f60e3 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:18.008782 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6532f9-e1bc-49ea-93d3-9d8f003f60e3 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:18.009263 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6532f9-e1bc-49ea-93d3-9d8f003f60e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:18.031015 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-dc6532f9-e1bc-49ea-93d3-9d8f003f60e3 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:18.032455 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-dc6532f9-e1bc-49ea-93d3-9d8f003f60e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:18.103059 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 373/753] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:18 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:18.138736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126027d-e575-4ff2-b311-6bd81e2bce18 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:18.155547 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126027d-e575-4ff2-b311-6bd81e2bce18 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:18.164790 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96e9e5-e177-4ff6-a7d8-3ed1bf3afb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:18.165845 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96e9e5-e177-4ff6-a7d8-3ed1bf3afb08 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:18.166322 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96e9e5-e177-4ff6-a7d8-3ed1bf3afb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:18.166826 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96e9e5-e177-4ff6-a7d8-3ed1bf3afb08 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:18.181893 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96e9e5-e177-4ff6-a7d8-3ed1bf3afb08 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:18.189574 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-6f96e9e5-e177-4ff6-a7d8-3ed1bf3afb08 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:28:18.193454 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 381/754] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:28:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:18.198811 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6532f9-e1bc-49ea-93d3-9d8f003f60e3 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:18.212320 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6532f9-e1bc-49ea-93d3-9d8f003f60e3 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:18.222482 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26798867-eb3a-4088-ab0c-711905fb9c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:18.223140 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26798867-eb3a-4088-ab0c-711905fb9c47 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:18.223418 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26798867-eb3a-4088-ab0c-711905fb9c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:18.223689 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26798867-eb3a-4088-ab0c-711905fb9c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:18.224448 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26798867-eb3a-4088-ab0c-711905fb9c47 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:18.224746 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26798867-eb3a-4088-ab0c-711905fb9c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:18.226353 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26798867-eb3a-4088-ab0c-711905fb9c47 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:18.243465 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 374/755] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:28:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:18.249552 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96e9e5-e177-4ff6-a7d8-3ed1bf3afb08 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:18.261858 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96e9e5-e177-4ff6-a7d8-3ed1bf3afb08 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:18.272563 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48818336-fa3a-48af-aad9-ff32cedcb616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:18.273639 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48818336-fa3a-48af-aad9-ff32cedcb616 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:18.274131 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48818336-fa3a-48af-aad9-ff32cedcb616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:18.274600 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48818336-fa3a-48af-aad9-ff32cedcb616 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:18.288786 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48818336-fa3a-48af-aad9-ff32cedcb616 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:18.290951 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48818336-fa3a-48af-aad9-ff32cedcb616 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:18.310806 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-48818336-fa3a-48af-aad9-ff32cedcb616 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:18.312273 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 382/756] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:18.317798 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26798867-eb3a-4088-ab0c-711905fb9c47 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:18.335283 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26798867-eb3a-4088-ab0c-711905fb9c47 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:18.349625 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048f601-9b42-4a18-97d9-3e8428d2f8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:18.350291 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048f601-9b42-4a18-97d9-3e8428d2f8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:18.350568 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048f601-9b42-4a18-97d9-3e8428d2f8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:18.350840 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048f601-9b42-4a18-97d9-3e8428d2f8a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:18.351586 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048f601-9b42-4a18-97d9-3e8428d2f8a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:18.351887 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048f601-9b42-4a18-97d9-3e8428d2f8a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:18.353505 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048f601-9b42-4a18-97d9-3e8428d2f8a6 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:18.371598 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 375/757] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:18.376929 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48818336-fa3a-48af-aad9-ff32cedcb616 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:18.390593 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48818336-fa3a-48af-aad9-ff32cedcb616 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:18.396499 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b9df3-b510-4ddc-8884-70e1080d23aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:18.401682 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b9df3-b510-4ddc-8884-70e1080d23aa admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:18.402191 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b9df3-b510-4ddc-8884-70e1080d23aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:18.402662 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b9df3-b510-4ddc-8884-70e1080d23aa admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:18.412481 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b9df3-b510-4ddc-8884-70e1080d23aa admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:18.414799 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b9df3-b510-4ddc-8884-70e1080d23aa admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:18.433088 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-8a2b9df3-b510-4ddc-8884-70e1080d23aa admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 09 04:28:18.434965 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 383/758] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:28:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:18.440197 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048f601-9b42-4a18-97d9-3e8428d2f8a6 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:18.455299 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048f601-9b42-4a18-97d9-3e8428d2f8a6 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:18.469624 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c5746-74c7-41c3-96b3-f3ba4048d1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:18.470301 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c5746-74c7-41c3-96b3-f3ba4048d1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:18.470584 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c5746-74c7-41c3-96b3-f3ba4048d1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:18.470853 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c5746-74c7-41c3-96b3-f3ba4048d1a3 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:18.471707 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c5746-74c7-41c3-96b3-f3ba4048d1a3 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:18.472014 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c5746-74c7-41c3-96b3-f3ba4048d1a3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:18.473882 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c5746-74c7-41c3-96b3-f3ba4048d1a3 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:18.500383 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 376/759] 10.222.0.36 () {56 vars in 1156 bytes} [Wed Feb 9 04:28:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:18.506387 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b9df3-b510-4ddc-8884-70e1080d23aa admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:18.522052 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b9df3-b510-4ddc-8884-70e1080d23aa admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:18.532118 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986d08b-eb85-4415-aad4-c9625b43b116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:18.533158 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986d08b-eb85-4415-aad4-c9625b43b116 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:18.533641 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986d08b-eb85-4415-aad4-c9625b43b116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:18.534111 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986d08b-eb85-4415-aad4-c9625b43b116 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:18.553096 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986d08b-eb85-4415-aad4-c9625b43b116 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:18.555286 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986d08b-eb85-4415-aad4-c9625b43b116 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:18.576138 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 384/760] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:18 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:28:18.581812 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c5746-74c7-41c3-96b3-f3ba4048d1a3 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:18.600279 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c5746-74c7-41c3-96b3-f3ba4048d1a3 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:18.615574 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef293c-77ce-4b65-b275-da97ce67e431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:18.616371 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef293c-77ce-4b65-b275-da97ce67e431 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:18.616652 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef293c-77ce-4b65-b275-da97ce67e431 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:18.616927 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef293c-77ce-4b65-b275-da97ce67e431 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:18.635023 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef293c-77ce-4b65-b275-da97ce67e431 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:18.636851 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef293c-77ce-4b65-b275-da97ce67e431 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:18.643916 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406f6e-0c45-40aa-9ed9-c9b7de82ac73 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:18.644452 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406f6e-0c45-40aa-9ed9-c9b7de82ac73 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:18.644942 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa406f6e-0c45-40aa-9ed9-c9b7de82ac73 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:18.647240 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 385/761] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:18.652213 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec29b5-55ca-476d-b69e-6ee566c76dff None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:18.652498 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec29b5-55ca-476d-b69e-6ee566c76dff None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:18.652767 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec29b5-55ca-476d-b69e-6ee566c76dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:18.659946 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-67ef293c-77ce-4b65-b275-da97ce67e431 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:18.661926 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 377/762] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:18.673407 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef293c-77ce-4b65-b275-da97ce67e431 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:18.683799 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-48ec29b5-55ca-476d-b69e-6ee566c76dff None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:18.684462 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef293c-77ce-4b65-b275-da97ce67e431 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:18.685107 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-48ec29b5-55ca-476d-b69e-6ee566c76dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:18.697774 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf8e1d-82af-4d07-aa5f-c9340652e70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:18.698990 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf8e1d-82af-4d07-aa5f-c9340652e70a admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:18.699276 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf8e1d-82af-4d07-aa5f-c9340652e70a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:18.699551 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf8e1d-82af-4d07-aa5f-c9340652e70a admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:18.701716 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf8e1d-82af-4d07-aa5f-c9340652e70a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:18.702025 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf8e1d-82af-4d07-aa5f-c9340652e70a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:18.703282 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 386/763] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:18 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:18.704653 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf8e1d-82af-4d07-aa5f-c9340652e70a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:18.724488 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 378/764] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:18.726592 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec29b5-55ca-476d-b69e-6ee566c76dff None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:18.737976 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec29b5-55ca-476d-b69e-6ee566c76dff None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:18.741525 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf8e1d-82af-4d07-aa5f-c9340652e70a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:18.747773 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba669a-0376-4b1c-9bcd-2cdf17d2c72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:18.748561 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba669a-0376-4b1c-9bcd-2cdf17d2c72a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:18.748838 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba669a-0376-4b1c-9bcd-2cdf17d2c72a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:18.749198 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba669a-0376-4b1c-9bcd-2cdf17d2c72a admin admin] PATH_INFO: `/v3/services/network` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:18.749866 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba669a-0376-4b1c-9bcd-2cdf17d2c72a admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:18.750951 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-c4ba669a-0376-4b1c-9bcd-2cdf17d2c72a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:28:18.750951 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 09 04:28:18.750951 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: Feb 09 04:28:18.751827 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba669a-0376-4b1c-9bcd-2cdf17d2c72a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:18.759301 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf8e1d-82af-4d07-aa5f-c9340652e70a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:18.769046 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3eb37-7f26-499b-87b5-fc4eee78ee6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:18.771079 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3eb37-7f26-499b-87b5-fc4eee78ee6c admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:18.771360 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3eb37-7f26-499b-87b5-fc4eee78ee6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:18.773727 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e3eb37-7f26-499b-87b5-fc4eee78ee6c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:18.777876 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-c4ba669a-0376-4b1c-9bcd-2cdf17d2c72a admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 09 04:28:18.780568 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 387/765] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:18 2022] GET /identity/v3/services/network => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:18.786704 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3eb37-7f26-499b-87b5-fc4eee78ee6c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:18.789033 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e3eb37-7f26-499b-87b5-fc4eee78ee6c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:18.790184 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba669a-0376-4b1c-9bcd-2cdf17d2c72a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:18.803619 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-e4e3eb37-7f26-499b-87b5-fc4eee78ee6c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:18.805178 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 379/766] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:18.807105 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba669a-0376-4b1c-9bcd-2cdf17d2c72a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:18.814296 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3eb37-7f26-499b-87b5-fc4eee78ee6c admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:18.821541 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a862b-3b68-45be-b699-3cc38fdc5ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:18.822257 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a862b-3b68-45be-b699-3cc38fdc5ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:18.822537 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a862b-3b68-45be-b699-3cc38fdc5ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:18.822813 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a862b-3b68-45be-b699-3cc38fdc5ef9 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:18.823592 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a862b-3b68-45be-b699-3cc38fdc5ef9 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:18.823895 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a862b-3b68-45be-b699-3cc38fdc5ef9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:18.827585 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a862b-3b68-45be-b699-3cc38fdc5ef9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:18.832626 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e3eb37-7f26-499b-87b5-fc4eee78ee6c admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:18.837166 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 388/767] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Feb 9 04:28:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:18.840079 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bbb00-e467-4317-b463-20de6870d62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:18.841431 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bbb00-e467-4317-b463-20de6870d62b admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:18.841783 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bbb00-e467-4317-b463-20de6870d62b admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:18.842059 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bbb00-e467-4317-b463-20de6870d62b admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:18.842856 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bbb00-e467-4317-b463-20de6870d62b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:18.843206 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bbb00-e467-4317-b463-20de6870d62b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:18.845036 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a862b-3b68-45be-b699-3cc38fdc5ef9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:18.853196 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bbb00-e467-4317-b463-20de6870d62b admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:18.857123 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a862b-3b68-45be-b699-3cc38fdc5ef9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:18.869610 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23730a9-0197-4104-830c-eeff58ef807f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:18.870342 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23730a9-0197-4104-830c-eeff58ef807f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:18.870622 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23730a9-0197-4104-830c-eeff58ef807f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:18.870895 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23730a9-0197-4104-830c-eeff58ef807f admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:18.871955 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23730a9-0197-4104-830c-eeff58ef807f admin admin] RBAC: Adding query filter params (type=network) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:18.874145 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23730a9-0197-4104-830c-eeff58ef807f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:18.875899 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23730a9-0197-4104-830c-eeff58ef807f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:18.877260 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 380/768] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:18.883387 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bbb00-e467-4317-b463-20de6870d62b admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:18.893035 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 389/769] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Feb 9 04:28:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:18.897594 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23730a9-0197-4104-830c-eeff58ef807f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:18.907215 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bbb00-e467-4317-b463-20de6870d62b admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:18.915739 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23730a9-0197-4104-830c-eeff58ef807f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:18.916450 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce7821-e2ca-4c36-be86-9b271e633046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:18.917169 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce7821-e2ca-4c36-be86-9b271e633046 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:18.917446 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce7821-e2ca-4c36-be86-9b271e633046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:18.917717 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce7821-e2ca-4c36-be86-9b271e633046 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:18.920017 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce7821-e2ca-4c36-be86-9b271e633046 admin admin] RBAC: Adding query filter params (role.id=05ca9a16ef2a450b8cc73ade47f5c7d0, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=66fd482451f743cdb692677e57508764) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:18.920334 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce7821-e2ca-4c36-be86-9b271e633046 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:18.923665 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce7821-e2ca-4c36-be86-9b271e633046 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:18.927612 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f8c0e-2688-4f09-b1c4-f90d2c805b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:18.928307 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f8c0e-2688-4f09-b1c4-f90d2c805b9d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:18.928586 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f8c0e-2688-4f09-b1c4-f90d2c805b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:18.928856 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f8c0e-2688-4f09-b1c4-f90d2c805b9d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:18.929733 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f8c0e-2688-4f09-b1c4-f90d2c805b9d admin admin] RBAC: Adding query filter params (interface=public, service_id=9d43e036688c47e4a809d3696f441b67, region_id=RegionOne) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:18.930038 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f8c0e-2688-4f09-b1c4-f90d2c805b9d admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:18.931987 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-594f8c0e-2688-4f09-b1c4-f90d2c805b9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:28:18.931987 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 09 04:28:18.931987 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: Feb 09 04:28:18.933865 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f8c0e-2688-4f09-b1c4-f90d2c805b9d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:18.937468 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 381/770] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:28:18 2022] GET /identity/v3/role_assignments?user.id=66fd482451f743cdb692677e57508764&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 259 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:18.953141 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 390/771] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Feb 9 04:28:18 2022] GET /identity/v3/endpoints?service_id=9d43e036688c47e4a809d3696f441b67&interface=public®ion_id=RegionOne => generated 194 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:18.958720 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce7821-e2ca-4c36-be86-9b271e633046 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:18.974727 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce7821-e2ca-4c36-be86-9b271e633046 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:18.982121 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6aabbc-356f-4e53-971b-4509cedcbaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:18.982856 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6aabbc-356f-4e53-971b-4509cedcbaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:18.983137 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6aabbc-356f-4e53-971b-4509cedcbaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:18.983408 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6aabbc-356f-4e53-971b-4509cedcbaf8 admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:18.984154 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6aabbc-356f-4e53-971b-4509cedcbaf8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:18.985850 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6aabbc-356f-4e53-971b-4509cedcbaf8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:18.994419 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 382/772] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Feb 9 04:28:18 2022] GET /identity/v3/services => generated 772 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:19.007586 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf04f1-077a-42bb-bcc9-8e345fa13e48 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.008683 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf04f1-077a-42bb-bcc9-8e345fa13e48 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.009225 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf04f1-077a-42bb-bcc9-8e345fa13e48 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.011316 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 391/773] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:19.018485 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932a149-c1d2-4e24-97b7-8b70bf64a571 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.019456 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932a149-c1d2-4e24-97b7-8b70bf64a571 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.019954 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932a149-c1d2-4e24-97b7-8b70bf64a571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.040422 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-2932a149-c1d2-4e24-97b7-8b70bf64a571 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:19.042250 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-2932a149-c1d2-4e24-97b7-8b70bf64a571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:19.057053 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 383/774] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:19 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:19.103696 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf04f1-077a-42bb-bcc9-8e345fa13e48 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.124200 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf04f1-077a-42bb-bcc9-8e345fa13e48 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.129976 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e4794-428a-47c9-b36d-918e8efdfebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.131215 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e4794-428a-47c9-b36d-918e8efdfebc admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.131719 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e4794-428a-47c9-b36d-918e8efdfebc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.132246 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e4794-428a-47c9-b36d-918e8efdfebc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.152297 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89e4794-428a-47c9-b36d-918e8efdfebc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:19.159951 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-b89e4794-428a-47c9-b36d-918e8efdfebc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 09 04:28:19.161450 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 392/775] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:19.167877 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932a149-c1d2-4e24-97b7-8b70bf64a571 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.181360 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932a149-c1d2-4e24-97b7-8b70bf64a571 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.186756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87b059-997c-4bf8-ad8e-1afd2f7b477f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.187756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87b059-997c-4bf8-ad8e-1afd2f7b477f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.188245 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87b059-997c-4bf8-ad8e-1afd2f7b477f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.188715 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87b059-997c-4bf8-ad8e-1afd2f7b477f admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.189700 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87b059-997c-4bf8-ad8e-1afd2f7b477f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:19.190204 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87b059-997c-4bf8-ad8e-1afd2f7b477f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.192057 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87b059-997c-4bf8-ad8e-1afd2f7b477f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.198879 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03914175-e8d1-4596-b264-b01f18e167ae None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.199460 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03914175-e8d1-4596-b264-b01f18e167ae None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.199978 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03914175-e8d1-4596-b264-b01f18e167ae None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.202640 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 393/776] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:28:19.208183 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553cc26-a8ea-4a16-b089-2ba81a775614 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.208743 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553cc26-a8ea-4a16-b089-2ba81a775614 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.209250 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553cc26-a8ea-4a16-b089-2ba81a775614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.217741 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 384/777] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:19.224467 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87b059-997c-4bf8-ad8e-1afd2f7b477f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.240634 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87b059-997c-4bf8-ad8e-1afd2f7b477f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.242132 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-b553cc26-a8ea-4a16-b089-2ba81a775614 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:19.244248 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b553cc26-a8ea-4a16-b089-2ba81a775614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:19.253069 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59dd826-d22e-4139-89a3-ee73c6830dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.255401 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59dd826-d22e-4139-89a3-ee73c6830dfe admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.256980 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59dd826-d22e-4139-89a3-ee73c6830dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.257498 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59dd826-d22e-4139-89a3-ee73c6830dfe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.263743 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 394/778] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:19 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:28:19.281354 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59dd826-d22e-4139-89a3-ee73c6830dfe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.283619 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59dd826-d22e-4139-89a3-ee73c6830dfe admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.287726 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553cc26-a8ea-4a16-b089-2ba81a775614 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.296971 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553cc26-a8ea-4a16-b089-2ba81a775614 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.308442 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec40387-8225-4530-8b24-47d523bd5973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.309266 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec40387-8225-4530-8b24-47d523bd5973 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.310078 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec40387-8225-4530-8b24-47d523bd5973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.310363 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec40387-8225-4530-8b24-47d523bd5973 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.311511 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-c59dd826-d22e-4139-89a3-ee73c6830dfe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:19.314548 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 385/779] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:19.319120 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59dd826-d22e-4139-89a3-ee73c6830dfe admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.332964 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec40387-8225-4530-8b24-47d523bd5973 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:19.334035 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59dd826-d22e-4139-89a3-ee73c6830dfe admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.338804 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73d577-3ae4-4a3c-8017-d790b5a8d2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.339454 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73d577-3ae4-4a3c-8017-d790b5a8d2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.339733 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73d577-3ae4-4a3c-8017-d790b5a8d2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.340004 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73d577-3ae4-4a3c-8017-d790b5a8d2f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.340737 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73d577-3ae4-4a3c-8017-d790b5a8d2f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:19.341101 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73d577-3ae4-4a3c-8017-d790b5a8d2f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.342667 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73d577-3ae4-4a3c-8017-d790b5a8d2f7 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.343258 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-6ec40387-8225-4530-8b24-47d523bd5973 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:28:19.344955 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 395/780] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:19.346260 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dee417-1d89-48a1-96e6-5437c3e1440a None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.347110 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dee417-1d89-48a1-96e6-5437c3e1440a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.347393 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dee417-1d89-48a1-96e6-5437c3e1440a None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.349520 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 396/781] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:19.355060 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cdf86-2969-48c6-8153-86fcb2c2cf8f None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.356572 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cdf86-2969-48c6-8153-86fcb2c2cf8f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.356572 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cdf86-2969-48c6-8153-86fcb2c2cf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.358666 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 386/782] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:19.358841 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73d577-3ae4-4a3c-8017-d790b5a8d2f7 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.375990 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-951cdf86-2969-48c6-8153-86fcb2c2cf8f None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:19.377181 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73d577-3ae4-4a3c-8017-d790b5a8d2f7 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.377311 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-951cdf86-2969-48c6-8153-86fcb2c2cf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:19.382205 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabb9ca-48c4-4f54-8b4a-e5d7c4fffed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.382869 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabb9ca-48c4-4f54-8b4a-e5d7c4fffed0 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.383150 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabb9ca-48c4-4f54-8b4a-e5d7c4fffed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.383427 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabb9ca-48c4-4f54-8b4a-e5d7c4fffed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.384184 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabb9ca-48c4-4f54-8b4a-e5d7c4fffed0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:19.384488 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabb9ca-48c4-4f54-8b4a-e5d7c4fffed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.386047 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 397/783] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:19 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:28:19.386163 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabb9ca-48c4-4f54-8b4a-e5d7c4fffed0 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.386846 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951cdf86-2969-48c6-8153-86fcb2c2cf8f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.397549 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951cdf86-2969-48c6-8153-86fcb2c2cf8f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.404282 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 387/784] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:19.404877 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e35a8-a79c-4af3-a787-5ad4f6d6acb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.409444 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e35a8-a79c-4af3-a787-5ad4f6d6acb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.409444 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e35a8-a79c-4af3-a787-5ad4f6d6acb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.409733 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e35a8-a79c-4af3-a787-5ad4f6d6acb7 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.410507 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabb9ca-48c4-4f54-8b4a-e5d7c4fffed0 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.419814 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e35a8-a79c-4af3-a787-5ad4f6d6acb7 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.422403 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e35a8-a79c-4af3-a787-5ad4f6d6acb7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.428323 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabb9ca-48c4-4f54-8b4a-e5d7c4fffed0 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.432861 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674afc6-9ab9-40d6-acf6-804c1d6d80af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.433676 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674afc6-9ab9-40d6-acf6-804c1d6d80af admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.433957 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674afc6-9ab9-40d6-acf6-804c1d6d80af admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.434231 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674afc6-9ab9-40d6-acf6-804c1d6d80af admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.442070 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-536e35a8-a79c-4af3-a787-5ad4f6d6acb7 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 09 04:28:19.444188 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 398/785] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:19.449436 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e35a8-a79c-4af3-a787-5ad4f6d6acb7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.450826 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674afc6-9ab9-40d6-acf6-804c1d6d80af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.452701 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674afc6-9ab9-40d6-acf6-804c1d6d80af admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.462406 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e35a8-a79c-4af3-a787-5ad4f6d6acb7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.467449 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4fd2f-3515-42d8-837f-b89c59e86987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.468283 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4fd2f-3515-42d8-837f-b89c59e86987 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.468573 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4fd2f-3515-42d8-837f-b89c59e86987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.468851 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4fd2f-3515-42d8-837f-b89c59e86987 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.469596 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4fd2f-3515-42d8-837f-b89c59e86987 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.471252 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4fd2f-3515-42d8-837f-b89c59e86987 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.477414 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-0674afc6-9ab9-40d6-acf6-804c1d6d80af admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:19.479078 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 388/786] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:19.484674 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674afc6-9ab9-40d6-acf6-804c1d6d80af admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.484813 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-a5d4fd2f-3515-42d8-837f-b89c59e86987 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 09 04:28:19.484813 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 399/787] 10.222.0.36 () {56 vars in 1150 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:19.490096 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4fd2f-3515-42d8-837f-b89c59e86987 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.495783 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674afc6-9ab9-40d6-acf6-804c1d6d80af admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.500704 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4fd2f-3515-42d8-837f-b89c59e86987 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.502223 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cff4ce-eaff-4484-8f7b-c19237def319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.503265 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cff4ce-eaff-4484-8f7b-c19237def319 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.503861 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cff4ce-eaff-4484-8f7b-c19237def319 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.504470 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cff4ce-eaff-4484-8f7b-c19237def319 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.505532 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339560e-5abc-4217-b6c3-237aff7a7631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.505884 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cff4ce-eaff-4484-8f7b-c19237def319 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:19.506262 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339560e-5abc-4217-b6c3-237aff7a7631 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.506545 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339560e-5abc-4217-b6c3-237aff7a7631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.506793 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cff4ce-eaff-4484-8f7b-c19237def319 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.506899 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339560e-5abc-4217-b6c3-237aff7a7631 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.507637 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339560e-5abc-4217-b6c3-237aff7a7631 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:19.507941 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339560e-5abc-4217-b6c3-237aff7a7631 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.509504 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cff4ce-eaff-4484-8f7b-c19237def319 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.509689 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339560e-5abc-4217-b6c3-237aff7a7631 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.526487 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 400/788] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:19.526487 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339560e-5abc-4217-b6c3-237aff7a7631 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.532812 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 389/789] 10.222.0.36 () {56 vars in 1170 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:19.533691 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cff4ce-eaff-4484-8f7b-c19237def319 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.542822 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339560e-5abc-4217-b6c3-237aff7a7631 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.549245 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea28f57-eff4-4963-90ea-5c57c4944cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.549456 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cff4ce-eaff-4484-8f7b-c19237def319 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.550967 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea28f57-eff4-4963-90ea-5c57c4944cba admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.551441 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea28f57-eff4-4963-90ea-5c57c4944cba admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.551916 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea28f57-eff4-4963-90ea-5c57c4944cba admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.552971 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea28f57-eff4-4963-90ea-5c57c4944cba admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:19.553534 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea28f57-eff4-4963-90ea-5c57c4944cba admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.555032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48e09c-cccf-4e6b-ac5f-cadb6f6a4022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.555720 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea28f57-eff4-4963-90ea-5c57c4944cba admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.556035 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48e09c-cccf-4e6b-ac5f-cadb6f6a4022 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.556422 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48e09c-cccf-4e6b-ac5f-cadb6f6a4022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.556792 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48e09c-cccf-4e6b-ac5f-cadb6f6a4022 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.562879 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 401/790] 10.222.0.36 () {56 vars in 1145 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:19.563789 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea28f57-eff4-4963-90ea-5c57c4944cba admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.570428 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48e09c-cccf-4e6b-ac5f-cadb6f6a4022 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.572341 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48e09c-cccf-4e6b-ac5f-cadb6f6a4022 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.574488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea28f57-eff4-4963-90ea-5c57c4944cba admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.579863 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf9282-8c82-4314-b569-46e078961447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.580814 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf9282-8c82-4314-b569-46e078961447 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.581308 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf9282-8c82-4314-b569-46e078961447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.581739 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf9282-8c82-4314-b569-46e078961447 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.587712 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-cd48e09c-cccf-4e6b-ac5f-cadb6f6a4022 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 09 04:28:19.589343 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 390/791] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:19.594348 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48e09c-cccf-4e6b-ac5f-cadb6f6a4022 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.598102 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf9282-8c82-4314-b569-46e078961447 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.600573 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf9282-8c82-4314-b569-46e078961447 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.604606 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48e09c-cccf-4e6b-ac5f-cadb6f6a4022 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.609752 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d80f8f-52a6-4a52-9267-d2e13ae3c2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.610754 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d80f8f-52a6-4a52-9267-d2e13ae3c2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.610985 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d80f8f-52a6-4a52-9267-d2e13ae3c2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.611359 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d80f8f-52a6-4a52-9267-d2e13ae3c2b1 admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.612177 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d80f8f-52a6-4a52-9267-d2e13ae3c2b1 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:19.612579 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d80f8f-52a6-4a52-9267-d2e13ae3c2b1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.614320 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d80f8f-52a6-4a52-9267-d2e13ae3c2b1 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.619497 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 391/792] 10.222.0.36 () {56 vars in 1145 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:19.623628 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-b6cf9282-8c82-4314-b569-46e078961447 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:19.625387 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d80f8f-52a6-4a52-9267-d2e13ae3c2b1 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.629916 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 402/793] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:19.629916 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf9282-8c82-4314-b569-46e078961447 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.639668 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d80f8f-52a6-4a52-9267-d2e13ae3c2b1 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.644042 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf9282-8c82-4314-b569-46e078961447 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.644388 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ef136-8d1a-482d-8bdc-5de2c22659a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.645127 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ef136-8d1a-482d-8bdc-5de2c22659a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.645419 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ef136-8d1a-482d-8bdc-5de2c22659a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.645695 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ef136-8d1a-482d-8bdc-5de2c22659a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.646636 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ef136-8d1a-482d-8bdc-5de2c22659a7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:19.646965 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ef136-8d1a-482d-8bdc-5de2c22659a7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.648911 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ef136-8d1a-482d-8bdc-5de2c22659a7 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.650111 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fa4e5-6211-40fe-9f2b-897aaeccca4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.651151 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fa4e5-6211-40fe-9f2b-897aaeccca4f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.652415 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fa4e5-6211-40fe-9f2b-897aaeccca4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.652894 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fa4e5-6211-40fe-9f2b-897aaeccca4f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.653955 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fa4e5-6211-40fe-9f2b-897aaeccca4f admin admin] RBAC: Adding query filter params (interface=public, service_id=1400576909414287890654049a03eac0, region_id=RegionOne) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:19.654483 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fa4e5-6211-40fe-9f2b-897aaeccca4f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.656614 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fa4e5-6211-40fe-9f2b-897aaeccca4f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.663613 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 403/794] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/endpoints?service_id=1400576909414287890654049a03eac0&interface=public®ion_id=RegionOne => generated 194 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:19.665151 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fa4e5-6211-40fe-9f2b-897aaeccca4f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.671879 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 392/795] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:19.677038 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ef136-8d1a-482d-8bdc-5de2c22659a7 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.680982 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fa4e5-6211-40fe-9f2b-897aaeccca4f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.686611 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603a9ff-0232-48da-b612-addafefae256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.687495 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603a9ff-0232-48da-b612-addafefae256 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.688002 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603a9ff-0232-48da-b612-addafefae256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.688488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603a9ff-0232-48da-b612-addafefae256 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.689126 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ef136-8d1a-482d-8bdc-5de2c22659a7 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.689671 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603a9ff-0232-48da-b612-addafefae256 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:19.690203 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603a9ff-0232-48da-b612-addafefae256 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.692066 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603a9ff-0232-48da-b612-addafefae256 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.693654 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef5627-6b76-444f-acde-c55803a324ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.694539 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef5627-6b76-444f-acde-c55803a324ec admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.694885 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef5627-6b76-444f-acde-c55803a324ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.695241 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef5627-6b76-444f-acde-c55803a324ec admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.696458 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef5627-6b76-444f-acde-c55803a324ec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.698142 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef5627-6b76-444f-acde-c55803a324ec admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.710146 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 393/796] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/services => generated 772 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:19.710146 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef5627-6b76-444f-acde-c55803a324ec admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.711217 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 404/797] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:19.719134 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603a9ff-0232-48da-b612-addafefae256 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.720427 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef5627-6b76-444f-acde-c55803a324ec admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.724920 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da488ba4-18d0-4eca-a910-d13bb2e01a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.729070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da488ba4-18d0-4eca-a910-d13bb2e01a0d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.729070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da488ba4-18d0-4eca-a910-d13bb2e01a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.729070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da488ba4-18d0-4eca-a910-d13bb2e01a0d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.735566 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603a9ff-0232-48da-b612-addafefae256 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.741036 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da488ba4-18d0-4eca-a910-d13bb2e01a0d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.741036 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da488ba4-18d0-4eca-a910-d13bb2e01a0d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.746613 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c285e-54b7-4b57-9c08-60e972e05417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.748338 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c285e-54b7-4b57-9c08-60e972e05417 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.748797 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c285e-54b7-4b57-9c08-60e972e05417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.749393 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c285e-54b7-4b57-9c08-60e972e05417 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.749702 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 394/798] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:28:19.763258 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c285e-54b7-4b57-9c08-60e972e05417 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.765775 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c285e-54b7-4b57-9c08-60e972e05417 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.776893 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da488ba4-18d0-4eca-a910-d13bb2e01a0d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.787628 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da488ba4-18d0-4eca-a910-d13bb2e01a0d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.789090 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-f81c285e-54b7-4b57-9c08-60e972e05417 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:19.790360 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 405/799] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:19.796803 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c285e-54b7-4b57-9c08-60e972e05417 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.804207 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b5a09-ea9d-4a74-a3ed-590001caac40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.805100 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b5a09-ea9d-4a74-a3ed-590001caac40 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.805509 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b5a09-ea9d-4a74-a3ed-590001caac40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.805834 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b5a09-ea9d-4a74-a3ed-590001caac40 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.807476 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c285e-54b7-4b57-9c08-60e972e05417 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.817672 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b5a09-ea9d-4a74-a3ed-590001caac40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.819566 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b5a09-ea9d-4a74-a3ed-590001caac40 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.825488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6238a97-f04e-499b-aed9-6c05fa4865bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.826214 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6238a97-f04e-499b-aed9-6c05fa4865bc admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.826493 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6238a97-f04e-499b-aed9-6c05fa4865bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.826764 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6238a97-f04e-499b-aed9-6c05fa4865bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.833297 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6238a97-f04e-499b-aed9-6c05fa4865bc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:19.833688 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6238a97-f04e-499b-aed9-6c05fa4865bc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.835657 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6238a97-f04e-499b-aed9-6c05fa4865bc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.845236 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-be8b5a09-ea9d-4a74-a3ed-590001caac40 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:19.846789 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 395/800] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:19.852688 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 406/801] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:19.853868 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b5a09-ea9d-4a74-a3ed-590001caac40 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.858783 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6238a97-f04e-499b-aed9-6c05fa4865bc admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.874975 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6238a97-f04e-499b-aed9-6c05fa4865bc admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.877810 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b5a09-ea9d-4a74-a3ed-590001caac40 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.885580 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ff91c-12ff-485d-93e2-2862a9ab53a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.886501 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ff91c-12ff-485d-93e2-2862a9ab53a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.886785 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ff91c-12ff-485d-93e2-2862a9ab53a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.887061 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ff91c-12ff-485d-93e2-2862a9ab53a2 admin admin] PATH_INFO: `/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/98a27dbe620c4aff967363a7d48c46e6/roles/0f98a58e4d884f4aa616093ea30cb15e` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.888297 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affb7a3-adfc-424e-9d55-5041bb09e7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.888957 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affb7a3-adfc-424e-9d55-5041bb09e7ca admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.889263 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affb7a3-adfc-424e-9d55-5041bb09e7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.889533 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7affb7a3-adfc-424e-9d55-5041bb09e7ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.890279 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7affb7a3-adfc-424e-9d55-5041bb09e7ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:19.890580 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7affb7a3-adfc-424e-9d55-5041bb09e7ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.892187 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7affb7a3-adfc-424e-9d55-5041bb09e7ca admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.917854 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 396/802] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:19.925233 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affb7a3-adfc-424e-9d55-5041bb09e7ca admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:19.927348 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ff91c-12ff-485d-93e2-2862a9ab53a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e618c4377ec64e2e8a6d332696019fac, user_id=98a27dbe620c4aff967363a7d48c46e6, role_id=0f98a58e4d884f4aa616093ea30cb15e)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.931149 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ff91c-12ff-485d-93e2-2862a9ab53a2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.936771 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7affb7a3-adfc-424e-9d55-5041bb09e7ca admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:19.945752 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676c39d-5458-440e-9407-956d475da746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:19.946538 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676c39d-5458-440e-9407-956d475da746 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:19.946820 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676c39d-5458-440e-9407-956d475da746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:19.947093 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676c39d-5458-440e-9407-956d475da746 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:19.953682 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 407/803] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:28:19 2022] PUT /identity/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/98a27dbe620c4aff967363a7d48c46e6/roles/0f98a58e4d884f4aa616093ea30cb15e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:28:19.958880 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676c39d-5458-440e-9407-956d475da746 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:19.960754 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676c39d-5458-440e-9407-956d475da746 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:19.982805 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-0676c39d-5458-440e-9407-956d475da746 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:19.984552 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 397/804] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:19.991634 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ff91c-12ff-485d-93e2-2862a9ab53a2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:20.077260 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ff91c-12ff-485d-93e2-2862a9ab53a2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:20.089600 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2c4a6-d553-4f27-8d40-f92a73f5f123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:20.090474 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2c4a6-d553-4f27-8d40-f92a73f5f123 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:20.091308 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2c4a6-d553-4f27-8d40-f92a73f5f123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:20.091590 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2c4a6-d553-4f27-8d40-f92a73f5f123 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:20.092422 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2c4a6-d553-4f27-8d40-f92a73f5f123 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:20.092730 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2c4a6-d553-4f27-8d40-f92a73f5f123 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:20.094721 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2c4a6-d553-4f27-8d40-f92a73f5f123 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:20.108834 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 408/805] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:20.114867 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676c39d-5458-440e-9407-956d475da746 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:20.125502 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676c39d-5458-440e-9407-956d475da746 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:20.133679 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd405a-e9ab-45b6-87e8-f7133f79cec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:20.134333 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd405a-e9ab-45b6-87e8-f7133f79cec6 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:20.134658 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd405a-e9ab-45b6-87e8-f7133f79cec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:20.134931 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd405a-e9ab-45b6-87e8-f7133f79cec6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:20.135833 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd405a-e9ab-45b6-87e8-f7133f79cec6 admin admin] RBAC: Adding query filter params (role.id=05ca9a16ef2a450b8cc73ade47f5c7d0, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=63fe98c10e974c019e05a2f68d012ba8) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:20.136142 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd405a-e9ab-45b6-87e8-f7133f79cec6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:20.138769 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd405a-e9ab-45b6-87e8-f7133f79cec6 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:20.147517 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 398/806] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:28:20 2022] GET /identity/v3/role_assignments?user.id=63fe98c10e974c019e05a2f68d012ba8&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:21.568312 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acbf54-ed9d-4e93-9ad3-c345ff7fe175 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:21.569271 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acbf54-ed9d-4e93-9ad3-c345ff7fe175 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:21.569787 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acbf54-ed9d-4e93-9ad3-c345ff7fe175 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:21.577143 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 409/807] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:21 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:21.582993 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da883540-c33f-48e2-9075-713eceaffe4f None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:21.583809 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da883540-c33f-48e2-9075-713eceaffe4f None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:21.584278 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da883540-c33f-48e2-9075-713eceaffe4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:21.607529 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-da883540-c33f-48e2-9075-713eceaffe4f None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:21.609150 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-da883540-c33f-48e2-9075-713eceaffe4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:21.617632 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 399/808] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:21 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:28:21.640739 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acbf54-ed9d-4e93-9ad3-c345ff7fe175 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:21.654135 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acbf54-ed9d-4e93-9ad3-c345ff7fe175 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:21.664271 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa98a8-83eb-46a9-b25b-13c352df5397 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:21.664850 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa98a8-83eb-46a9-b25b-13c352df5397 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:21.665353 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa98a8-83eb-46a9-b25b-13c352df5397 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:21.667309 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 400/809] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:28:21.668648 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d97e9-dbe7-436a-af56-60d35be8e224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:21.669827 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d97e9-dbe7-436a-af56-60d35be8e224 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:21.670305 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d97e9-dbe7-436a-af56-60d35be8e224 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:21.670769 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d97e9-dbe7-436a-af56-60d35be8e224 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:21.672733 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225e67d-5cda-4416-bc6b-b8146a5377df None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:21.673258 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225e67d-5cda-4416-bc6b-b8146a5377df None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:21.673361 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225e67d-5cda-4416-bc6b-b8146a5377df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:21.682291 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d97e9-dbe7-436a-af56-60d35be8e224 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:21.690371 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-b24d97e9-dbe7-436a-af56-60d35be8e224 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:28:21.692457 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 410/810] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:28:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:21.698543 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d97e9-dbe7-436a-af56-60d35be8e224 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:21.700665 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-1225e67d-5cda-4416-bc6b-b8146a5377df None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:21.702423 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-1225e67d-5cda-4416-bc6b-b8146a5377df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:21.715129 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d97e9-dbe7-436a-af56-60d35be8e224 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:21.722732 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 401/811] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:21 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:21.724754 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c6ad6-b54b-454d-b39b-1fb8ad889422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:21.725690 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c6ad6-b54b-454d-b39b-1fb8ad889422 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:21.726227 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c6ad6-b54b-454d-b39b-1fb8ad889422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:21.726695 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686c6ad6-b54b-454d-b39b-1fb8ad889422 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:21.727638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c6ad6-b54b-454d-b39b-1fb8ad889422 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:21.728134 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c6ad6-b54b-454d-b39b-1fb8ad889422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:21.729943 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686c6ad6-b54b-454d-b39b-1fb8ad889422 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:21.739085 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 411/812] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:28:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:21.744597 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225e67d-5cda-4416-bc6b-b8146a5377df None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:21.754259 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225e67d-5cda-4416-bc6b-b8146a5377df None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:21.755415 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c6ad6-b54b-454d-b39b-1fb8ad889422 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:21.767779 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27eaec-6b28-47e6-af02-47163abafd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:21.768861 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27eaec-6b28-47e6-af02-47163abafd9e admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:21.769357 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27eaec-6b28-47e6-af02-47163abafd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:21.769823 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27eaec-6b28-47e6-af02-47163abafd9e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:21.772893 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686c6ad6-b54b-454d-b39b-1fb8ad889422 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:21.786267 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27eaec-6b28-47e6-af02-47163abafd9e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:21.789553 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27eaec-6b28-47e6-af02-47163abafd9e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:21.790510 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bb03d-c4b8-4dd6-96a2-c15a4ed9b30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:21.791519 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bb03d-c4b8-4dd6-96a2-c15a4ed9b30a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:21.792005 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bb03d-c4b8-4dd6-96a2-c15a4ed9b30a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:21.792487 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bb03d-c4b8-4dd6-96a2-c15a4ed9b30a admin admin] PATH_INFO: `/v3/services/network` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:21.793374 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4bb03d-c4b8-4dd6-96a2-c15a4ed9b30a admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:21.795720 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4bb03d-c4b8-4dd6-96a2-c15a4ed9b30a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:21.815784 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-6b4bb03d-c4b8-4dd6-96a2-c15a4ed9b30a admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 09 04:28:21.826116 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 412/813] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:21 2022] GET /identity/v3/services/network => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:21.827978 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-6b27eaec-6b28-47e6-af02-47163abafd9e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:21.829426 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 402/814] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:21.834138 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bb03d-c4b8-4dd6-96a2-c15a4ed9b30a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:21.844312 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bb03d-c4b8-4dd6-96a2-c15a4ed9b30a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:21.848167 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27eaec-6b28-47e6-af02-47163abafd9e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:21.860304 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3db184-5266-4fc9-b1f0-fd6a1aa56c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:21.861317 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3db184-5266-4fc9-b1f0-fd6a1aa56c06 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:21.861794 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3db184-5266-4fc9-b1f0-fd6a1aa56c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:21.862278 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3db184-5266-4fc9-b1f0-fd6a1aa56c06 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:21.863189 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3db184-5266-4fc9-b1f0-fd6a1aa56c06 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:21.863403 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27eaec-6b28-47e6-af02-47163abafd9e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:21.863888 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3db184-5266-4fc9-b1f0-fd6a1aa56c06 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:21.865818 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3db184-5266-4fc9-b1f0-fd6a1aa56c06 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:21.871260 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 413/815] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Feb 9 04:28:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:21.876272 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f8e3d-a854-470e-ab12-cc4b5974b39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:21.876945 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f8e3d-a854-470e-ab12-cc4b5974b39a admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:21.877220 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3db184-5266-4fc9-b1f0-fd6a1aa56c06 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:21.877320 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f8e3d-a854-470e-ab12-cc4b5974b39a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:21.877516 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f8e3d-a854-470e-ab12-cc4b5974b39a admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:21.878260 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f8e3d-a854-470e-ab12-cc4b5974b39a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:21.878575 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f8e3d-a854-470e-ab12-cc4b5974b39a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:21.880148 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f8e3d-a854-470e-ab12-cc4b5974b39a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:21.887537 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3db184-5266-4fc9-b1f0-fd6a1aa56c06 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:21.892273 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367b520-1ce2-4e38-91b5-79550a868077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:21.893163 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367b520-1ce2-4e38-91b5-79550a868077 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:21.893682 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367b520-1ce2-4e38-91b5-79550a868077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:21.894186 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367b520-1ce2-4e38-91b5-79550a868077 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:21.895134 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367b520-1ce2-4e38-91b5-79550a868077 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:21.895632 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367b520-1ce2-4e38-91b5-79550a868077 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:21.897697 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9367b520-1ce2-4e38-91b5-79550a868077 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:21.898622 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 403/816] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:21.906281 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f8e3d-a854-470e-ab12-cc4b5974b39a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:21.909047 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 414/817] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Feb 9 04:28:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:21.917950 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367b520-1ce2-4e38-91b5-79550a868077 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:21.919357 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f8e3d-a854-470e-ab12-cc4b5974b39a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:21.928803 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367b520-1ce2-4e38-91b5-79550a868077 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:21.933788 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b689166-20ee-4a72-9ca5-a67fed00cc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:21.935334 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b689166-20ee-4a72-9ca5-a67fed00cc05 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:21.935861 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b689166-20ee-4a72-9ca5-a67fed00cc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:21.936327 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b689166-20ee-4a72-9ca5-a67fed00cc05 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:21.937404 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b689166-20ee-4a72-9ca5-a67fed00cc05 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:21.938777 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-6b689166-20ee-4a72-9ca5-a67fed00cc05 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:28:21.938777 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 09 04:28:21.938777 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: Feb 09 04:28:21.940004 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b689166-20ee-4a72-9ca5-a67fed00cc05 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:21.942241 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2b6a4-a9f2-40f9-bf4b-a59769c5fe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:21.943037 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2b6a4-a9f2-40f9-bf4b-a59769c5fe3d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:21.943324 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2b6a4-a9f2-40f9-bf4b-a59769c5fe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:21.943593 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2b6a4-a9f2-40f9-bf4b-a59769c5fe3d admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:21.957101 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2b6a4-a9f2-40f9-bf4b-a59769c5fe3d admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:21.959897 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2b6a4-a9f2-40f9-bf4b-a59769c5fe3d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:21.978193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 415/818] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Feb 9 04:28:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:28:21.987626 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-64c2b6a4-a9f2-40f9-bf4b-a59769c5fe3d admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 09 04:28:21.989655 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 404/819] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:28:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:21.995177 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b689166-20ee-4a72-9ca5-a67fed00cc05 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:22.024991 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b689166-20ee-4a72-9ca5-a67fed00cc05 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:22.030384 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d29e80-8bec-4e28-a439-fa540cc8d0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:22.031063 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d29e80-8bec-4e28-a439-fa540cc8d0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:22.031391 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d29e80-8bec-4e28-a439-fa540cc8d0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:22.031668 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d29e80-8bec-4e28-a439-fa540cc8d0d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:22.032640 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d29e80-8bec-4e28-a439-fa540cc8d0d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:22.033029 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d29e80-8bec-4e28-a439-fa540cc8d0d6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:22.035042 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d29e80-8bec-4e28-a439-fa540cc8d0d6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:22.055851 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 416/820] 10.222.0.36 () {56 vars in 1156 bytes} [Wed Feb 9 04:28:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:22.066070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2b6a4-a9f2-40f9-bf4b-a59769c5fe3d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:22.078298 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2b6a4-a9f2-40f9-bf4b-a59769c5fe3d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:22.083077 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599dd68f-d8d9-4d13-9620-28c51ce5cb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:22.083904 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dd68f-d8d9-4d13-9620-28c51ce5cb2e admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:22.084183 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dd68f-d8d9-4d13-9620-28c51ce5cb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:22.084453 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dd68f-d8d9-4d13-9620-28c51ce5cb2e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:22.101627 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599dd68f-d8d9-4d13-9620-28c51ce5cb2e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:22.103579 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599dd68f-d8d9-4d13-9620-28c51ce5cb2e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:22.126854 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-599dd68f-d8d9-4d13-9620-28c51ce5cb2e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:22.128125 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 405/821] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:22.134177 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d29e80-8bec-4e28-a439-fa540cc8d0d6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:22.144535 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d29e80-8bec-4e28-a439-fa540cc8d0d6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:22.151527 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37b16e-6cde-4688-86fd-e23695ac82f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:22.152279 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37b16e-6cde-4688-86fd-e23695ac82f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:22.152560 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37b16e-6cde-4688-86fd-e23695ac82f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:22.152832 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37b16e-6cde-4688-86fd-e23695ac82f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:22.154263 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37b16e-6cde-4688-86fd-e23695ac82f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:22.154572 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37b16e-6cde-4688-86fd-e23695ac82f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:22.156215 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37b16e-6cde-4688-86fd-e23695ac82f9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:22.174902 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 417/822] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:22.180200 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599dd68f-d8d9-4d13-9620-28c51ce5cb2e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:22.191236 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599dd68f-d8d9-4d13-9620-28c51ce5cb2e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:22.201174 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34581eb4-4919-4e84-9f33-0cad372dce30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:22.202108 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34581eb4-4919-4e84-9f33-0cad372dce30 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:22.202520 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34581eb4-4919-4e84-9f33-0cad372dce30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:22.202827 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34581eb4-4919-4e84-9f33-0cad372dce30 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:22.218608 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34581eb4-4919-4e84-9f33-0cad372dce30 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:22.220718 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34581eb4-4919-4e84-9f33-0cad372dce30 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:22.239505 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-34581eb4-4919-4e84-9f33-0cad372dce30 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:22.240756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 406/823] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:22.246575 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37b16e-6cde-4688-86fd-e23695ac82f9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:22.257971 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37b16e-6cde-4688-86fd-e23695ac82f9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:22.263331 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b57cf-8e02-4377-a79f-7f94ba6ea9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:22.264034 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b57cf-8e02-4377-a79f-7f94ba6ea9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:22.264315 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b57cf-8e02-4377-a79f-7f94ba6ea9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:22.264588 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b57cf-8e02-4377-a79f-7f94ba6ea9d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:22.265455 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b57cf-8e02-4377-a79f-7f94ba6ea9d8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:22.265759 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b57cf-8e02-4377-a79f-7f94ba6ea9d8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:22.267723 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b57cf-8e02-4377-a79f-7f94ba6ea9d8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:22.281711 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 418/824] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:22.287354 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34581eb4-4919-4e84-9f33-0cad372dce30 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:22.297948 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34581eb4-4919-4e84-9f33-0cad372dce30 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:22.302612 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ead66-c450-4cb7-b880-e31c80ebb318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:22.303580 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ead66-c450-4cb7-b880-e31c80ebb318 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:22.303861 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ead66-c450-4cb7-b880-e31c80ebb318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:22.304133 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ead66-c450-4cb7-b880-e31c80ebb318 admin admin] PATH_INFO: `/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/66fd482451f743cdb692677e57508764/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:22.306234 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ead66-c450-4cb7-b880-e31c80ebb318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e618c4377ec64e2e8a6d332696019fac, user_id=66fd482451f743cdb692677e57508764, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:22.309107 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ead66-c450-4cb7-b880-e31c80ebb318 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:22.328457 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 407/825] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:28:22 2022] PUT /identity/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/66fd482451f743cdb692677e57508764/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:28:22.421036 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94957c1-cae4-4333-84c8-0c8880831ea2 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:22.421383 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94957c1-cae4-4333-84c8-0c8880831ea2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:22.421642 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94957c1-cae4-4333-84c8-0c8880831ea2 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:22.423787 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 419/826] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:22.431508 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3b21d-8e0a-46a4-946c-92ff603cae5d None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:22.431508 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3b21d-8e0a-46a4-946c-92ff603cae5d None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:22.431508 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3b21d-8e0a-46a4-946c-92ff603cae5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:22.451566 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-fbc3b21d-8e0a-46a4-946c-92ff603cae5d None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:22.453036 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-fbc3b21d-8e0a-46a4-946c-92ff603cae5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:22.517188 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 408/827] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:22 2022] POST /identity/v3/auth/tokens => generated 1266 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:22.542572 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94957c1-cae4-4333-84c8-0c8880831ea2 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:22.564336 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94957c1-cae4-4333-84c8-0c8880831ea2 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:22.576619 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a6585-0c90-4f26-ac37-2ab15212fe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:22.578234 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a6585-0c90-4f26-ac37-2ab15212fe43 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:22.578765 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a6585-0c90-4f26-ac37-2ab15212fe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:22.579182 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a6585-0c90-4f26-ac37-2ab15212fe43 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:22.580066 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a6585-0c90-4f26-ac37-2ab15212fe43 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:22.581876 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a6585-0c90-4f26-ac37-2ab15212fe43 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:22.595384 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-822a6585-0c90-4f26-ac37-2ab15212fe43 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 09 04:28:22.597136 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 420/828] 10.222.0.36 () {56 vars in 1150 bytes} [Wed Feb 9 04:28:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:22.603156 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3b21d-8e0a-46a4-946c-92ff603cae5d None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:22.612736 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3b21d-8e0a-46a4-946c-92ff603cae5d None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:22.617516 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7094b0-4ae9-47ca-b13e-99f4cac74da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:22.618366 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7094b0-4ae9-47ca-b13e-99f4cac74da1 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:22.618785 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7094b0-4ae9-47ca-b13e-99f4cac74da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:22.619196 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7094b0-4ae9-47ca-b13e-99f4cac74da1 admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:22.620068 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7094b0-4ae9-47ca-b13e-99f4cac74da1 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:22.620558 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7094b0-4ae9-47ca-b13e-99f4cac74da1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:22.622409 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7094b0-4ae9-47ca-b13e-99f4cac74da1 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:22.627652 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 409/829] 10.222.0.36 () {56 vars in 1145 bytes} [Wed Feb 9 04:28:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:22.633370 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a6585-0c90-4f26-ac37-2ab15212fe43 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:22.644060 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a6585-0c90-4f26-ac37-2ab15212fe43 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:22.649044 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49958a-f794-4753-a672-bebc44baff2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:22.649894 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49958a-f794-4753-a672-bebc44baff2e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:22.650311 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49958a-f794-4753-a672-bebc44baff2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:22.650724 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49958a-f794-4753-a672-bebc44baff2e admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:22.651680 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49958a-f794-4753-a672-bebc44baff2e admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:22.652132 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49958a-f794-4753-a672-bebc44baff2e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:22.654536 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f49958a-f794-4753-a672-bebc44baff2e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:22.662746 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 421/830] 10.222.0.36 () {56 vars in 1145 bytes} [Wed Feb 9 04:28:22 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:22.668342 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7094b0-4ae9-47ca-b13e-99f4cac74da1 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:22.678617 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7094b0-4ae9-47ca-b13e-99f4cac74da1 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:22.683413 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35cdc6-a78a-4351-a010-c2047dbd057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:22.684224 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35cdc6-a78a-4351-a010-c2047dbd057b admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:22.684705 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35cdc6-a78a-4351-a010-c2047dbd057b admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:22.685140 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35cdc6-a78a-4351-a010-c2047dbd057b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:22.686108 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35cdc6-a78a-4351-a010-c2047dbd057b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:22.687298 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING py.warnings [None req-2c35cdc6-a78a-4351-a010-c2047dbd057b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:28:22.687298 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: warnings.warn(msg) Feb 09 04:28:22.687298 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: Feb 09 04:28:22.688476 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35cdc6-a78a-4351-a010-c2047dbd057b admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:22.711347 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 410/831] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Feb 9 04:28:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:28:22.820713 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57b36c-f090-40e6-8b6e-c0195d7275e3 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:22.821323 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57b36c-f090-40e6-8b6e-c0195d7275e3 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:22.821811 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f57b36c-f090-40e6-8b6e-c0195d7275e3 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:22.824241 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 422/832] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:22.830335 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e35f2-2255-47d1-b84b-e1df9af58016 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:22.830611 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e35f2-2255-47d1-b84b-e1df9af58016 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:22.830837 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e35f2-2255-47d1-b84b-e1df9af58016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:22.849807 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-435e35f2-2255-47d1-b84b-e1df9af58016 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:22.851096 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-435e35f2-2255-47d1-b84b-e1df9af58016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:22.869886 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 411/833] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:22 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:28:22.895558 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57b36c-f090-40e6-8b6e-c0195d7275e3 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:22.909159 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f57b36c-f090-40e6-8b6e-c0195d7275e3 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:22.914030 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60015315-232d-4db4-80de-e72584ae6a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:22.915047 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60015315-232d-4db4-80de-e72584ae6a3e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:22.915522 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60015315-232d-4db4-80de-e72584ae6a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:22.916062 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60015315-232d-4db4-80de-e72584ae6a3e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:22.927178 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60015315-232d-4db4-80de-e72584ae6a3e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:22.934338 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-60015315-232d-4db4-80de-e72584ae6a3e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 09 04:28:22.936514 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 423/834] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:28:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:22.942137 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e35f2-2255-47d1-b84b-e1df9af58016 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:22.951686 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e35f2-2255-47d1-b84b-e1df9af58016 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:22.956435 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b73227-2437-49c9-82ae-d88a4b843289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:22.957228 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b73227-2437-49c9-82ae-d88a4b843289 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:22.957583 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b73227-2437-49c9-82ae-d88a4b843289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:22.957934 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b73227-2437-49c9-82ae-d88a4b843289 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:22.958768 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b73227-2437-49c9-82ae-d88a4b843289 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:22.959138 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b73227-2437-49c9-82ae-d88a4b843289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:22.960795 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b73227-2437-49c9-82ae-d88a4b843289 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:22.969525 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 412/835] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Feb 9 04:28:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:22.975153 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60015315-232d-4db4-80de-e72584ae6a3e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:22.984946 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60015315-232d-4db4-80de-e72584ae6a3e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:22.989475 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc9715-89c0-42a9-85cf-18070c5cda27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:22.990252 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc9715-89c0-42a9-85cf-18070c5cda27 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:22.990531 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc9715-89c0-42a9-85cf-18070c5cda27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:22.990800 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc9715-89c0-42a9-85cf-18070c5cda27 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:23.002340 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc9715-89c0-42a9-85cf-18070c5cda27 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:23.004249 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc9715-89c0-42a9-85cf-18070c5cda27 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:23.022539 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-ecbc9715-89c0-42a9-85cf-18070c5cda27 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:23.023992 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 424/836] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:23.029421 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b73227-2437-49c9-82ae-d88a4b843289 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:23.042707 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b73227-2437-49c9-82ae-d88a4b843289 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:23.047667 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847ea62-3f81-41e4-b957-0f299e293ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:23.048533 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847ea62-3f81-41e4-b957-0f299e293ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:23.049050 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847ea62-3f81-41e4-b957-0f299e293ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:23.049504 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847ea62-3f81-41e4-b957-0f299e293ca8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:23.050435 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847ea62-3f81-41e4-b957-0f299e293ca8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:23.050975 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847ea62-3f81-41e4-b957-0f299e293ca8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:23.052809 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847ea62-3f81-41e4-b957-0f299e293ca8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:23.066038 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 413/837] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:23.071790 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc9715-89c0-42a9-85cf-18070c5cda27 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:23.083179 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc9715-89c0-42a9-85cf-18070c5cda27 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:23.088172 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51afcc0b-ff76-49bc-93c5-83e24620ee98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:23.089281 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afcc0b-ff76-49bc-93c5-83e24620ee98 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:23.089747 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afcc0b-ff76-49bc-93c5-83e24620ee98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:23.090214 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51afcc0b-ff76-49bc-93c5-83e24620ee98 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:23.098415 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afcc0b-ff76-49bc-93c5-83e24620ee98 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:23.100684 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51afcc0b-ff76-49bc-93c5-83e24620ee98 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:23.116531 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-51afcc0b-ff76-49bc-93c5-83e24620ee98 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 09 04:28:23.118396 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 425/838] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Feb 9 04:28:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:23.124649 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847ea62-3f81-41e4-b957-0f299e293ca8 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:23.134829 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847ea62-3f81-41e4-b957-0f299e293ca8 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:23.137378 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b107a8-e233-4608-991b-c0e5b5ec035b None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:23.138225 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b107a8-e233-4608-991b-c0e5b5ec035b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:23.138503 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b107a8-e233-4608-991b-c0e5b5ec035b None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:23.140511 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 426/839] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:23.141207 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43336297-a45b-4276-9d02-a10235a19aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:23.142165 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43336297-a45b-4276-9d02-a10235a19aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:23.142624 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43336297-a45b-4276-9d02-a10235a19aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:23.143121 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43336297-a45b-4276-9d02-a10235a19aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:23.144312 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43336297-a45b-4276-9d02-a10235a19aa9 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:23.144814 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43336297-a45b-4276-9d02-a10235a19aa9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:23.145407 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0a21b-88e1-45ae-aa50-150c239206bb None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:23.145692 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0a21b-88e1-45ae-aa50-150c239206bb None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:23.145975 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0a21b-88e1-45ae-aa50-150c239206bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:23.147575 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43336297-a45b-4276-9d02-a10235a19aa9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:23.165516 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-b9f0a21b-88e1-45ae-aa50-150c239206bb None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:23.167010 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b9f0a21b-88e1-45ae-aa50-150c239206bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:23.169339 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 414/840] 10.222.0.36 () {56 vars in 1170 bytes} [Wed Feb 9 04:28:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:23.174024 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43336297-a45b-4276-9d02-a10235a19aa9 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:23.180326 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 427/841] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:23 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:28:23.184347 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43336297-a45b-4276-9d02-a10235a19aa9 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:23.189857 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4a843-8538-4afb-a05e-1853f73e70da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:23.190733 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4a843-8538-4afb-a05e-1853f73e70da admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:23.191235 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4a843-8538-4afb-a05e-1853f73e70da admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:23.191681 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4a843-8538-4afb-a05e-1853f73e70da admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:23.200611 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4a843-8538-4afb-a05e-1853f73e70da admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:23.202539 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4a843-8538-4afb-a05e-1853f73e70da admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:23.204141 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0a21b-88e1-45ae-aa50-150c239206bb None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:23.212979 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0a21b-88e1-45ae-aa50-150c239206bb None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:23.215551 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 415/842] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:23 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:28:23.219165 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382305aa-a71b-4f74-92ad-be026a0156a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:23.220371 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382305aa-a71b-4f74-92ad-be026a0156a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:23.220752 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382305aa-a71b-4f74-92ad-be026a0156a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:23.220919 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4a843-8538-4afb-a05e-1853f73e70da admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:23.221277 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382305aa-a71b-4f74-92ad-be026a0156a8 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:23.222045 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382305aa-a71b-4f74-92ad-be026a0156a8 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:23.223808 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382305aa-a71b-4f74-92ad-be026a0156a8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:23.230353 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4a843-8538-4afb-a05e-1853f73e70da admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:23.235457 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1c083-6385-4be4-88d7-c4c1b811dc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:23.236226 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1c083-6385-4be4-88d7-c4c1b811dc35 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:23.236511 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1c083-6385-4be4-88d7-c4c1b811dc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:23.236790 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1c083-6385-4be4-88d7-c4c1b811dc35 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:23.238004 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-382305aa-a71b-4f74-92ad-be026a0156a8 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 09 04:28:23.239610 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 428/843] 10.222.0.36 () {56 vars in 1153 bytes} [Wed Feb 9 04:28:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:23.245893 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382305aa-a71b-4f74-92ad-be026a0156a8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:23.251831 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1c083-6385-4be4-88d7-c4c1b811dc35 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:23.253745 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1c083-6385-4be4-88d7-c4c1b811dc35 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:23.256050 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382305aa-a71b-4f74-92ad-be026a0156a8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:23.260808 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c991a-62e0-41d8-91fb-e5c874b4b8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:23.261491 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c991a-62e0-41d8-91fb-e5c874b4b8cc admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:23.261821 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c991a-62e0-41d8-91fb-e5c874b4b8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:23.262106 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c991a-62e0-41d8-91fb-e5c874b4b8cc admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:23.262920 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c991a-62e0-41d8-91fb-e5c874b4b8cc admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:23.263230 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c991a-62e0-41d8-91fb-e5c874b4b8cc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:23.264943 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c991a-62e0-41d8-91fb-e5c874b4b8cc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:23.272590 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-6cf1c083-6385-4be4-88d7-c4c1b811dc35 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:23.274271 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 416/845] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:23.274376 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 429/845] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Feb 9 04:28:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:23.277036 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c991a-62e0-41d8-91fb-e5c874b4b8cc admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:23.279941 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1c083-6385-4be4-88d7-c4c1b811dc35 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:23.287386 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c991a-62e0-41d8-91fb-e5c874b4b8cc admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:23.289973 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1c083-6385-4be4-88d7-c4c1b811dc35 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:23.292819 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3acbc0-f89f-4805-9085-28bf0b1994f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:23.294257 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3acbc0-f89f-4805-9085-28bf0b1994f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:23.294714 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3acbc0-f89f-4805-9085-28bf0b1994f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:23.295240 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3acbc0-f89f-4805-9085-28bf0b1994f1 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:23.295626 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f264eff-6011-455b-befc-217106450174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:23.296362 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3acbc0-f89f-4805-9085-28bf0b1994f1 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:23.296477 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f264eff-6011-455b-befc-217106450174 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:23.296812 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f264eff-6011-455b-befc-217106450174 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:23.297144 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3acbc0-f89f-4805-9085-28bf0b1994f1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:23.297284 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f264eff-6011-455b-befc-217106450174 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:23.298115 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f264eff-6011-455b-befc-217106450174 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:23.298514 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f264eff-6011-455b-befc-217106450174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:23.299366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3acbc0-f89f-4805-9085-28bf0b1994f1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:23.300268 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f264eff-6011-455b-befc-217106450174 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:23.304477 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 430/846] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Feb 9 04:28:23 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:23.313259 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 417/847] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:23.318879 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3acbc0-f89f-4805-9085-28bf0b1994f1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:23.329439 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3acbc0-f89f-4805-9085-28bf0b1994f1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:23.334531 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b10e7a-551b-4e83-a006-0965be222bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:23.335557 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b10e7a-551b-4e83-a006-0965be222bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:23.336001 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b10e7a-551b-4e83-a006-0965be222bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:23.336421 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b10e7a-551b-4e83-a006-0965be222bf0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:23.344761 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b10e7a-551b-4e83-a006-0965be222bf0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:23.347045 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b10e7a-551b-4e83-a006-0965be222bf0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:23.362332 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-f9b10e7a-551b-4e83-a006-0965be222bf0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:23.363841 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 431/848] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:23.370034 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f264eff-6011-455b-befc-217106450174 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:23.381423 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f264eff-6011-455b-befc-217106450174 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:23.386596 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16822ff-9737-491c-9af7-e4820cfa3b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:23.387466 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16822ff-9737-491c-9af7-e4820cfa3b91 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:23.387881 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16822ff-9737-491c-9af7-e4820cfa3b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:23.388263 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16822ff-9737-491c-9af7-e4820cfa3b91 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:23.389280 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16822ff-9737-491c-9af7-e4820cfa3b91 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:23.389688 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16822ff-9737-491c-9af7-e4820cfa3b91 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:23.391768 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16822ff-9737-491c-9af7-e4820cfa3b91 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:23.405978 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 418/849] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:23.411858 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b10e7a-551b-4e83-a006-0965be222bf0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:23.422685 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b10e7a-551b-4e83-a006-0965be222bf0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:23.427299 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ade76c-f35b-4754-92c7-626e7e8aab51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:23.427965 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ade76c-f35b-4754-92c7-626e7e8aab51 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:23.428249 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ade76c-f35b-4754-92c7-626e7e8aab51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:23.428528 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ade76c-f35b-4754-92c7-626e7e8aab51 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:23.429430 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ade76c-f35b-4754-92c7-626e7e8aab51 admin admin] RBAC: Adding query filter params (role.id=0f98a58e4d884f4aa616093ea30cb15e, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=98a27dbe620c4aff967363a7d48c46e6) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:23.429743 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ade76c-f35b-4754-92c7-626e7e8aab51 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:23.431622 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ade76c-f35b-4754-92c7-626e7e8aab51 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:23.439006 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 432/850] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:28:23 2022] GET /identity/v3/role_assignments?user.id=98a27dbe620c4aff967363a7d48c46e6&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=0f98a58e4d884f4aa616093ea30cb15e => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:24.654700 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e6b7c-8635-413f-84f2-9829dce91444 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:24.655245 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e6b7c-8635-413f-84f2-9829dce91444 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:24.655245 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e6b7c-8635-413f-84f2-9829dce91444 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:24.657309 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 419/851] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:24.663277 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea067c1-fd1c-4053-a6fd-861688a950ba None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:24.663701 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea067c1-fd1c-4053-a6fd-861688a950ba None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:24.663907 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea067c1-fd1c-4053-a6fd-861688a950ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:24.682066 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-9ea067c1-fd1c-4053-a6fd-861688a950ba None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:24.683256 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9ea067c1-fd1c-4053-a6fd-861688a950ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:24.697117 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 433/852] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:24 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:24.714811 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e6b7c-8635-413f-84f2-9829dce91444 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:24.726924 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e6b7c-8635-413f-84f2-9829dce91444 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:24.731813 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014618b3-9c60-44c4-b41a-c6b0f3490de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:24.732585 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014618b3-9c60-44c4-b41a-c6b0f3490de4 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:24.732868 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014618b3-9c60-44c4-b41a-c6b0f3490de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:24.733177 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014618b3-9c60-44c4-b41a-c6b0f3490de4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:24.743560 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014618b3-9c60-44c4-b41a-c6b0f3490de4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:24.750939 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-014618b3-9c60-44c4-b41a-c6b0f3490de4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:28:24.756920 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 420/853] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:28:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:24.758254 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea067c1-fd1c-4053-a6fd-861688a950ba None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:24.767170 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea067c1-fd1c-4053-a6fd-861688a950ba None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:24.771708 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f13d0-caf3-491b-b670-1a185c286134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:24.772366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f13d0-caf3-491b-b670-1a185c286134 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:24.772647 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f13d0-caf3-491b-b670-1a185c286134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:24.772922 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f13d0-caf3-491b-b670-1a185c286134 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:24.773795 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f13d0-caf3-491b-b670-1a185c286134 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:24.774099 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f13d0-caf3-491b-b670-1a185c286134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:24.775701 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f13d0-caf3-491b-b670-1a185c286134 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:24.785088 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 434/854] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:28:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:24.789841 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014618b3-9c60-44c4-b41a-c6b0f3490de4 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:24.800025 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014618b3-9c60-44c4-b41a-c6b0f3490de4 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:24.804515 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a30e1-935e-4fc9-8b7c-bdff3ff3bdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:24.805315 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a30e1-935e-4fc9-8b7c-bdff3ff3bdd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:24.805594 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a30e1-935e-4fc9-8b7c-bdff3ff3bdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:24.805866 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a30e1-935e-4fc9-8b7c-bdff3ff3bdd5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:24.817198 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a30e1-935e-4fc9-8b7c-bdff3ff3bdd5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:24.819027 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3a30e1-935e-4fc9-8b7c-bdff3ff3bdd5 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:24.836387 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-ac3a30e1-935e-4fc9-8b7c-bdff3ff3bdd5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:24.842463 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 421/855] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:24.843954 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f13d0-caf3-491b-b670-1a185c286134 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:24.854053 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f13d0-caf3-491b-b670-1a185c286134 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:24.859218 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6accfd6-12a1-470e-bc81-5134c1987dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:24.859878 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6accfd6-12a1-470e-bc81-5134c1987dbc admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:24.860160 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6accfd6-12a1-470e-bc81-5134c1987dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:24.860433 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6accfd6-12a1-470e-bc81-5134c1987dbc admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:24.861213 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6accfd6-12a1-470e-bc81-5134c1987dbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:24.861523 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6accfd6-12a1-470e-bc81-5134c1987dbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:24.863131 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6accfd6-12a1-470e-bc81-5134c1987dbc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:24.879987 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 435/856] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:24.881329 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a30e1-935e-4fc9-8b7c-bdff3ff3bdd5 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:24.890893 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a30e1-935e-4fc9-8b7c-bdff3ff3bdd5 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:24.895372 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff7b4f-8ce2-495a-91c7-a48efe944c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:24.896144 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff7b4f-8ce2-495a-91c7-a48efe944c35 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:24.896420 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff7b4f-8ce2-495a-91c7-a48efe944c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:24.896690 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff7b4f-8ce2-495a-91c7-a48efe944c35 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:24.904733 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff7b4f-8ce2-495a-91c7-a48efe944c35 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:24.906791 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff7b4f-8ce2-495a-91c7-a48efe944c35 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:24.920602 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-41ff7b4f-8ce2-495a-91c7-a48efe944c35 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 09 04:28:24.926323 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 422/857] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:28:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:24.927643 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6accfd6-12a1-470e-bc81-5134c1987dbc admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:24.937909 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6accfd6-12a1-470e-bc81-5134c1987dbc admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:24.942460 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544a5b5-0a07-4f5e-a467-f22724a4f1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:24.943121 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544a5b5-0a07-4f5e-a467-f22724a4f1ba admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:24.943402 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544a5b5-0a07-4f5e-a467-f22724a4f1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:24.943676 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544a5b5-0a07-4f5e-a467-f22724a4f1ba admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:24.944532 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544a5b5-0a07-4f5e-a467-f22724a4f1ba admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:24.944858 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544a5b5-0a07-4f5e-a467-f22724a4f1ba admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:24.946718 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544a5b5-0a07-4f5e-a467-f22724a4f1ba admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:24.968768 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 436/858] 10.222.0.36 () {56 vars in 1156 bytes} [Wed Feb 9 04:28:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:24.970115 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff7b4f-8ce2-495a-91c7-a48efe944c35 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:24.979808 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff7b4f-8ce2-495a-91c7-a48efe944c35 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:24.984887 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1b8c2-4348-4bc7-9ed1-d08dc36f52f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:24.985562 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1b8c2-4348-4bc7-9ed1-d08dc36f52f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:24.985841 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1b8c2-4348-4bc7-9ed1-d08dc36f52f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:24.986113 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f1b8c2-4348-4bc7-9ed1-d08dc36f52f9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:24.993989 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1b8c2-4348-4bc7-9ed1-d08dc36f52f9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:24.995728 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f1b8c2-4348-4bc7-9ed1-d08dc36f52f9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:25.009119 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 423/859] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:24 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:28:25.011190 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544a5b5-0a07-4f5e-a467-f22724a4f1ba admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:25.020787 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544a5b5-0a07-4f5e-a467-f22724a4f1ba admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:25.025344 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fc678-499f-4f90-af1f-9d7e0ccd5ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:25.026120 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fc678-499f-4f90-af1f-9d7e0ccd5ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:25.026401 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fc678-499f-4f90-af1f-9d7e0ccd5ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:25.026677 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fc678-499f-4f90-af1f-9d7e0ccd5ed8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:25.037638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fc678-499f-4f90-af1f-9d7e0ccd5ed8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:25.039525 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fc678-499f-4f90-af1f-9d7e0ccd5ed8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:25.056597 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-e27fc678-499f-4f90-af1f-9d7e0ccd5ed8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:25.061174 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 437/860] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:25.063695 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1b8c2-4348-4bc7-9ed1-d08dc36f52f9 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:25.072670 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f1b8c2-4348-4bc7-9ed1-d08dc36f52f9 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:25.077330 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224a01d-2133-416b-aa98-53c99b8ef9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:25.077980 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224a01d-2133-416b-aa98-53c99b8ef9eb admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:25.078261 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224a01d-2133-416b-aa98-53c99b8ef9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:25.078537 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224a01d-2133-416b-aa98-53c99b8ef9eb admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:25.079277 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224a01d-2133-416b-aa98-53c99b8ef9eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:25.079580 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224a01d-2133-416b-aa98-53c99b8ef9eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:25.081199 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224a01d-2133-416b-aa98-53c99b8ef9eb admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:25.098359 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 424/861] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:25.099768 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fc678-499f-4f90-af1f-9d7e0ccd5ed8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:25.110315 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6224c-c186-477f-b6a8-b1ce4a9875ce None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:25.110653 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6224c-c186-477f-b6a8-b1ce4a9875ce None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:25.110935 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6224c-c186-477f-b6a8-b1ce4a9875ce None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:25.111257 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fc678-499f-4f90-af1f-9d7e0ccd5ed8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:25.113022 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 425/862] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:28:25.117351 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa93f63-7edf-4091-a7cc-765ed78fd572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:25.118166 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa93f63-7edf-4091-a7cc-765ed78fd572 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:25.118513 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa93f63-7edf-4091-a7cc-765ed78fd572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:25.118850 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa93f63-7edf-4091-a7cc-765ed78fd572 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:25.119241 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750a2a0-2fe0-4a6d-85db-0c3036cbd7fb None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:25.119900 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750a2a0-2fe0-4a6d-85db-0c3036cbd7fb None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:25.120316 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750a2a0-2fe0-4a6d-85db-0c3036cbd7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:25.126385 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa93f63-7edf-4091-a7cc-765ed78fd572 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:25.128427 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa93f63-7edf-4091-a7cc-765ed78fd572 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:25.138834 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-b750a2a0-2fe0-4a6d-85db-0c3036cbd7fb None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:25.140209 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-b750a2a0-2fe0-4a6d-85db-0c3036cbd7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:25.141542 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-4aa93f63-7edf-4091-a7cc-765ed78fd572 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:25.147490 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 438/863] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:25.148682 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa93f63-7edf-4091-a7cc-765ed78fd572 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:25.149499 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 426/864] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:25 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:28:25.164351 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa93f63-7edf-4091-a7cc-765ed78fd572 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:25.173865 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489aafb-2e5d-4511-9dd7-57bcc681e543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:25.174687 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489aafb-2e5d-4511-9dd7-57bcc681e543 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:25.175069 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489aafb-2e5d-4511-9dd7-57bcc681e543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:25.175448 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b489aafb-2e5d-4511-9dd7-57bcc681e543 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:25.176362 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489aafb-2e5d-4511-9dd7-57bcc681e543 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:25.176772 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489aafb-2e5d-4511-9dd7-57bcc681e543 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:25.178763 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b489aafb-2e5d-4511-9dd7-57bcc681e543 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:25.179636 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750a2a0-2fe0-4a6d-85db-0c3036cbd7fb None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:25.189159 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750a2a0-2fe0-4a6d-85db-0c3036cbd7fb None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:25.191978 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 439/865] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:25.195039 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b5a81-e8db-4a9a-b01d-9e153c20cb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:25.196052 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b5a81-e8db-4a9a-b01d-9e153c20cb00 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:25.196509 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b5a81-e8db-4a9a-b01d-9e153c20cb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:25.197024 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b5a81-e8db-4a9a-b01d-9e153c20cb00 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:25.197694 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489aafb-2e5d-4511-9dd7-57bcc681e543 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:25.198175 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b5a81-e8db-4a9a-b01d-9e153c20cb00 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:25.200099 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b5a81-e8db-4a9a-b01d-9e153c20cb00 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:25.207541 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b489aafb-2e5d-4511-9dd7-57bcc681e543 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:25.212220 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3115595-dd04-4138-a029-37e8160f874d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:25.212974 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3115595-dd04-4138-a029-37e8160f874d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:25.213373 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3115595-dd04-4138-a029-37e8160f874d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:25.213723 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3115595-dd04-4138-a029-37e8160f874d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:25.214635 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-275b5a81-e8db-4a9a-b01d-9e153c20cb00 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 09 04:28:25.214747 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3115595-dd04-4138-a029-37e8160f874d admin admin] RBAC: Adding query filter params (role.id=05ca9a16ef2a450b8cc73ade47f5c7d0, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=66fd482451f743cdb692677e57508764) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:25.215085 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3115595-dd04-4138-a029-37e8160f874d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:25.221095 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3115595-dd04-4138-a029-37e8160f874d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:25.221503 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 427/866] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Feb 9 04:28:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:25.223256 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b5a81-e8db-4a9a-b01d-9e153c20cb00 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:25.224383 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 440/867] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:28:25 2022] GET /identity/v3/role_assignments?user.id=66fd482451f743cdb692677e57508764&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:25.234301 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b5a81-e8db-4a9a-b01d-9e153c20cb00 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:25.239399 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfe19d-de1d-4deb-84db-f6dbef9be16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:25.240445 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfe19d-de1d-4deb-84db-f6dbef9be16d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:25.240955 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfe19d-de1d-4deb-84db-f6dbef9be16d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:25.241497 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfe19d-de1d-4deb-84db-f6dbef9be16d admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:25.242457 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfe19d-de1d-4deb-84db-f6dbef9be16d admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:25.242983 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfe19d-de1d-4deb-84db-f6dbef9be16d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:25.244941 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfe19d-de1d-4deb-84db-f6dbef9be16d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:25.251014 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 428/868] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Feb 9 04:28:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:25.257127 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3115595-dd04-4138-a029-37e8160f874d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:25.267813 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3115595-dd04-4138-a029-37e8160f874d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:25.272665 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3213a9-85eb-4c37-a5ca-bc65e33e7c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:25.273425 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3213a9-85eb-4c37-a5ca-bc65e33e7c16 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:25.273715 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3213a9-85eb-4c37-a5ca-bc65e33e7c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:25.273994 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3213a9-85eb-4c37-a5ca-bc65e33e7c16 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:25.274786 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3213a9-85eb-4c37-a5ca-bc65e33e7c16 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:25.275094 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3213a9-85eb-4c37-a5ca-bc65e33e7c16 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:25.276796 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3213a9-85eb-4c37-a5ca-bc65e33e7c16 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:25.283294 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 441/869] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Feb 9 04:28:25 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:25.657121 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbf000-d076-4c1d-942a-ae4c1ace743f None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:25.657659 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbf000-d076-4c1d-942a-ae4c1ace743f None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:25.657659 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbf000-d076-4c1d-942a-ae4c1ace743f None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:25.659776 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 429/870] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:25.665540 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af3301-382f-4e2a-b4d4-48921b05e694 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:25.666017 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af3301-382f-4e2a-b4d4-48921b05e694 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:25.666100 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af3301-382f-4e2a-b4d4-48921b05e694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:25.683707 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d1af3301-382f-4e2a-b4d4-48921b05e694 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:25.684921 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d1af3301-382f-4e2a-b4d4-48921b05e694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:25.697110 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 442/871] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:25 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:25.716660 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbf000-d076-4c1d-942a-ae4c1ace743f None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:25.728765 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbf000-d076-4c1d-942a-ae4c1ace743f None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:25.733146 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5c8d9-8af1-4165-94ec-26c2be91dab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:25.733795 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5c8d9-8af1-4165-94ec-26c2be91dab2 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:25.734083 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5c8d9-8af1-4165-94ec-26c2be91dab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:25.734359 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5c8d9-8af1-4165-94ec-26c2be91dab2 admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:25.735098 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5c8d9-8af1-4165-94ec-26c2be91dab2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:25.736667 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5c8d9-8af1-4165-94ec-26c2be91dab2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:25.757163 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 430/872] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Feb 9 04:28:25 2022] POST /identity/v3/services => generated 269 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:28:25.816879 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e53fd7-a15c-4658-86aa-eff8abbfd1c8 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:25.817297 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e53fd7-a15c-4658-86aa-eff8abbfd1c8 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:25.817511 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e53fd7-a15c-4658-86aa-eff8abbfd1c8 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:25.819421 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 443/873] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:28:25.825693 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d982ba-c27c-4b4a-9711-2ef526f9d2a7 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:25.826054 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d982ba-c27c-4b4a-9711-2ef526f9d2a7 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:25.826296 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d982ba-c27c-4b4a-9711-2ef526f9d2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:25.846094 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-d6d982ba-c27c-4b4a-9711-2ef526f9d2a7 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:25.847329 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-d6d982ba-c27c-4b4a-9711-2ef526f9d2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:25.869395 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 431/874] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:25 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:25.907417 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e53fd7-a15c-4658-86aa-eff8abbfd1c8 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:25.920396 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e53fd7-a15c-4658-86aa-eff8abbfd1c8 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:25.924806 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020db68-26a3-4f5c-a01f-03ed1f12b979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:25.925682 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020db68-26a3-4f5c-a01f-03ed1f12b979 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:25.925961 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020db68-26a3-4f5c-a01f-03ed1f12b979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:25.926283 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020db68-26a3-4f5c-a01f-03ed1f12b979 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:25.938587 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020db68-26a3-4f5c-a01f-03ed1f12b979 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:25.946058 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-8020db68-26a3-4f5c-a01f-03ed1f12b979 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 09 04:28:25.947635 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 444/875] 10.222.0.36 () {56 vars in 1141 bytes} [Wed Feb 9 04:28:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:25.953946 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d982ba-c27c-4b4a-9711-2ef526f9d2a7 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:25.963849 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d982ba-c27c-4b4a-9711-2ef526f9d2a7 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:25.968801 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55029e48-8b5f-467c-9926-b798540d08f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:25.969871 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55029e48-8b5f-467c-9926-b798540d08f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:25.969871 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55029e48-8b5f-467c-9926-b798540d08f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:25.970065 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55029e48-8b5f-467c-9926-b798540d08f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:25.970789 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55029e48-8b5f-467c-9926-b798540d08f7 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:25.971094 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55029e48-8b5f-467c-9926-b798540d08f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:25.972672 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55029e48-8b5f-467c-9926-b798540d08f7 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:25.981604 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 432/876] 10.222.0.36 () {56 vars in 1136 bytes} [Wed Feb 9 04:28:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:25.987784 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020db68-26a3-4f5c-a01f-03ed1f12b979 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:26.002804 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020db68-26a3-4f5c-a01f-03ed1f12b979 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:26.007561 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c36dca-111b-42b3-8f91-09f2cb604f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:26.008472 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c36dca-111b-42b3-8f91-09f2cb604f78 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:26.008963 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c36dca-111b-42b3-8f91-09f2cb604f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:26.010445 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c36dca-111b-42b3-8f91-09f2cb604f78 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:26.025846 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c36dca-111b-42b3-8f91-09f2cb604f78 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:26.027919 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c36dca-111b-42b3-8f91-09f2cb604f78 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:26.049494 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-e4c36dca-111b-42b3-8f91-09f2cb604f78 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:26.050832 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 445/877] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:26.056778 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55029e48-8b5f-467c-9926-b798540d08f7 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:26.067894 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55029e48-8b5f-467c-9926-b798540d08f7 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:26.072750 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86569bf4-5142-442f-a651-d805adcc9351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:26.074145 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86569bf4-5142-442f-a651-d805adcc9351 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:26.074917 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86569bf4-5142-442f-a651-d805adcc9351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:26.076195 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86569bf4-5142-442f-a651-d805adcc9351 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:26.078069 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86569bf4-5142-442f-a651-d805adcc9351 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:26.078739 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86569bf4-5142-442f-a651-d805adcc9351 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:26.080542 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86569bf4-5142-442f-a651-d805adcc9351 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:26.094740 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 433/878] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:26.102367 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c36dca-111b-42b3-8f91-09f2cb604f78 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:26.116376 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c36dca-111b-42b3-8f91-09f2cb604f78 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:26.124133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ba5d0-537d-4db3-8ea4-2b208742885c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:26.125287 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ba5d0-537d-4db3-8ea4-2b208742885c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:26.125767 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ba5d0-537d-4db3-8ea4-2b208742885c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:26.126186 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ba5d0-537d-4db3-8ea4-2b208742885c admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:26.135754 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ba5d0-537d-4db3-8ea4-2b208742885c admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:26.138243 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ba5d0-537d-4db3-8ea4-2b208742885c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:26.155912 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-809ba5d0-537d-4db3-8ea4-2b208742885c admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 09 04:28:26.157740 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 446/879] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Feb 9 04:28:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:26.165577 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86569bf4-5142-442f-a651-d805adcc9351 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:26.176660 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86569bf4-5142-442f-a651-d805adcc9351 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:26.181757 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7171de-150a-4a20-a9bd-ea9e9a1e65fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:26.182470 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7171de-150a-4a20-a9bd-ea9e9a1e65fa admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:26.182800 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7171de-150a-4a20-a9bd-ea9e9a1e65fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:26.183073 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7171de-150a-4a20-a9bd-ea9e9a1e65fa admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:26.185234 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7171de-150a-4a20-a9bd-ea9e9a1e65fa admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:26.185799 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7171de-150a-4a20-a9bd-ea9e9a1e65fa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:26.189449 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7171de-150a-4a20-a9bd-ea9e9a1e65fa admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:26.216094 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 434/880] 10.222.0.36 () {56 vars in 1170 bytes} [Wed Feb 9 04:28:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:26.221540 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ba5d0-537d-4db3-8ea4-2b208742885c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:26.235499 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ba5d0-537d-4db3-8ea4-2b208742885c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:26.240003 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524682e-ee6e-41e6-b141-afb879831756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:26.240649 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524682e-ee6e-41e6-b141-afb879831756 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:26.240929 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524682e-ee6e-41e6-b141-afb879831756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:26.241238 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524682e-ee6e-41e6-b141-afb879831756 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:26.251007 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524682e-ee6e-41e6-b141-afb879831756 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:26.255238 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524682e-ee6e-41e6-b141-afb879831756 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:26.264870 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 447/881] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:26 2022] GET /identity/v3/auth/tokens => generated 1562 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:28:26.270426 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7171de-150a-4a20-a9bd-ea9e9a1e65fa admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:26.282306 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7171de-150a-4a20-a9bd-ea9e9a1e65fa admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:26.286837 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6237fa-8e05-48b1-b6fe-f2b03ee431b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:26.287918 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6237fa-8e05-48b1-b6fe-f2b03ee431b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:26.288196 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6237fa-8e05-48b1-b6fe-f2b03ee431b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:26.288460 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6237fa-8e05-48b1-b6fe-f2b03ee431b9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:26.302197 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6237fa-8e05-48b1-b6fe-f2b03ee431b9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:26.304019 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6237fa-8e05-48b1-b6fe-f2b03ee431b9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:26.323563 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-6a6237fa-8e05-48b1-b6fe-f2b03ee431b9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:26.325033 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 435/882] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:26.330495 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524682e-ee6e-41e6-b141-afb879831756 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:26.341648 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524682e-ee6e-41e6-b141-afb879831756 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:26.346411 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bd975-bfda-4bcf-8911-4a5772187c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:26.347059 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bd975-bfda-4bcf-8911-4a5772187c50 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:26.347338 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bd975-bfda-4bcf-8911-4a5772187c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:26.347611 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bd975-bfda-4bcf-8911-4a5772187c50 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:26.348338 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bd975-bfda-4bcf-8911-4a5772187c50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:26.348641 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bd975-bfda-4bcf-8911-4a5772187c50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:26.350343 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bd975-bfda-4bcf-8911-4a5772187c50 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:26.364261 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 448/883] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:26.369615 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6237fa-8e05-48b1-b6fe-f2b03ee431b9 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:26.380108 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6237fa-8e05-48b1-b6fe-f2b03ee431b9 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:26.384616 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e96f45-6301-4910-8da7-f4ddaa5a0950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:26.385484 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e96f45-6301-4910-8da7-f4ddaa5a0950 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:26.385759 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e96f45-6301-4910-8da7-f4ddaa5a0950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:26.386030 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e96f45-6301-4910-8da7-f4ddaa5a0950 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:26.394631 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e96f45-6301-4910-8da7-f4ddaa5a0950 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:26.397524 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e96f45-6301-4910-8da7-f4ddaa5a0950 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:26.411190 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-90e96f45-6301-4910-8da7-f4ddaa5a0950 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:26.412940 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 436/884] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:26.421274 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bd975-bfda-4bcf-8911-4a5772187c50 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:26.431302 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bd975-bfda-4bcf-8911-4a5772187c50 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:26.436404 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03b436-7947-4945-bc76-8696be8994d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:26.437142 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03b436-7947-4945-bc76-8696be8994d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:26.437423 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03b436-7947-4945-bc76-8696be8994d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:26.437894 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03b436-7947-4945-bc76-8696be8994d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:26.439444 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03b436-7947-4945-bc76-8696be8994d1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:26.440046 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03b436-7947-4945-bc76-8696be8994d1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:26.443079 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03b436-7947-4945-bc76-8696be8994d1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:26.456173 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 449/885] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:26.463921 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e96f45-6301-4910-8da7-f4ddaa5a0950 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:26.475056 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e96f45-6301-4910-8da7-f4ddaa5a0950 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:26.479664 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245664b-8063-49b6-9bec-26f215076bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:26.480308 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245664b-8063-49b6-9bec-26f215076bfc admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:26.480639 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245664b-8063-49b6-9bec-26f215076bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:26.480917 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245664b-8063-49b6-9bec-26f215076bfc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:26.482393 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245664b-8063-49b6-9bec-26f215076bfc admin admin] RBAC: Adding query filter params (role.id=a4bddbbd5f64404a90db53f5db02078b, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=98a27dbe620c4aff967363a7d48c46e6) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:26.482697 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245664b-8063-49b6-9bec-26f215076bfc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:26.486015 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245664b-8063-49b6-9bec-26f215076bfc admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:26.493493 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 437/886] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:28:26 2022] GET /identity/v3/role_assignments?user.id=98a27dbe620c4aff967363a7d48c46e6&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=a4bddbbd5f64404a90db53f5db02078b => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:27.657391 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232db5f-e3f3-4092-8fe6-a68595b75aa2 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:27.658133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232db5f-e3f3-4092-8fe6-a68595b75aa2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:27.658133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b232db5f-e3f3-4092-8fe6-a68595b75aa2 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:27.660023 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 450/887] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:27.666872 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e655098-4028-4bfe-b6c7-e29c7c9f1615 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:27.666872 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e655098-4028-4bfe-b6c7-e29c7c9f1615 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:27.666872 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e655098-4028-4bfe-b6c7-e29c7c9f1615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:27.687015 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-7e655098-4028-4bfe-b6c7-e29c7c9f1615 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:27.688529 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7e655098-4028-4bfe-b6c7-e29c7c9f1615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:27.701103 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 438/888] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:27 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:28:27.719451 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232db5f-e3f3-4092-8fe6-a68595b75aa2 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:27.732813 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b232db5f-e3f3-4092-8fe6-a68595b75aa2 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:27.734331 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc1b4d-653e-45f0-9d22-dc9bb786942f None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:27.734625 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc1b4d-653e-45f0-9d22-dc9bb786942f None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:27.734898 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc1b4d-653e-45f0-9d22-dc9bb786942f None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:27.736926 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 439/889] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:28:27.738454 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd63d1-7813-4867-ae9a-6609f05f6325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:27.739330 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd63d1-7813-4867-ae9a-6609f05f6325 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:27.739803 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd63d1-7813-4867-ae9a-6609f05f6325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:27.740283 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd63d1-7813-4867-ae9a-6609f05f6325 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:27.741318 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd63d1-7813-4867-ae9a-6609f05f6325 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:27.741877 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6301d-342d-4ff1-9268-db38b97d0d7f None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:27.742165 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6301d-342d-4ff1-9268-db38b97d0d7f None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:27.742440 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6301d-342d-4ff1-9268-db38b97d0d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:27.743707 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd63d1-7813-4867-ae9a-6609f05f6325 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:27.765032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-2fa6301d-342d-4ff1-9268-db38b97d0d7f None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:27.765032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-2fa6301d-342d-4ff1-9268-db38b97d0d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:27.765305 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 451/890] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Feb 9 04:28:27 2022] POST /identity/v3/services => generated 251 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:28:27.783671 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 440/891] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:27 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:28:27.809926 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd63d1-7813-4867-ae9a-6609f05f6325 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:27.821304 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd63d1-7813-4867-ae9a-6609f05f6325 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:27.826299 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adcb42-e703-4b39-b5ab-72cb29649b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:27.827134 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adcb42-e703-4b39-b5ab-72cb29649b29 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:27.827418 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adcb42-e703-4b39-b5ab-72cb29649b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:27.827691 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77adcb42-e703-4b39-b5ab-72cb29649b29 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:27.828443 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adcb42-e703-4b39-b5ab-72cb29649b29 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:27.830222 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77adcb42-e703-4b39-b5ab-72cb29649b29 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:27.842611 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-77adcb42-e703-4b39-b5ab-72cb29649b29 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 09 04:28:27.844188 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 452/892] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Feb 9 04:28:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:27.850467 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6301d-342d-4ff1-9268-db38b97d0d7f None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:27.860452 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6301d-342d-4ff1-9268-db38b97d0d7f None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:27.865333 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1210f9-1bed-487c-b4d6-269adaa4a4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:27.866006 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1210f9-1bed-487c-b4d6-269adaa4a4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:27.866288 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1210f9-1bed-487c-b4d6-269adaa4a4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:27.866564 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1210f9-1bed-487c-b4d6-269adaa4a4d2 admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:27.867296 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1210f9-1bed-487c-b4d6-269adaa4a4d2 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:27.867603 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1210f9-1bed-487c-b4d6-269adaa4a4d2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:27.869228 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1210f9-1bed-487c-b4d6-269adaa4a4d2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:27.875563 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 441/893] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Feb 9 04:28:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:27.881031 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adcb42-e703-4b39-b5ab-72cb29649b29 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:27.891258 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77adcb42-e703-4b39-b5ab-72cb29649b29 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:27.897203 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7afe8b9-85e0-4c6f-9ba9-03a0496dd001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:27.897929 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afe8b9-85e0-4c6f-9ba9-03a0496dd001 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:27.898212 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afe8b9-85e0-4c6f-9ba9-03a0496dd001 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:27.898487 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7afe8b9-85e0-4c6f-9ba9-03a0496dd001 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:27.899221 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7afe8b9-85e0-4c6f-9ba9-03a0496dd001 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:27.899526 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7afe8b9-85e0-4c6f-9ba9-03a0496dd001 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:27.901244 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7afe8b9-85e0-4c6f-9ba9-03a0496dd001 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:27.907205 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 453/894] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Feb 9 04:28:27 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:28.097469 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a3315-ed32-4563-a935-c29f6a7639fe None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:28.097684 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a3315-ed32-4563-a935-c29f6a7639fe None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:28.097968 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a3315-ed32-4563-a935-c29f6a7639fe None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:28.100030 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 442/895] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:28.105492 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44805a5-b810-43ab-b580-ac2e8bb1ca22 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:28.105785 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44805a5-b810-43ab-b580-ac2e8bb1ca22 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:28.106058 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44805a5-b810-43ab-b580-ac2e8bb1ca22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:28.127699 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-f44805a5-b810-43ab-b580-ac2e8bb1ca22 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:28.128914 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f44805a5-b810-43ab-b580-ac2e8bb1ca22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:28.136677 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 454/896] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:28 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:28.161848 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a3315-ed32-4563-a935-c29f6a7639fe None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:28.175044 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a3315-ed32-4563-a935-c29f6a7639fe None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:28.179439 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98142cd-7a32-4a8d-a874-41dd825f690f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:28.180221 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98142cd-7a32-4a8d-a874-41dd825f690f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:28.180508 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98142cd-7a32-4a8d-a874-41dd825f690f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:28.180781 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98142cd-7a32-4a8d-a874-41dd825f690f admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:28.181479 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98142cd-7a32-4a8d-a874-41dd825f690f admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:28.183057 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98142cd-7a32-4a8d-a874-41dd825f690f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:28.194577 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-e98142cd-7a32-4a8d-a874-41dd825f690f admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 09 04:28:28.196059 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 443/897] 10.222.0.36 () {56 vars in 1153 bytes} [Wed Feb 9 04:28:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:28.201993 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44805a5-b810-43ab-b580-ac2e8bb1ca22 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:28.211010 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44805a5-b810-43ab-b580-ac2e8bb1ca22 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:28.216240 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74764896-b680-40b1-8748-8895b485405d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:28.216893 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74764896-b680-40b1-8748-8895b485405d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:28.217215 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74764896-b680-40b1-8748-8895b485405d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:28.217487 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74764896-b680-40b1-8748-8895b485405d admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:28.218210 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74764896-b680-40b1-8748-8895b485405d admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:28.218511 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74764896-b680-40b1-8748-8895b485405d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:28.220177 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74764896-b680-40b1-8748-8895b485405d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:28.225167 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 455/898] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Feb 9 04:28:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:28.230706 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98142cd-7a32-4a8d-a874-41dd825f690f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:28.241287 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98142cd-7a32-4a8d-a874-41dd825f690f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:28.246091 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd2e77-8a6d-4df9-97cb-bcfce080d0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:28.246819 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd2e77-8a6d-4df9-97cb-bcfce080d0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:28.247102 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd2e77-8a6d-4df9-97cb-bcfce080d0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:28.247380 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd2e77-8a6d-4df9-97cb-bcfce080d0b2 admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:28.248150 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd2e77-8a6d-4df9-97cb-bcfce080d0b2 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:28.248455 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd2e77-8a6d-4df9-97cb-bcfce080d0b2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:28.250151 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd2e77-8a6d-4df9-97cb-bcfce080d0b2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:28.256109 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 444/899] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Feb 9 04:28:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:28.261119 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74764896-b680-40b1-8748-8895b485405d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:28.271235 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74764896-b680-40b1-8748-8895b485405d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:28.276031 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d8998-8a0f-499d-9f19-7db696fb7047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:28.276677 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d8998-8a0f-499d-9f19-7db696fb7047 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:28.277029 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d8998-8a0f-499d-9f19-7db696fb7047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:28.277313 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d8998-8a0f-499d-9f19-7db696fb7047 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:28.278716 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d8998-8a0f-499d-9f19-7db696fb7047 admin admin] RBAC: Adding query filter params (interface=public, service_id=d1002c18aff9457c95e81f0e35c6d587, region_id=RegionOne) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:28.279026 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d8998-8a0f-499d-9f19-7db696fb7047 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:28.280686 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d8998-8a0f-499d-9f19-7db696fb7047 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:28.286356 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 456/900] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Feb 9 04:28:28 2022] GET /identity/v3/endpoints?service_id=d1002c18aff9457c95e81f0e35c6d587&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:28.291941 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd2e77-8a6d-4df9-97cb-bcfce080d0b2 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:28.302440 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd2e77-8a6d-4df9-97cb-bcfce080d0b2 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:28.307072 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8c8bf-0f99-4f11-9974-938fcb5b77e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:28.307775 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8c8bf-0f99-4f11-9974-938fcb5b77e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:28.308057 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8c8bf-0f99-4f11-9974-938fcb5b77e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:28.308334 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8c8bf-0f99-4f11-9974-938fcb5b77e9 admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:28.309114 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8c8bf-0f99-4f11-9974-938fcb5b77e9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:28.310845 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8c8bf-0f99-4f11-9974-938fcb5b77e9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:28.317548 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 445/901] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Feb 9 04:28:28 2022] GET /identity/v3/services => generated 1268 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:28:28.814345 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedd560-f52c-45f3-96d4-fcc6c081a69e None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:28.814850 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedd560-f52c-45f3-96d4-fcc6c081a69e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:28.814850 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedd560-f52c-45f3-96d4-fcc6c081a69e None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:28.816713 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 457/902] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:28.822257 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e66833-4ca3-4423-b66e-c4c1a9b6cd41 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:28.823124 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e66833-4ca3-4423-b66e-c4c1a9b6cd41 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:28.823610 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e66833-4ca3-4423-b66e-c4c1a9b6cd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:28.842297 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-63e66833-4ca3-4423-b66e-c4c1a9b6cd41 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:28.843779 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-63e66833-4ca3-4423-b66e-c4c1a9b6cd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:28.852017 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 446/903] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:28 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:28.875281 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcedd560-f52c-45f3-96d4-fcc6c081a69e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:28.888277 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcedd560-f52c-45f3-96d4-fcc6c081a69e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:28.893041 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ddbc3-fdd7-41a2-a092-6887460f5288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:28.894091 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ddbc3-fdd7-41a2-a092-6887460f5288 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:28.894590 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ddbc3-fdd7-41a2-a092-6887460f5288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:28.895066 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ddbc3-fdd7-41a2-a092-6887460f5288 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:28.905707 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ddbc3-fdd7-41a2-a092-6887460f5288 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:28.913846 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-101ddbc3-fdd7-41a2-a092-6887460f5288 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 09 04:28:28.915943 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 458/904] 10.222.0.36 () {56 vars in 1141 bytes} [Wed Feb 9 04:28:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:28.922177 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e66833-4ca3-4423-b66e-c4c1a9b6cd41 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:28.936298 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e66833-4ca3-4423-b66e-c4c1a9b6cd41 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:28.941284 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbb33a-6b74-4918-b3a0-027928cda095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:28.942233 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbb33a-6b74-4918-b3a0-027928cda095 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:28.942719 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbb33a-6b74-4918-b3a0-027928cda095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:28.943202 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cbb33a-6b74-4918-b3a0-027928cda095 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:28.944167 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cbb33a-6b74-4918-b3a0-027928cda095 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:28.944692 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cbb33a-6b74-4918-b3a0-027928cda095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:28.946689 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cbb33a-6b74-4918-b3a0-027928cda095 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:28.956475 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 447/905] 10.222.0.36 () {56 vars in 1136 bytes} [Wed Feb 9 04:28:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:28.962183 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ddbc3-fdd7-41a2-a092-6887460f5288 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:28.973048 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ddbc3-fdd7-41a2-a092-6887460f5288 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:28.977990 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd64a2-5af3-473d-977c-1e7375b45d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:28.979062 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd64a2-5af3-473d-977c-1e7375b45d80 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:28.979592 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd64a2-5af3-473d-977c-1e7375b45d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:28.980114 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd64a2-5af3-473d-977c-1e7375b45d80 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:28.991049 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd64a2-5af3-473d-977c-1e7375b45d80 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:28.993262 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd64a2-5af3-473d-977c-1e7375b45d80 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:29.011090 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-a8dd64a2-5af3-473d-977c-1e7375b45d80 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:29.013647 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 459/906] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:29.019629 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbb33a-6b74-4918-b3a0-027928cda095 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:29.030046 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cbb33a-6b74-4918-b3a0-027928cda095 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:29.035042 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe4c9d-3c9e-4143-b6fa-715fb9ef5c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:29.035976 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe4c9d-3c9e-4143-b6fa-715fb9ef5c23 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:29.036480 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe4c9d-3c9e-4143-b6fa-715fb9ef5c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:29.037293 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe4c9d-3c9e-4143-b6fa-715fb9ef5c23 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:29.038278 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe4c9d-3c9e-4143-b6fa-715fb9ef5c23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:29.038800 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe4c9d-3c9e-4143-b6fa-715fb9ef5c23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:29.040638 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe4c9d-3c9e-4143-b6fa-715fb9ef5c23 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:29.057417 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 448/907] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:29.059026 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd64a2-5af3-473d-977c-1e7375b45d80 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:29.069979 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd64a2-5af3-473d-977c-1e7375b45d80 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:29.075687 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c2cd5-1a1b-4971-b2c5-02b43a11586a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:29.076775 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c2cd5-1a1b-4971-b2c5-02b43a11586a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:29.077347 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c2cd5-1a1b-4971-b2c5-02b43a11586a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:29.077835 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c2cd5-1a1b-4971-b2c5-02b43a11586a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:29.085623 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c2cd5-1a1b-4971-b2c5-02b43a11586a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:29.087918 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96c2cd5-1a1b-4971-b2c5-02b43a11586a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:29.102784 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-e96c2cd5-1a1b-4971-b2c5-02b43a11586a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 09 04:28:29.104656 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 460/908] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Feb 9 04:28:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:29.110779 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe4c9d-3c9e-4143-b6fa-715fb9ef5c23 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:29.122434 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe4c9d-3c9e-4143-b6fa-715fb9ef5c23 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:29.127696 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e6794-9b41-4024-9be7-0e766794f523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:29.128639 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e6794-9b41-4024-9be7-0e766794f523 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:29.129164 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e6794-9b41-4024-9be7-0e766794f523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:29.129642 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e6794-9b41-4024-9be7-0e766794f523 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:29.130725 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e6794-9b41-4024-9be7-0e766794f523 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:29.131323 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e6794-9b41-4024-9be7-0e766794f523 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:29.133440 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e6794-9b41-4024-9be7-0e766794f523 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:29.152018 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 449/909] 10.222.0.36 () {56 vars in 1170 bytes} [Wed Feb 9 04:28:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:29.157826 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c2cd5-1a1b-4971-b2c5-02b43a11586a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:29.168333 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c2cd5-1a1b-4971-b2c5-02b43a11586a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:29.173931 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c9747-55fd-4eab-9d31-1bdacf04d41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:29.175021 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c9747-55fd-4eab-9d31-1bdacf04d41d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:29.175504 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c9747-55fd-4eab-9d31-1bdacf04d41d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:29.176066 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c9747-55fd-4eab-9d31-1bdacf04d41d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:29.187581 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c9747-55fd-4eab-9d31-1bdacf04d41d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:29.189775 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c9747-55fd-4eab-9d31-1bdacf04d41d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:29.211789 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-164c9747-55fd-4eab-9d31-1bdacf04d41d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:29.211789 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 461/910] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:29.220459 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e6794-9b41-4024-9be7-0e766794f523 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:29.237280 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e6794-9b41-4024-9be7-0e766794f523 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:29.242390 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9101e-4c91-4133-8065-0cd1583c1411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:29.243371 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9101e-4c91-4133-8065-0cd1583c1411 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:29.243821 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9101e-4c91-4133-8065-0cd1583c1411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:29.244234 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9101e-4c91-4133-8065-0cd1583c1411 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:29.245190 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9101e-4c91-4133-8065-0cd1583c1411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:29.245660 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9101e-4c91-4133-8065-0cd1583c1411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:29.247996 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9101e-4c91-4133-8065-0cd1583c1411 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:29.261452 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 450/911] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:29.267455 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c9747-55fd-4eab-9d31-1bdacf04d41d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:29.277551 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c9747-55fd-4eab-9d31-1bdacf04d41d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:29.282594 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa8efe-266b-4dc8-b410-73e2ae9e613c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:29.283576 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa8efe-266b-4dc8-b410-73e2ae9e613c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:29.284089 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa8efe-266b-4dc8-b410-73e2ae9e613c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:29.284568 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa8efe-266b-4dc8-b410-73e2ae9e613c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:29.292240 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa8efe-266b-4dc8-b410-73e2ae9e613c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:29.294946 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa8efe-266b-4dc8-b410-73e2ae9e613c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:29.308441 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-4baa8efe-266b-4dc8-b410-73e2ae9e613c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:29.310701 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 462/912] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:29.316426 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9101e-4c91-4133-8065-0cd1583c1411 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:29.326610 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9101e-4c91-4133-8065-0cd1583c1411 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:29.331420 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6d8d8-c0ff-4e70-87f0-3140af0c5d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:29.332233 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6d8d8-c0ff-4e70-87f0-3140af0c5d25 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:29.332683 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6d8d8-c0ff-4e70-87f0-3140af0c5d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:29.333130 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6d8d8-c0ff-4e70-87f0-3140af0c5d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:29.334110 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6d8d8-c0ff-4e70-87f0-3140af0c5d25 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:29.334572 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6d8d8-c0ff-4e70-87f0-3140af0c5d25 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:29.336689 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6d8d8-c0ff-4e70-87f0-3140af0c5d25 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:29.349817 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 451/913] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:29.355742 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa8efe-266b-4dc8-b410-73e2ae9e613c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:29.367410 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa8efe-266b-4dc8-b410-73e2ae9e613c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:29.372770 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79297f-ff3f-438a-9d2e-f4e1c8e542ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:29.373886 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79297f-ff3f-438a-9d2e-f4e1c8e542ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:29.374307 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79297f-ff3f-438a-9d2e-f4e1c8e542ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:29.374774 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79297f-ff3f-438a-9d2e-f4e1c8e542ca admin admin] PATH_INFO: `/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/98a27dbe620c4aff967363a7d48c46e6/roles/a4bddbbd5f64404a90db53f5db02078b` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:29.377176 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79297f-ff3f-438a-9d2e-f4e1c8e542ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=e618c4377ec64e2e8a6d332696019fac, user_id=98a27dbe620c4aff967363a7d48c46e6, role_id=a4bddbbd5f64404a90db53f5db02078b)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:29.380066 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79297f-ff3f-438a-9d2e-f4e1c8e542ca admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:29.399354 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 463/914] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:28:29 2022] PUT /identity/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/98a27dbe620c4aff967363a7d48c46e6/roles/a4bddbbd5f64404a90db53f5db02078b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:28:30.027327 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec13146-da1a-48de-b1f8-fec96de3af4e None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:30.027857 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec13146-da1a-48de-b1f8-fec96de3af4e None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:30.027857 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec13146-da1a-48de-b1f8-fec96de3af4e None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:30.030627 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 452/915] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:30.036746 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8f074-d122-4924-9d3a-edd0bf9a7aa0 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:30.037535 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8f074-d122-4924-9d3a-edd0bf9a7aa0 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:30.037608 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8f074-d122-4924-9d3a-edd0bf9a7aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:30.055283 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-05c8f074-d122-4924-9d3a-edd0bf9a7aa0 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:30.056457 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-05c8f074-d122-4924-9d3a-edd0bf9a7aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:30.117784 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 464/916] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:30 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:28:30.141599 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec13146-da1a-48de-b1f8-fec96de3af4e None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:30.154391 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec13146-da1a-48de-b1f8-fec96de3af4e None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:30.158660 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1707629-1cb7-4785-8419-b87b5fb9968d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:30.159432 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1707629-1cb7-4785-8419-b87b5fb9968d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:30.159709 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1707629-1cb7-4785-8419-b87b5fb9968d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:30.159980 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1707629-1cb7-4785-8419-b87b5fb9968d admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:30.160637 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1707629-1cb7-4785-8419-b87b5fb9968d admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:30.162516 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1707629-1cb7-4785-8419-b87b5fb9968d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:30.173490 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-e1707629-1cb7-4785-8419-b87b5fb9968d admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 09 04:28:30.179529 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 453/917] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Feb 9 04:28:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:30.180876 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8f074-d122-4924-9d3a-edd0bf9a7aa0 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:30.190380 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8f074-d122-4924-9d3a-edd0bf9a7aa0 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:30.196628 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d496082-7923-450b-9140-2d021adc21f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:30.198011 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d496082-7923-450b-9140-2d021adc21f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:30.198420 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d496082-7923-450b-9140-2d021adc21f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:30.198751 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d496082-7923-450b-9140-2d021adc21f6 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:30.199483 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d496082-7923-450b-9140-2d021adc21f6 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:30.200627 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d496082-7923-450b-9140-2d021adc21f6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:30.202294 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d496082-7923-450b-9140-2d021adc21f6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:30.207924 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 465/918] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Feb 9 04:28:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:30.213511 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1707629-1cb7-4785-8419-b87b5fb9968d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:30.224034 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1707629-1cb7-4785-8419-b87b5fb9968d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:30.228824 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e230dd-47a6-4584-9b72-11132f39324d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:30.229722 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e230dd-47a6-4584-9b72-11132f39324d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:30.230228 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e230dd-47a6-4584-9b72-11132f39324d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:30.230716 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e230dd-47a6-4584-9b72-11132f39324d admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:30.231688 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e230dd-47a6-4584-9b72-11132f39324d admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:30.232185 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e230dd-47a6-4584-9b72-11132f39324d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:30.233992 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e230dd-47a6-4584-9b72-11132f39324d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:30.244204 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 454/919] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Feb 9 04:28:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:30.245774 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d496082-7923-450b-9140-2d021adc21f6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:30.256585 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d496082-7923-450b-9140-2d021adc21f6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:30.261918 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeba9c4-dd04-4e4f-b832-1aab760e13d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:30.263424 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeba9c4-dd04-4e4f-b832-1aab760e13d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:30.263897 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeba9c4-dd04-4e4f-b832-1aab760e13d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:30.264356 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeba9c4-dd04-4e4f-b832-1aab760e13d9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:30.265445 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeba9c4-dd04-4e4f-b832-1aab760e13d9 admin admin] RBAC: Adding query filter params (interface=public, service_id=96c2269229e6485a8fd06b58afda43b5, region_id=RegionOne) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:30.265946 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeba9c4-dd04-4e4f-b832-1aab760e13d9 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:30.267820 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeba9c4-dd04-4e4f-b832-1aab760e13d9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:30.277129 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 466/920] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Feb 9 04:28:30 2022] GET /identity/v3/endpoints?service_id=96c2269229e6485a8fd06b58afda43b5&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:30.279493 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e230dd-47a6-4584-9b72-11132f39324d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:30.290013 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e230dd-47a6-4584-9b72-11132f39324d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:30.295070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3910c0-9239-4af0-8462-ad8eb8202dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:30.296135 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3910c0-9239-4af0-8462-ad8eb8202dae admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:30.296613 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3910c0-9239-4af0-8462-ad8eb8202dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:30.297131 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3910c0-9239-4af0-8462-ad8eb8202dae admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:30.298282 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3910c0-9239-4af0-8462-ad8eb8202dae admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:30.299835 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e701f-0f6b-44de-a3f7-4d3cfa586802 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:30.300128 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e701f-0f6b-44de-a3f7-4d3cfa586802 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:30.300409 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e701f-0f6b-44de-a3f7-4d3cfa586802 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:30.300936 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3910c0-9239-4af0-8462-ad8eb8202dae admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:30.302828 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 467/921] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:30.308747 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15d576-5912-404c-8053-cc16df2b9438 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:30.309071 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15d576-5912-404c-8053-cc16df2b9438 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:30.309879 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf15d576-5912-404c-8053-cc16df2b9438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:30.311706 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 455/922] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Feb 9 04:28:30 2022] GET /identity/v3/services => generated 1268 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:28:30.330241 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-bf15d576-5912-404c-8053-cc16df2b9438 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:30.331510 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-bf15d576-5912-404c-8053-cc16df2b9438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:30.340556 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 468/923] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:30 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:30.364606 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3910c0-9239-4af0-8462-ad8eb8202dae admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:30.375846 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3910c0-9239-4af0-8462-ad8eb8202dae admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:30.381155 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ea79f-ba8a-4c25-9716-d4d37f262405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:30.382284 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ea79f-ba8a-4c25-9716-d4d37f262405 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:30.382859 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ea79f-ba8a-4c25-9716-d4d37f262405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:30.383356 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ea79f-ba8a-4c25-9716-d4d37f262405 admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:30.384696 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ea79f-ba8a-4c25-9716-d4d37f262405 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:30.388309 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ea79f-ba8a-4c25-9716-d4d37f262405 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:30.407655 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 456/924] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Feb 9 04:28:30 2022] POST /identity/v3/services => generated 241 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:28:30.588225 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7869275-5bba-4225-8039-3cf693600496 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:30.588575 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7869275-5bba-4225-8039-3cf693600496 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:30.588779 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7869275-5bba-4225-8039-3cf693600496 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:30.590950 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 469/925] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:30.596114 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481b055-4df4-4e01-93f0-526e12adc5ff None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:30.596614 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481b055-4df4-4e01-93f0-526e12adc5ff None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:30.597092 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481b055-4df4-4e01-93f0-526e12adc5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:30.616558 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-2481b055-4df4-4e01-93f0-526e12adc5ff None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:30.618159 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-2481b055-4df4-4e01-93f0-526e12adc5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:30.636899 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 457/926] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:30 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:30.662179 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7869275-5bba-4225-8039-3cf693600496 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:30.679575 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7869275-5bba-4225-8039-3cf693600496 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:30.684243 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a31334-6cfb-42d5-84c2-8d259e91141b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:30.685559 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a31334-6cfb-42d5-84c2-8d259e91141b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:30.685910 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a31334-6cfb-42d5-84c2-8d259e91141b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:30.686251 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a31334-6cfb-42d5-84c2-8d259e91141b admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:30.686987 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a31334-6cfb-42d5-84c2-8d259e91141b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:30.688717 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a31334-6cfb-42d5-84c2-8d259e91141b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:30.700473 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-a2a31334-6cfb-42d5-84c2-8d259e91141b admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 09 04:28:30.702119 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 470/927] 10.222.0.36 () {56 vars in 1153 bytes} [Wed Feb 9 04:28:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:30.708068 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481b055-4df4-4e01-93f0-526e12adc5ff None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:30.717732 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481b055-4df4-4e01-93f0-526e12adc5ff None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:30.722684 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe55a79-a2dc-4a30-a5a1-e91a1df96eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:30.723645 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe55a79-a2dc-4a30-a5a1-e91a1df96eea admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:30.724131 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe55a79-a2dc-4a30-a5a1-e91a1df96eea admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:30.724646 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe55a79-a2dc-4a30-a5a1-e91a1df96eea admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:30.725674 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe55a79-a2dc-4a30-a5a1-e91a1df96eea admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:30.726183 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe55a79-a2dc-4a30-a5a1-e91a1df96eea admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:30.728075 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe55a79-a2dc-4a30-a5a1-e91a1df96eea admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:30.734161 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 458/928] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Feb 9 04:28:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:30.739846 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a31334-6cfb-42d5-84c2-8d259e91141b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:30.750972 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a31334-6cfb-42d5-84c2-8d259e91141b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:30.755895 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21a633-cf0c-442a-b087-55e5e38d357a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:30.756846 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21a633-cf0c-442a-b087-55e5e38d357a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:30.757363 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21a633-cf0c-442a-b087-55e5e38d357a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:30.757886 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21a633-cf0c-442a-b087-55e5e38d357a admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:30.758880 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21a633-cf0c-442a-b087-55e5e38d357a admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:30.759428 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21a633-cf0c-442a-b087-55e5e38d357a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:30.761346 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21a633-cf0c-442a-b087-55e5e38d357a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:30.766783 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 471/929] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Feb 9 04:28:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:30.772449 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe55a79-a2dc-4a30-a5a1-e91a1df96eea admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:30.782758 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe55a79-a2dc-4a30-a5a1-e91a1df96eea admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:30.787907 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b787b-ef74-48a8-9314-e21d315ec921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:30.788833 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b787b-ef74-48a8-9314-e21d315ec921 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:30.789366 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b787b-ef74-48a8-9314-e21d315ec921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:30.789840 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b787b-ef74-48a8-9314-e21d315ec921 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:30.790864 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b787b-ef74-48a8-9314-e21d315ec921 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:30.792790 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b787b-ef74-48a8-9314-e21d315ec921 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:30.815696 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 459/930] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Feb 9 04:28:30 2022] POST /identity/v3/endpoints => generated 347 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:28:31.743795 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a754e-4a11-4078-a6b3-0118872be02d None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:31.744319 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a754e-4a11-4078-a6b3-0118872be02d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:31.744319 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a754e-4a11-4078-a6b3-0118872be02d None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:31.746371 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 472/931] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:31.752147 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb396f-62f4-46ad-9ff7-c257b36f9f1a None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:31.752535 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb396f-62f4-46ad-9ff7-c257b36f9f1a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:31.752709 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb396f-62f4-46ad-9ff7-c257b36f9f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:31.770753 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-72fb396f-62f4-46ad-9ff7-c257b36f9f1a None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:31.771921 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-72fb396f-62f4-46ad-9ff7-c257b36f9f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:31.788869 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 460/932] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:31 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:28:31.812915 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a754e-4a11-4078-a6b3-0118872be02d None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:31.825572 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a754e-4a11-4078-a6b3-0118872be02d None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:31.829924 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d4d84-d88e-4ea0-8f4e-3e353c8dea22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:31.830713 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d4d84-d88e-4ea0-8f4e-3e353c8dea22 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:31.830987 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d4d84-d88e-4ea0-8f4e-3e353c8dea22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:31.831257 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d4d84-d88e-4ea0-8f4e-3e353c8dea22 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:31.842121 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d4d84-d88e-4ea0-8f4e-3e353c8dea22 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:31.849328 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-092d4d84-d88e-4ea0-8f4e-3e353c8dea22 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 09 04:28:31.850779 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 473/933] 10.222.0.36 () {56 vars in 1141 bytes} [Wed Feb 9 04:28:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:31.857065 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb396f-62f4-46ad-9ff7-c257b36f9f1a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:31.865865 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb396f-62f4-46ad-9ff7-c257b36f9f1a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:31.870309 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa130b11-2525-401e-ba44-3f66405ce685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:31.870948 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa130b11-2525-401e-ba44-3f66405ce685 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:31.871228 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa130b11-2525-401e-ba44-3f66405ce685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:31.871499 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa130b11-2525-401e-ba44-3f66405ce685 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:31.872783 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa130b11-2525-401e-ba44-3f66405ce685 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:31.873277 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa130b11-2525-401e-ba44-3f66405ce685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:31.874879 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa130b11-2525-401e-ba44-3f66405ce685 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:31.883295 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 461/934] 10.222.0.36 () {56 vars in 1136 bytes} [Wed Feb 9 04:28:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:31.888949 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d4d84-d88e-4ea0-8f4e-3e353c8dea22 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:31.898728 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d4d84-d88e-4ea0-8f4e-3e353c8dea22 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:31.903300 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127bd1c-68ff-4783-8cdf-d1c99b410f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:31.904082 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127bd1c-68ff-4783-8cdf-d1c99b410f16 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:31.904359 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127bd1c-68ff-4783-8cdf-d1c99b410f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:31.904632 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127bd1c-68ff-4783-8cdf-d1c99b410f16 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:31.915639 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127bd1c-68ff-4783-8cdf-d1c99b410f16 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:31.917503 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127bd1c-68ff-4783-8cdf-d1c99b410f16 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:31.935429 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-b127bd1c-68ff-4783-8cdf-d1c99b410f16 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:31.936923 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 474/935] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:31.942470 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa130b11-2525-401e-ba44-3f66405ce685 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:31.952719 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa130b11-2525-401e-ba44-3f66405ce685 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:31.957300 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d670b-3c97-4592-8b81-51bd1a02092d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:31.957941 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d670b-3c97-4592-8b81-51bd1a02092d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:31.958220 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d670b-3c97-4592-8b81-51bd1a02092d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:31.958488 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d670b-3c97-4592-8b81-51bd1a02092d admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:31.959214 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d670b-3c97-4592-8b81-51bd1a02092d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:31.959515 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d670b-3c97-4592-8b81-51bd1a02092d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:31.961116 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d670b-3c97-4592-8b81-51bd1a02092d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:31.973985 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 462/936] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:31.979370 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127bd1c-68ff-4783-8cdf-d1c99b410f16 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:31.989145 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127bd1c-68ff-4783-8cdf-d1c99b410f16 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:31.993638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e46cf8-3e9c-47a3-a27e-4f465608bdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:31.994455 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e46cf8-3e9c-47a3-a27e-4f465608bdfe admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:31.994740 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e46cf8-3e9c-47a3-a27e-4f465608bdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:31.995012 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e46cf8-3e9c-47a3-a27e-4f465608bdfe admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:32.004037 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e46cf8-3e9c-47a3-a27e-4f465608bdfe admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:32.006164 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e46cf8-3e9c-47a3-a27e-4f465608bdfe admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:32.023202 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-15e46cf8-3e9c-47a3-a27e-4f465608bdfe admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 09 04:28:32.024677 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 475/937] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Feb 9 04:28:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:32.030295 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d670b-3c97-4592-8b81-51bd1a02092d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:32.041333 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d670b-3c97-4592-8b81-51bd1a02092d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:32.045950 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537223d-0835-4c02-86ea-8f5405c149ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:32.046608 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537223d-0835-4c02-86ea-8f5405c149ed admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:32.046936 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537223d-0835-4c02-86ea-8f5405c149ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:32.047209 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537223d-0835-4c02-86ea-8f5405c149ed admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:32.048054 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537223d-0835-4c02-86ea-8f5405c149ed admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:32.048360 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537223d-0835-4c02-86ea-8f5405c149ed admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:32.050246 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537223d-0835-4c02-86ea-8f5405c149ed admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:32.068247 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 463/938] 10.222.0.36 () {56 vars in 1170 bytes} [Wed Feb 9 04:28:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:32.073721 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e46cf8-3e9c-47a3-a27e-4f465608bdfe admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:32.084304 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e46cf8-3e9c-47a3-a27e-4f465608bdfe admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:32.089033 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406d99a-2605-4bd4-889d-d16169367876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:32.089682 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406d99a-2605-4bd4-889d-d16169367876 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:32.090012 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406d99a-2605-4bd4-889d-d16169367876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:32.090289 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406d99a-2605-4bd4-889d-d16169367876 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:32.098484 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406d99a-2605-4bd4-889d-d16169367876 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:32.100301 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406d99a-2605-4bd4-889d-d16169367876 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:32.109855 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 476/939] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:32 2022] GET /identity/v3/auth/tokens => generated 1952 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:28:32.115616 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537223d-0835-4c02-86ea-8f5405c149ed admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:32.125974 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537223d-0835-4c02-86ea-8f5405c149ed admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:32.130392 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37c099-6923-414f-b10d-b9be58b73882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:32.131209 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37c099-6923-414f-b10d-b9be58b73882 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:32.131489 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37c099-6923-414f-b10d-b9be58b73882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:32.131761 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37c099-6923-414f-b10d-b9be58b73882 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:32.142705 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37c099-6923-414f-b10d-b9be58b73882 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:32.144508 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37c099-6923-414f-b10d-b9be58b73882 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:32.161378 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-7b37c099-6923-414f-b10d-b9be58b73882 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:32.163139 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 464/940] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:32.169168 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406d99a-2605-4bd4-889d-d16169367876 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:32.178095 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406d99a-2605-4bd4-889d-d16169367876 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:32.182696 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266eb6c-1203-4bf3-8bc9-0c0f5b56ecf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:32.183383 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266eb6c-1203-4bf3-8bc9-0c0f5b56ecf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:32.183663 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266eb6c-1203-4bf3-8bc9-0c0f5b56ecf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:32.183987 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266eb6c-1203-4bf3-8bc9-0c0f5b56ecf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:32.185322 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266eb6c-1203-4bf3-8bc9-0c0f5b56ecf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:32.185662 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266eb6c-1203-4bf3-8bc9-0c0f5b56ecf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:32.187260 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266eb6c-1203-4bf3-8bc9-0c0f5b56ecf4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:32.201667 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 477/941] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:32.207149 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37c099-6923-414f-b10d-b9be58b73882 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:32.217315 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37c099-6923-414f-b10d-b9be58b73882 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:32.222105 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6dd620-29e3-4b69-b45b-58f180d88c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:32.222891 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6dd620-29e3-4b69-b45b-58f180d88c01 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:32.223166 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6dd620-29e3-4b69-b45b-58f180d88c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:32.223492 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6dd620-29e3-4b69-b45b-58f180d88c01 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:32.230779 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6dd620-29e3-4b69-b45b-58f180d88c01 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:32.233357 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6dd620-29e3-4b69-b45b-58f180d88c01 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:32.246288 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-cd6dd620-29e3-4b69-b45b-58f180d88c01 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:32.248445 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 465/942] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:32.254035 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266eb6c-1203-4bf3-8bc9-0c0f5b56ecf4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:32.265279 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266eb6c-1203-4bf3-8bc9-0c0f5b56ecf4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:32.269976 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c4398-ee90-4699-9c5e-e28be91f85e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:32.270678 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c4398-ee90-4699-9c5e-e28be91f85e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:32.270956 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c4398-ee90-4699-9c5e-e28be91f85e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:32.271227 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c4398-ee90-4699-9c5e-e28be91f85e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:32.272083 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c4398-ee90-4699-9c5e-e28be91f85e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:32.272386 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c4398-ee90-4699-9c5e-e28be91f85e7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:32.274386 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c4398-ee90-4699-9c5e-e28be91f85e7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:32.408917 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 478/943] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:32.414682 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6dd620-29e3-4b69-b45b-58f180d88c01 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:32.425885 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6dd620-29e3-4b69-b45b-58f180d88c01 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:32.430423 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8cfe5-0e4b-4115-b59f-16673286857c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:32.431060 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8cfe5-0e4b-4115-b59f-16673286857c admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:32.431336 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8cfe5-0e4b-4115-b59f-16673286857c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:32.431610 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8cfe5-0e4b-4115-b59f-16673286857c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:32.432463 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8cfe5-0e4b-4115-b59f-16673286857c admin admin] RBAC: Adding query filter params (role.id=a4bddbbd5f64404a90db53f5db02078b, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=98a27dbe620c4aff967363a7d48c46e6) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:32.432772 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8cfe5-0e4b-4115-b59f-16673286857c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:32.435342 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8cfe5-0e4b-4115-b59f-16673286857c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:32.442553 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 466/944] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:28:32 2022] GET /identity/v3/role_assignments?user.id=98a27dbe620c4aff967363a7d48c46e6&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=a4bddbbd5f64404a90db53f5db02078b => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:32.577551 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499840c0-d4e4-4930-aaa6-f2ab9f9b6f8e None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:32.578016 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499840c0-d4e4-4930-aaa6-f2ab9f9b6f8e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:32.578389 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499840c0-d4e4-4930-aaa6-f2ab9f9b6f8e None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:32.580641 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 479/945] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:32.586778 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06fa93-b727-4d83-94da-54aec3ef9ffb None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:32.587206 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06fa93-b727-4d83-94da-54aec3ef9ffb None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:32.587579 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b06fa93-b727-4d83-94da-54aec3ef9ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:32.606911 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-3b06fa93-b727-4d83-94da-54aec3ef9ffb None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:32.608115 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-3b06fa93-b727-4d83-94da-54aec3ef9ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:32.620526 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 467/946] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:32 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:32.639601 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499840c0-d4e4-4930-aaa6-f2ab9f9b6f8e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:32.652229 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499840c0-d4e4-4930-aaa6-f2ab9f9b6f8e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:32.658250 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958348c-bc71-4367-8d10-9b2c86ce5b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:32.659142 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958348c-bc71-4367-8d10-9b2c86ce5b5a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:32.659424 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958348c-bc71-4367-8d10-9b2c86ce5b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:32.659698 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958348c-bc71-4367-8d10-9b2c86ce5b5a admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:32.660365 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958348c-bc71-4367-8d10-9b2c86ce5b5a admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:32.662351 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958348c-bc71-4367-8d10-9b2c86ce5b5a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:32.674417 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-e958348c-bc71-4367-8d10-9b2c86ce5b5a admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 09 04:28:32.675997 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 480/947] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Feb 9 04:28:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:32.681713 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06fa93-b727-4d83-94da-54aec3ef9ffb None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:32.692366 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b06fa93-b727-4d83-94da-54aec3ef9ffb None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:32.697220 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04659f18-8404-4af9-b61f-c81ea95d078d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:32.697936 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04659f18-8404-4af9-b61f-c81ea95d078d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:32.698225 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04659f18-8404-4af9-b61f-c81ea95d078d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:32.698501 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04659f18-8404-4af9-b61f-c81ea95d078d admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:32.699276 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04659f18-8404-4af9-b61f-c81ea95d078d admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:32.699586 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04659f18-8404-4af9-b61f-c81ea95d078d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:32.701231 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04659f18-8404-4af9-b61f-c81ea95d078d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:32.706539 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 468/948] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Feb 9 04:28:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:32.712063 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958348c-bc71-4367-8d10-9b2c86ce5b5a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:32.722321 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958348c-bc71-4367-8d10-9b2c86ce5b5a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:32.726217 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0be12-ce6d-4745-bd0c-9e95fbd6cbfd None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:32.726509 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0be12-ce6d-4745-bd0c-9e95fbd6cbfd None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:32.726787 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0be12-ce6d-4745-bd0c-9e95fbd6cbfd None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:32.727201 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6389703-a0cc-4b70-a79d-716c44e0ec47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:32.727857 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6389703-a0cc-4b70-a79d-716c44e0ec47 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:32.728137 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6389703-a0cc-4b70-a79d-716c44e0ec47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:32.728413 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6389703-a0cc-4b70-a79d-716c44e0ec47 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:32.728572 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 469/949] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:28:32.729425 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6389703-a0cc-4b70-a79d-716c44e0ec47 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:32.729730 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6389703-a0cc-4b70-a79d-716c44e0ec47 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:32.731994 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6389703-a0cc-4b70-a79d-716c44e0ec47 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:32.734292 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b550c96-7908-4523-8707-6d98493b66ae None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:32.734580 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b550c96-7908-4523-8707-6d98493b66ae None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:32.734853 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b550c96-7908-4523-8707-6d98493b66ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:32.738142 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 481/950] 10.222.0.36 () {56 vars in 1135 bytes} [Wed Feb 9 04:28:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:32.743663 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6389703-a0cc-4b70-a79d-716c44e0ec47 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:32.752988 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-0b550c96-7908-4523-8707-6d98493b66ae None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:32.753746 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6389703-a0cc-4b70-a79d-716c44e0ec47 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:32.754362 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-0b550c96-7908-4523-8707-6d98493b66ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:32.759042 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6b956-6586-47cf-b643-5f86d1738806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:32.759882 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6b956-6586-47cf-b643-5f86d1738806 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:32.760451 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6b956-6586-47cf-b643-5f86d1738806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:32.760974 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6b956-6586-47cf-b643-5f86d1738806 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:32.761923 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6b956-6586-47cf-b643-5f86d1738806 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:32.763126 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 470/951] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:32 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:28:32.763887 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6b956-6586-47cf-b643-5f86d1738806 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:32.784075 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 482/952] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Feb 9 04:28:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:28:32.789116 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b550c96-7908-4523-8707-6d98493b66ae None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:32.798151 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b550c96-7908-4523-8707-6d98493b66ae None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:32.813900 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762f23a-95b1-4f80-bf6a-a0d23446556c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:32.814711 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762f23a-95b1-4f80-bf6a-a0d23446556c admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:32.814987 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762f23a-95b1-4f80-bf6a-a0d23446556c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:32.815257 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762f23a-95b1-4f80-bf6a-a0d23446556c admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:32.815930 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762f23a-95b1-4f80-bf6a-a0d23446556c admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:32.817603 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762f23a-95b1-4f80-bf6a-a0d23446556c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:32.829808 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-4762f23a-95b1-4f80-bf6a-a0d23446556c admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 09 04:28:32.831428 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 471/953] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Feb 9 04:28:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:32.838326 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6b956-6586-47cf-b643-5f86d1738806 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:32.851869 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6b956-6586-47cf-b643-5f86d1738806 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:32.857881 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb33ad-d074-4306-bc8c-9171cbe507ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:32.859039 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb33ad-d074-4306-bc8c-9171cbe507ad admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:32.859543 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb33ad-d074-4306-bc8c-9171cbe507ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:32.860015 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb33ad-d074-4306-bc8c-9171cbe507ad admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:32.860953 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb33ad-d074-4306-bc8c-9171cbe507ad admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:32.861618 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb33ad-d074-4306-bc8c-9171cbe507ad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:32.863453 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb33ad-d074-4306-bc8c-9171cbe507ad admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:32.869590 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 483/954] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Feb 9 04:28:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:32.875660 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762f23a-95b1-4f80-bf6a-a0d23446556c admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:32.888009 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762f23a-95b1-4f80-bf6a-a0d23446556c admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:32.893277 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cf39a-7b10-402f-a4ca-20fb6cb515ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:32.894371 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cf39a-7b10-402f-a4ca-20fb6cb515ff admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:32.894882 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cf39a-7b10-402f-a4ca-20fb6cb515ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:32.895400 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9cf39a-7b10-402f-a4ca-20fb6cb515ff admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:32.896328 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cf39a-7b10-402f-a4ca-20fb6cb515ff admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:32.896840 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cf39a-7b10-402f-a4ca-20fb6cb515ff admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:32.898714 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9cf39a-7b10-402f-a4ca-20fb6cb515ff admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:32.905846 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 472/955] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Feb 9 04:28:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:32.912953 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb33ad-d074-4306-bc8c-9171cbe507ad admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:32.924153 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb33ad-d074-4306-bc8c-9171cbe507ad admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:32.930032 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed840d0f-4fef-4fc6-9e0b-78b29147df03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:32.931156 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed840d0f-4fef-4fc6-9e0b-78b29147df03 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:32.931700 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed840d0f-4fef-4fc6-9e0b-78b29147df03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:32.932177 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed840d0f-4fef-4fc6-9e0b-78b29147df03 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:32.933309 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed840d0f-4fef-4fc6-9e0b-78b29147df03 admin admin] RBAC: Adding query filter params (interface=public, service_id=1e3bbf11de7244e5827e45c928d97826, region_id=RegionOne) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:32.933843 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed840d0f-4fef-4fc6-9e0b-78b29147df03 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:32.935845 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed840d0f-4fef-4fc6-9e0b-78b29147df03 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:32.942815 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 484/956] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Feb 9 04:28:32 2022] GET /identity/v3/endpoints?service_id=1e3bbf11de7244e5827e45c928d97826&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:32.948848 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cf39a-7b10-402f-a4ca-20fb6cb515ff admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:32.960059 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9cf39a-7b10-402f-a4ca-20fb6cb515ff admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:32.965102 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf8e82-b5f9-4dcc-9306-4e9b117cb062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:32.966608 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf8e82-b5f9-4dcc-9306-4e9b117cb062 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:32.967089 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf8e82-b5f9-4dcc-9306-4e9b117cb062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:32.967590 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf8e82-b5f9-4dcc-9306-4e9b117cb062 admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:32.968474 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf8e82-b5f9-4dcc-9306-4e9b117cb062 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:32.970360 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf8e82-b5f9-4dcc-9306-4e9b117cb062 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:32.977131 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 473/957] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Feb 9 04:28:32 2022] GET /identity/v3/services => generated 1497 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:28:33.198424 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9e0bd-fb8f-450e-984f-437a30fd28e5 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:33.198717 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9e0bd-fb8f-450e-984f-437a30fd28e5 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:33.198957 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9e0bd-fb8f-450e-984f-437a30fd28e5 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:33.201504 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 485/958] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:33.207753 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34759a-a394-400e-bd54-aa273d3911c6 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:33.207753 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34759a-a394-400e-bd54-aa273d3911c6 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:33.207753 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34759a-a394-400e-bd54-aa273d3911c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:33.226714 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-5b34759a-a394-400e-bd54-aa273d3911c6 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:33.228248 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-5b34759a-a394-400e-bd54-aa273d3911c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:33.236809 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 474/959] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:33 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:28:33.264587 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9e0bd-fb8f-450e-984f-437a30fd28e5 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:33.277545 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9e0bd-fb8f-450e-984f-437a30fd28e5 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:33.282159 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f649c6d-904a-43b4-aa2d-7b34ca2f0e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:33.282989 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f649c6d-904a-43b4-aa2d-7b34ca2f0e4b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:33.283329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f649c6d-904a-43b4-aa2d-7b34ca2f0e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:33.283610 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f649c6d-904a-43b4-aa2d-7b34ca2f0e4b admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:33.284322 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f649c6d-904a-43b4-aa2d-7b34ca2f0e4b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:33.286024 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f649c6d-904a-43b4-aa2d-7b34ca2f0e4b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:33.297741 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-6f649c6d-904a-43b4-aa2d-7b34ca2f0e4b admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 09 04:28:33.299258 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 486/960] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:33.305037 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34759a-a394-400e-bd54-aa273d3911c6 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:33.315016 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34759a-a394-400e-bd54-aa273d3911c6 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:33.319938 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf95465-9df1-4628-8a38-9e57bb55cdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:33.320821 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf95465-9df1-4628-8a38-9e57bb55cdef admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:33.321351 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf95465-9df1-4628-8a38-9e57bb55cdef admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:33.321830 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf95465-9df1-4628-8a38-9e57bb55cdef admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:33.322767 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf95465-9df1-4628-8a38-9e57bb55cdef admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:33.323290 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf95465-9df1-4628-8a38-9e57bb55cdef admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:33.325735 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf95465-9df1-4628-8a38-9e57bb55cdef admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:33.334441 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 475/961] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Feb 9 04:28:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:33.342979 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f649c6d-904a-43b4-aa2d-7b34ca2f0e4b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:33.357844 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f649c6d-904a-43b4-aa2d-7b34ca2f0e4b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:33.371126 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2de669-1ada-46f9-a240-3d7ccee1877d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:33.372595 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2de669-1ada-46f9-a240-3d7ccee1877d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:33.373183 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2de669-1ada-46f9-a240-3d7ccee1877d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:33.373722 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2de669-1ada-46f9-a240-3d7ccee1877d admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:33.374745 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2de669-1ada-46f9-a240-3d7ccee1877d admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:33.375252 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2de669-1ada-46f9-a240-3d7ccee1877d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:33.377238 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2de669-1ada-46f9-a240-3d7ccee1877d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:33.382886 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 487/962] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Feb 9 04:28:33 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:34.767497 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646e05a-9cb8-4f18-bcf5-8683cc028633 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:34.768010 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646e05a-9cb8-4f18-bcf5-8683cc028633 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:34.768086 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646e05a-9cb8-4f18-bcf5-8683cc028633 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:34.770104 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 476/963] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:34.775524 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c82669-ea53-41e2-bfe2-4ee6d67a1062 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:34.775914 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c82669-ea53-41e2-bfe2-4ee6d67a1062 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:34.776093 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c82669-ea53-41e2-bfe2-4ee6d67a1062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:34.793807 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-75c82669-ea53-41e2-bfe2-4ee6d67a1062 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:34.794981 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-75c82669-ea53-41e2-bfe2-4ee6d67a1062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:34.805157 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 488/964] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:34 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:34.826014 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646e05a-9cb8-4f18-bcf5-8683cc028633 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:34.838715 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646e05a-9cb8-4f18-bcf5-8683cc028633 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:34.843375 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b832a1c-1067-4cf6-857f-a3de5e1d665c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:34.844179 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b832a1c-1067-4cf6-857f-a3de5e1d665c admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:34.844453 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b832a1c-1067-4cf6-857f-a3de5e1d665c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:34.844723 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b832a1c-1067-4cf6-857f-a3de5e1d665c admin admin] PATH_INFO: `/v3/services/image` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:34.845445 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b832a1c-1067-4cf6-857f-a3de5e1d665c admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:34.847082 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b832a1c-1067-4cf6-857f-a3de5e1d665c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:34.858772 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-7b832a1c-1067-4cf6-857f-a3de5e1d665c admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 09 04:28:34.865089 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 477/965] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Feb 9 04:28:34 2022] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:34.866483 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c82669-ea53-41e2-bfe2-4ee6d67a1062 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:34.875936 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c82669-ea53-41e2-bfe2-4ee6d67a1062 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:34.880478 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c650c30-eab8-4424-b427-d4ac3ff77979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:34.881147 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c650c30-eab8-4424-b427-d4ac3ff77979 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:34.881428 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c650c30-eab8-4424-b427-d4ac3ff77979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:34.881702 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c650c30-eab8-4424-b427-d4ac3ff77979 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:34.882417 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c650c30-eab8-4424-b427-d4ac3ff77979 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:34.882715 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c650c30-eab8-4424-b427-d4ac3ff77979 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:34.884302 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c650c30-eab8-4424-b427-d4ac3ff77979 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:34.894136 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 489/966] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:34.895454 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b832a1c-1067-4cf6-857f-a3de5e1d665c admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:34.905048 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b832a1c-1067-4cf6-857f-a3de5e1d665c admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:34.909635 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e346f60-d22f-4763-9e31-7d5f8ad80453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:34.910277 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e346f60-d22f-4763-9e31-7d5f8ad80453 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:34.910553 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e346f60-d22f-4763-9e31-7d5f8ad80453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:34.910827 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e346f60-d22f-4763-9e31-7d5f8ad80453 admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:34.911543 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e346f60-d22f-4763-9e31-7d5f8ad80453 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:34.912104 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e346f60-d22f-4763-9e31-7d5f8ad80453 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:34.913724 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e346f60-d22f-4763-9e31-7d5f8ad80453 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:34.925168 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 478/967] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:34 2022] GET /identity/v3/services?type=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:35.120450 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb54a8-b3a4-40a9-85ab-d8e2b2de3532 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:35.120695 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb54a8-b3a4-40a9-85ab-d8e2b2de3532 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:35.120931 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb54a8-b3a4-40a9-85ab-d8e2b2de3532 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:35.123585 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 490/968] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:35.129249 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab9983-2dd6-4315-9b11-535b8272f834 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:35.129531 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab9983-2dd6-4315-9b11-535b8272f834 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:35.129805 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab9983-2dd6-4315-9b11-535b8272f834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:35.148391 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-92ab9983-2dd6-4315-9b11-535b8272f834 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:35.149591 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-92ab9983-2dd6-4315-9b11-535b8272f834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:35.161118 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 479/969] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:35 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:35.182167 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb54a8-b3a4-40a9-85ab-d8e2b2de3532 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:35.195339 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb54a8-b3a4-40a9-85ab-d8e2b2de3532 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:35.200351 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80448e-8b6d-4a64-bfb8-fe228e2cc0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:35.200998 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80448e-8b6d-4a64-bfb8-fe228e2cc0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:35.201308 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80448e-8b6d-4a64-bfb8-fe228e2cc0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:35.201579 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80448e-8b6d-4a64-bfb8-fe228e2cc0b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:35.202296 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80448e-8b6d-4a64-bfb8-fe228e2cc0b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:35.204134 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80448e-8b6d-4a64-bfb8-fe228e2cc0b1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:35.205507 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.common [None req-9b80448e-8b6d-4a64-bfb8-fe228e2cc0b1 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 09 04:28:35.224017 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.sql.core [None req-9b80448e-8b6d-4a64-bfb8-fe228e2cc0b1 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 09 04:28:35.224017 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 09 04:28:35.224017 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [parameters: {'id': '5dd67127acf348d480581770740efdf2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 09 04:28:35.224017 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79177) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 09 04:28:35.239854 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-9b80448e-8b6d-4a64-bfb8-fe228e2cc0b1 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5dd67127acf348d480581770740efdf2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5dd67127acf348d480581770740efdf2. Feb 09 04:28:35.245248 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 491/970] 10.222.0.36 () {60 vars in 1161 bytes} [Wed Feb 9 04:28:35 2022] POST /identity/v3/projects => generated 262 bytes in 60 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:35.247738 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab9983-2dd6-4315-9b11-535b8272f834 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:35.256749 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab9983-2dd6-4315-9b11-535b8272f834 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:35.261466 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97346daa-0158-4f80-963d-43a6ab9bc5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:35.262786 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97346daa-0158-4f80-963d-43a6ab9bc5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:35.263062 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97346daa-0158-4f80-963d-43a6ab9bc5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:35.263331 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97346daa-0158-4f80-963d-43a6ab9bc5a6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:35.270934 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97346daa-0158-4f80-963d-43a6ab9bc5a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:35.272881 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97346daa-0158-4f80-963d-43a6ab9bc5a6 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:35.277618 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ded57-7c36-422c-b80f-04c9394364df None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:35.278468 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ded57-7c36-422c-b80f-04c9394364df None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:35.278744 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1ded57-7c36-422c-b80f-04c9394364df None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:35.285090 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 492/971] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:35.290838 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486792e-d74b-4eea-9143-5b8bae13da66 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:35.291122 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486792e-d74b-4eea-9143-5b8bae13da66 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:35.291399 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486792e-d74b-4eea-9143-5b8bae13da66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:35.292763 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-97346daa-0158-4f80-963d-43a6ab9bc5a6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:35.294417 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 480/972] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:35.300478 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97346daa-0158-4f80-963d-43a6ab9bc5a6 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:35.310207 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-e486792e-d74b-4eea-9143-5b8bae13da66 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:35.311802 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e486792e-d74b-4eea-9143-5b8bae13da66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:35.312395 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97346daa-0158-4f80-963d-43a6ab9bc5a6 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:35.317773 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70e9cb-668d-4eac-b937-2b44867052de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:35.318757 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70e9cb-668d-4eac-b937-2b44867052de admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:35.319196 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70e9cb-668d-4eac-b937-2b44867052de admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:35.319570 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc70e9cb-668d-4eac-b937-2b44867052de admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:35.320402 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70e9cb-668d-4eac-b937-2b44867052de admin admin] RBAC: Adding query filter params (name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:35.320594 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 493/973] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:35 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:35.320888 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70e9cb-668d-4eac-b937-2b44867052de admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:35.322997 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc70e9cb-668d-4eac-b937-2b44867052de admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:35.341825 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 481/974] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Feb 9 04:28:35 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:35.345406 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486792e-d74b-4eea-9143-5b8bae13da66 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:35.355391 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486792e-d74b-4eea-9143-5b8bae13da66 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:35.360487 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d830f8-f6e6-4687-8bb5-b5f1ac946af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:35.361473 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d830f8-f6e6-4687-8bb5-b5f1ac946af7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:35.361872 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d830f8-f6e6-4687-8bb5-b5f1ac946af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:35.362256 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d830f8-f6e6-4687-8bb5-b5f1ac946af7 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:35.363013 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d830f8-f6e6-4687-8bb5-b5f1ac946af7 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:35.364987 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d830f8-f6e6-4687-8bb5-b5f1ac946af7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:35.377672 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-62d830f8-f6e6-4687-8bb5-b5f1ac946af7 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 09 04:28:35.379423 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 494/975] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Feb 9 04:28:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:35.385242 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70e9cb-668d-4eac-b937-2b44867052de admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:35.399552 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc70e9cb-668d-4eac-b937-2b44867052de admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:35.405226 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0d3e3-61cc-4fad-b1b1-13e55a59a4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:35.405974 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0d3e3-61cc-4fad-b1b1-13e55a59a4bd admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:35.406263 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0d3e3-61cc-4fad-b1b1-13e55a59a4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:35.406537 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0d3e3-61cc-4fad-b1b1-13e55a59a4bd admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:35.407304 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0d3e3-61cc-4fad-b1b1-13e55a59a4bd admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:35.407613 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0d3e3-61cc-4fad-b1b1-13e55a59a4bd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:35.409357 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0d3e3-61cc-4fad-b1b1-13e55a59a4bd admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:35.415616 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 482/976] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Feb 9 04:28:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:35.421809 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d830f8-f6e6-4687-8bb5-b5f1ac946af7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:35.432516 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d830f8-f6e6-4687-8bb5-b5f1ac946af7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:35.437631 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dc77c-49c2-47f0-b25c-81f79d4a09a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:35.438366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dc77c-49c2-47f0-b25c-81f79d4a09a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:35.438644 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dc77c-49c2-47f0-b25c-81f79d4a09a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:35.438917 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dc77c-49c2-47f0-b25c-81f79d4a09a7 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:35.439705 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23dc77c-49c2-47f0-b25c-81f79d4a09a7 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:35.440008 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23dc77c-49c2-47f0-b25c-81f79d4a09a7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:35.441773 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23dc77c-49c2-47f0-b25c-81f79d4a09a7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:35.448192 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 495/977] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Feb 9 04:28:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:35.454051 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0d3e3-61cc-4fad-b1b1-13e55a59a4bd admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:35.464279 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0d3e3-61cc-4fad-b1b1-13e55a59a4bd admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:35.469773 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf8555-11ba-4e68-ba0e-d151ddb16453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:35.470547 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf8555-11ba-4e68-ba0e-d151ddb16453 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:35.470832 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf8555-11ba-4e68-ba0e-d151ddb16453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:35.471107 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf8555-11ba-4e68-ba0e-d151ddb16453 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:35.471935 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf8555-11ba-4e68-ba0e-d151ddb16453 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:35.473605 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf8555-11ba-4e68-ba0e-d151ddb16453 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:35.495783 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 483/978] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Feb 9 04:28:35 2022] POST /identity/v3/endpoints => generated 349 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:28:35.681788 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c02b6e-7ed9-4ae7-a021-22e138d64ff7 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:35.682082 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c02b6e-7ed9-4ae7-a021-22e138d64ff7 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:35.682259 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c02b6e-7ed9-4ae7-a021-22e138d64ff7 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:35.684834 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 496/979] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:35.690224 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051d99c-ecd0-45c7-8a30-50767933fb70 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:35.690516 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051d99c-ecd0-45c7-8a30-50767933fb70 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:35.690796 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051d99c-ecd0-45c7-8a30-50767933fb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:35.711201 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-b051d99c-ecd0-45c7-8a30-50767933fb70 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:35.712390 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-b051d99c-ecd0-45c7-8a30-50767933fb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:35.729551 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 484/980] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:35 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:28:35.758452 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c02b6e-7ed9-4ae7-a021-22e138d64ff7 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:35.772831 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c02b6e-7ed9-4ae7-a021-22e138d64ff7 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:35.777826 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd54b2-0d0e-4e42-8cd7-d8c8e576812a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:35.779157 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd54b2-0d0e-4e42-8cd7-d8c8e576812a admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:35.779644 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd54b2-0d0e-4e42-8cd7-d8c8e576812a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:35.780154 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd54b2-0d0e-4e42-8cd7-d8c8e576812a admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:35.781182 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd54b2-0d0e-4e42-8cd7-d8c8e576812a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:35.783000 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd54b2-0d0e-4e42-8cd7-d8c8e576812a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:35.800567 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 497/981] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Feb 9 04:28:35 2022] POST /identity/v3/services => generated 242 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:28:37.198620 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d2b0f-234d-44f1-8147-eef0ad31e6d7 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:37.199138 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d2b0f-234d-44f1-8147-eef0ad31e6d7 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:37.199215 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d2b0f-234d-44f1-8147-eef0ad31e6d7 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:37.201284 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 485/982] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:37.206333 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e01204-94d8-4229-8464-c650577304a5 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:37.206726 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e01204-94d8-4229-8464-c650577304a5 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:37.206867 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e01204-94d8-4229-8464-c650577304a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:37.224988 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-11e01204-94d8-4229-8464-c650577304a5 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:37.226190 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-11e01204-94d8-4229-8464-c650577304a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:37.249114 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 498/983] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:37 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:28:37.266658 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d2b0f-234d-44f1-8147-eef0ad31e6d7 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:37.279300 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d2b0f-234d-44f1-8147-eef0ad31e6d7 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:37.283539 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b38e4-7910-4f7b-b519-9e82504424d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:37.284181 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b38e4-7910-4f7b-b519-9e82504424d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:37.284457 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b38e4-7910-4f7b-b519-9e82504424d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:37.284727 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b38e4-7910-4f7b-b519-9e82504424d6 admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:37.285504 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b38e4-7910-4f7b-b519-9e82504424d6 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:37.287335 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b38e4-7910-4f7b-b519-9e82504424d6 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:37.309196 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 486/984] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Feb 9 04:28:37 2022] POST /identity/v3/services => generated 242 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:28:37.696932 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be57023-b30a-40f5-b8a9-df96c5075546 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:37.697345 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be57023-b30a-40f5-b8a9-df96c5075546 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:37.697518 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be57023-b30a-40f5-b8a9-df96c5075546 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:37.700075 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 499/985] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:37.705558 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13631769-5e7c-43aa-b402-9b5d3c41eabe None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:37.706112 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13631769-5e7c-43aa-b402-9b5d3c41eabe None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:37.706600 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13631769-5e7c-43aa-b402-9b5d3c41eabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:37.725267 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-13631769-5e7c-43aa-b402-9b5d3c41eabe None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:37.726771 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-13631769-5e7c-43aa-b402-9b5d3c41eabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:37.743978 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 487/986] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:37 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:37.770099 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be57023-b30a-40f5-b8a9-df96c5075546 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:37.782512 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be57023-b30a-40f5-b8a9-df96c5075546 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:37.787261 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47a758-1c59-424f-9ab8-c7e31535aa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:37.787924 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47a758-1c59-424f-9ab8-c7e31535aa30 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:37.788211 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47a758-1c59-424f-9ab8-c7e31535aa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:37.788492 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47a758-1c59-424f-9ab8-c7e31535aa30 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:37.789258 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47a758-1c59-424f-9ab8-c7e31535aa30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:37.791125 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47a758-1c59-424f-9ab8-c7e31535aa30 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:37.804909 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d09109-2898-47b4-815b-4e2038f233f7 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:37.805309 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d09109-2898-47b4-815b-4e2038f233f7 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:37.805668 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.sql.core [None req-9f47a758-1c59-424f-9ab8-c7e31535aa30 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 09 04:28:37.805668 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 09 04:28:37.805668 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [parameters: {'user_id': '00c7efe9d6054761a837351674b5ec25', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 09 04:28:37.805668 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79177) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 09 04:28:37.805993 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d09109-2898-47b4-815b-4e2038f233f7 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:37.808108 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 488/987] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:37.812627 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-9f47a758-1c59-424f-9ab8-c7e31535aa30 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 09 04:28:37.813584 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b34e8c-1a94-40d9-94c8-b82ff934778b None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:37.813972 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b34e8c-1a94-40d9-94c8-b82ff934778b None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:37.814240 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 500/988] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:28:37 2022] POST /identity/v3/users => generated 160 bytes in 45 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:37.814467 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b34e8c-1a94-40d9-94c8-b82ff934778b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:37.820010 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47a758-1c59-424f-9ab8-c7e31535aa30 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:37.830524 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47a758-1c59-424f-9ab8-c7e31535aa30 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:37.833097 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-92b34e8c-1a94-40d9-94c8-b82ff934778b None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:37.834408 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-92b34e8c-1a94-40d9-94c8-b82ff934778b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:37.835351 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb06ac-e95d-49c3-ad05-3699f7d58d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:37.836059 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb06ac-e95d-49c3-ad05-3699f7d58d6a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:37.836417 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb06ac-e95d-49c3-ad05-3699f7d58d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:37.836626 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb06ac-e95d-49c3-ad05-3699f7d58d6a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:37.843755 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 489/989] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:37 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:28:37.846302 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb06ac-e95d-49c3-ad05-3699f7d58d6a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:37.848663 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb06ac-e95d-49c3-ad05-3699f7d58d6a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:37.864065 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-f1bb06ac-e95d-49c3-ad05-3699f7d58d6a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 09 04:28:37.865890 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 501/990] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:28:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:37.867482 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b34e8c-1a94-40d9-94c8-b82ff934778b None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:37.872364 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb06ac-e95d-49c3-ad05-3699f7d58d6a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:37.877984 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b34e8c-1a94-40d9-94c8-b82ff934778b None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:37.882711 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb06ac-e95d-49c3-ad05-3699f7d58d6a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:37.882998 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4e338-9eac-428f-a1ea-8617b77e8e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:37.883875 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4e338-9eac-428f-a1ea-8617b77e8e35 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:37.884222 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4e338-9eac-428f-a1ea-8617b77e8e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:37.884565 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4e338-9eac-428f-a1ea-8617b77e8e35 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:37.885460 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4e338-9eac-428f-a1ea-8617b77e8e35 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:37.887640 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4e338-9eac-428f-a1ea-8617b77e8e35 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:37.888127 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5eeb63-20b9-4dad-95fc-ceff1c0385c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:37.888802 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eeb63-20b9-4dad-95fc-ceff1c0385c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:37.889113 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eeb63-20b9-4dad-95fc-ceff1c0385c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:37.889398 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5eeb63-20b9-4dad-95fc-ceff1c0385c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:37.890227 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5eeb63-20b9-4dad-95fc-ceff1c0385c8 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:37.890536 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5eeb63-20b9-4dad-95fc-ceff1c0385c8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:37.892475 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5eeb63-20b9-4dad-95fc-ceff1c0385c8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:37.900115 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-0ad4e338-9eac-428f-a1ea-8617b77e8e35 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 09 04:28:37.901720 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 490/991] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Feb 9 04:28:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:37.908502 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4e338-9eac-428f-a1ea-8617b77e8e35 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:37.925199 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4e338-9eac-428f-a1ea-8617b77e8e35 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:37.929709 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbccb90-820b-4199-9505-507601864cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:37.930358 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbccb90-820b-4199-9505-507601864cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:37.930641 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbccb90-820b-4199-9505-507601864cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:37.930919 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbccb90-820b-4199-9505-507601864cc1 admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:37.931686 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbccb90-820b-4199-9505-507601864cc1 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:37.931994 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbccb90-820b-4199-9505-507601864cc1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:37.933697 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbccb90-820b-4199-9505-507601864cc1 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:37.944081 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 491/992] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Feb 9 04:28:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:37.944215 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 502/993] 10.222.0.36 () {56 vars in 1122 bytes} [Wed Feb 9 04:28:37 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:37.946590 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbccb90-820b-4199-9505-507601864cc1 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:37.958395 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbccb90-820b-4199-9505-507601864cc1 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:37.963667 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955053a-f54f-47f8-a7dd-32ca04a77ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:37.964701 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955053a-f54f-47f8-a7dd-32ca04a77ebc admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:37.965288 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955053a-f54f-47f8-a7dd-32ca04a77ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:37.965787 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955053a-f54f-47f8-a7dd-32ca04a77ebc admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:37.966906 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955053a-f54f-47f8-a7dd-32ca04a77ebc admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:37.968784 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955053a-f54f-47f8-a7dd-32ca04a77ebc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:37.973684 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955053a-f54f-47f8-a7dd-32ca04a77ebc admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:37.980277 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 492/994] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Feb 9 04:28:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:37.986874 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5eeb63-20b9-4dad-95fc-ceff1c0385c8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:37.998189 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5eeb63-20b9-4dad-95fc-ceff1c0385c8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:38.003591 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a09f6-5db2-4a00-9cd3-a920bfc78800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:38.004698 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a09f6-5db2-4a00-9cd3-a920bfc78800 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:38.005683 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a09f6-5db2-4a00-9cd3-a920bfc78800 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:38.006351 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a09f6-5db2-4a00-9cd3-a920bfc78800 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:38.007417 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a09f6-5db2-4a00-9cd3-a920bfc78800 admin admin] RBAC: Adding query filter params (interface=admin, service_id=1e3bbf11de7244e5827e45c928d97826, region_id=RegionOne) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:38.007960 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a09f6-5db2-4a00-9cd3-a920bfc78800 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:38.009890 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a09f6-5db2-4a00-9cd3-a920bfc78800 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:38.020942 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 503/995] 10.222.0.36 () {56 vars in 1270 bytes} [Wed Feb 9 04:28:37 2022] GET /identity/v3/endpoints?service_id=1e3bbf11de7244e5827e45c928d97826&interface=admin®ion_id=RegionOne => generated 193 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:38.023496 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955053a-f54f-47f8-a7dd-32ca04a77ebc admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:38.034145 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955053a-f54f-47f8-a7dd-32ca04a77ebc admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:38.039777 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b472ba-6510-4326-b65e-15636898bd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:38.040783 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b472ba-6510-4326-b65e-15636898bd43 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:38.041375 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b472ba-6510-4326-b65e-15636898bd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:38.041853 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b472ba-6510-4326-b65e-15636898bd43 admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:38.042802 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b472ba-6510-4326-b65e-15636898bd43 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:38.044861 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b472ba-6510-4326-b65e-15636898bd43 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:38.052748 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 493/996] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Feb 9 04:28:38 2022] GET /identity/v3/services => generated 1957 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:28:38.150936 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e688a9-1c05-46e4-a4ed-615e848efeda None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:38.151557 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e688a9-1c05-46e4-a4ed-615e848efeda None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:38.152054 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e688a9-1c05-46e4-a4ed-615e848efeda None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:38.154580 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 504/997] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:38.160092 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fd788-e1fb-45b9-ae0b-caa18fecbf5f None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:38.160388 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fd788-e1fb-45b9-ae0b-caa18fecbf5f None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:38.160657 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8fd788-e1fb-45b9-ae0b-caa18fecbf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:38.182011 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-1a8fd788-e1fb-45b9-ae0b-caa18fecbf5f None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:38.183247 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-1a8fd788-e1fb-45b9-ae0b-caa18fecbf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:38.192342 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 494/998] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:38 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:38.216452 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e688a9-1c05-46e4-a4ed-615e848efeda None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:38.231604 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e688a9-1c05-46e4-a4ed-615e848efeda None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:38.236680 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48884d-a9b0-40f7-9e07-dd39998f609f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:38.237517 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48884d-a9b0-40f7-9e07-dd39998f609f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:38.237796 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48884d-a9b0-40f7-9e07-dd39998f609f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:38.238071 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48884d-a9b0-40f7-9e07-dd39998f609f admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:38.238741 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48884d-a9b0-40f7-9e07-dd39998f609f admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:38.240353 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48884d-a9b0-40f7-9e07-dd39998f609f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:38.252889 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-fa48884d-a9b0-40f7-9e07-dd39998f609f admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 09 04:28:38.254422 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 505/999] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:38.260275 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fd788-e1fb-45b9-ae0b-caa18fecbf5f None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:38.269543 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8fd788-e1fb-45b9-ae0b-caa18fecbf5f None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:38.275687 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11147c-58d3-45cd-a0aa-cf10326319bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:38.276550 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11147c-58d3-45cd-a0aa-cf10326319bc admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:38.277060 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11147c-58d3-45cd-a0aa-cf10326319bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:38.277626 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11147c-58d3-45cd-a0aa-cf10326319bc admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:38.278539 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11147c-58d3-45cd-a0aa-cf10326319bc admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:38.279022 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11147c-58d3-45cd-a0aa-cf10326319bc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:38.280791 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11147c-58d3-45cd-a0aa-cf10326319bc admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:38.286428 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 495/1000] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Feb 9 04:28:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:38.292099 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48884d-a9b0-40f7-9e07-dd39998f609f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:38.302391 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48884d-a9b0-40f7-9e07-dd39998f609f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:38.306816 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27da011-763f-4d07-ad03-80cc0c86551f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:38.307468 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27da011-763f-4d07-ad03-80cc0c86551f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:38.307751 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27da011-763f-4d07-ad03-80cc0c86551f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:38.308025 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27da011-763f-4d07-ad03-80cc0c86551f admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:38.308742 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27da011-763f-4d07-ad03-80cc0c86551f admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:38.309816 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27da011-763f-4d07-ad03-80cc0c86551f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:38.312293 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27da011-763f-4d07-ad03-80cc0c86551f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:38.317721 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 506/1001] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Feb 9 04:28:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:38.323631 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11147c-58d3-45cd-a0aa-cf10326319bc admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:38.333342 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11147c-58d3-45cd-a0aa-cf10326319bc admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:38.337868 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9fc13-83e5-4f83-b238-aa6f0892836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:38.338581 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9fc13-83e5-4f83-b238-aa6f0892836e admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:38.338937 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9fc13-83e5-4f83-b238-aa6f0892836e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:38.339375 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9fc13-83e5-4f83-b238-aa6f0892836e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:38.340301 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9fc13-83e5-4f83-b238-aa6f0892836e admin admin] RBAC: Adding query filter params (interface=public, service_id=511114eef33d4a60b94c3cfc0cdbf8fc, region_id=RegionOne) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:38.340674 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9fc13-83e5-4f83-b238-aa6f0892836e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:38.341715 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING py.warnings [None req-8fa9fc13-83e5-4f83-b238-aa6f0892836e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:28:38.341715 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: warnings.warn(msg) Feb 09 04:28:38.341715 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: Feb 09 04:28:38.342594 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9fc13-83e5-4f83-b238-aa6f0892836e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:38.350296 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 496/1002] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Feb 9 04:28:38 2022] GET /identity/v3/endpoints?service_id=511114eef33d4a60b94c3cfc0cdbf8fc&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:38.355474 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27da011-763f-4d07-ad03-80cc0c86551f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:38.365673 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27da011-763f-4d07-ad03-80cc0c86551f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:38.370192 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a1d89-5f3c-456a-9629-92d782f650b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:38.370852 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a1d89-5f3c-456a-9629-92d782f650b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:38.371141 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a1d89-5f3c-456a-9629-92d782f650b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:38.371980 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a1d89-5f3c-456a-9629-92d782f650b0 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:38.372681 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a1d89-5f3c-456a-9629-92d782f650b0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:38.374316 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a1d89-5f3c-456a-9629-92d782f650b0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:38.381224 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 507/1003] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Feb 9 04:28:38 2022] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:28:39.571996 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34355d-7bc5-4486-b86e-f64098a20383 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:39.571996 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34355d-7bc5-4486-b86e-f64098a20383 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:39.572628 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34355d-7bc5-4486-b86e-f64098a20383 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:39.574265 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 497/1004] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:39.579775 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ffb9b-5c5e-4209-a00d-b1d2079fea63 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:39.580188 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ffb9b-5c5e-4209-a00d-b1d2079fea63 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:39.580372 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ffb9b-5c5e-4209-a00d-b1d2079fea63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:39.598810 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-1a9ffb9b-5c5e-4209-a00d-b1d2079fea63 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:39.600324 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1a9ffb9b-5c5e-4209-a00d-b1d2079fea63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:39.608782 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 508/1005] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:39 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:39.631797 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34355d-7bc5-4486-b86e-f64098a20383 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:39.644389 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34355d-7bc5-4486-b86e-f64098a20383 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:39.648769 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50adef-c1f5-425e-bd3c-add82e93622c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:39.649560 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50adef-c1f5-425e-bd3c-add82e93622c admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:39.649844 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50adef-c1f5-425e-bd3c-add82e93622c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:39.650121 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50adef-c1f5-425e-bd3c-add82e93622c admin admin] PATH_INFO: `/v3/services/image` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:39.650789 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50adef-c1f5-425e-bd3c-add82e93622c admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:39.652375 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50adef-c1f5-425e-bd3c-add82e93622c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:39.663787 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-7b50adef-c1f5-425e-bd3c-add82e93622c admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 09 04:28:39.665091 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 498/1006] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Feb 9 04:28:39 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:39.670713 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ffb9b-5c5e-4209-a00d-b1d2079fea63 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:39.679630 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ffb9b-5c5e-4209-a00d-b1d2079fea63 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:39.684107 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8e548-7703-401d-b19a-5aec37c8c365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:39.684824 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8e548-7703-401d-b19a-5aec37c8c365 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:39.685196 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8e548-7703-401d-b19a-5aec37c8c365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:39.685542 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8e548-7703-401d-b19a-5aec37c8c365 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:39.686329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8e548-7703-401d-b19a-5aec37c8c365 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:39.686863 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8e548-7703-401d-b19a-5aec37c8c365 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:39.688527 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8e548-7703-401d-b19a-5aec37c8c365 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:39.697032 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 509/1007] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:39.698876 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50adef-c1f5-425e-bd3c-add82e93622c admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:39.716490 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50adef-c1f5-425e-bd3c-add82e93622c admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:39.735034 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391854d-11e0-4f60-b928-a9c9a7a11995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:39.735726 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391854d-11e0-4f60-b928-a9c9a7a11995 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:39.736012 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391854d-11e0-4f60-b928-a9c9a7a11995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:39.736286 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391854d-11e0-4f60-b928-a9c9a7a11995 admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:39.737032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391854d-11e0-4f60-b928-a9c9a7a11995 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:39.737337 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391854d-11e0-4f60-b928-a9c9a7a11995 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:39.738918 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391854d-11e0-4f60-b928-a9c9a7a11995 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:39.745621 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 499/1008] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:39.753425 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8e548-7703-401d-b19a-5aec37c8c365 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:39.763784 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8e548-7703-401d-b19a-5aec37c8c365 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:39.768334 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912927b-004d-435c-b855-6d0aa4ce9592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:39.769087 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912927b-004d-435c-b855-6d0aa4ce9592 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:39.769445 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912927b-004d-435c-b855-6d0aa4ce9592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:39.769794 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912927b-004d-435c-b855-6d0aa4ce9592 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:39.770671 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912927b-004d-435c-b855-6d0aa4ce9592 admin admin] RBAC: Adding query filter params (interface=public, service_id=db10d633657c48cb969e4329406e455d, region_id=RegionOne) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:39.771070 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912927b-004d-435c-b855-6d0aa4ce9592 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:39.772751 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912927b-004d-435c-b855-6d0aa4ce9592 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:39.781037 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 510/1009] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Feb 9 04:28:39 2022] GET /identity/v3/endpoints?service_id=db10d633657c48cb969e4329406e455d&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:39.784177 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391854d-11e0-4f60-b928-a9c9a7a11995 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:39.794037 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391854d-11e0-4f60-b928-a9c9a7a11995 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:39.798562 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b39b53-55d2-40ec-8637-f21caf2f0a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:39.799164 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b39b53-55d2-40ec-8637-f21caf2f0a03 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:39.799445 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b39b53-55d2-40ec-8637-f21caf2f0a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:39.799724 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b39b53-55d2-40ec-8637-f21caf2f0a03 admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:39.800408 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b39b53-55d2-40ec-8637-f21caf2f0a03 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:39.802031 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b39b53-55d2-40ec-8637-f21caf2f0a03 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:39.808757 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 500/1010] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Feb 9 04:28:39 2022] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:28:40.294959 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631588d-fa3e-4b4a-aea5-9c5cceacadd1 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:40.295367 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631588d-fa3e-4b4a-aea5-9c5cceacadd1 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:40.295546 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631588d-fa3e-4b4a-aea5-9c5cceacadd1 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:40.297358 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 511/1011] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:40.302542 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d879d-2a89-4bb3-bd42-9801a0531142 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:40.302843 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d879d-2a89-4bb3-bd42-9801a0531142 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:40.303110 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d879d-2a89-4bb3-bd42-9801a0531142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:40.320709 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-1e9d879d-2a89-4bb3-bd42-9801a0531142 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:40.321903 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-1e9d879d-2a89-4bb3-bd42-9801a0531142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:40.329793 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 501/1012] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:40 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:40.352541 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631588d-fa3e-4b4a-aea5-9c5cceacadd1 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:40.364811 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631588d-fa3e-4b4a-aea5-9c5cceacadd1 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:40.369330 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ea5bc-d6bf-49a1-b312-6c6f2db23c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:40.370157 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ea5bc-d6bf-49a1-b312-6c6f2db23c4b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:40.370435 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ea5bc-d6bf-49a1-b312-6c6f2db23c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:40.370704 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ea5bc-d6bf-49a1-b312-6c6f2db23c4b admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:40.371949 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ea5bc-d6bf-49a1-b312-6c6f2db23c4b admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:40.373611 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59ea5bc-d6bf-49a1-b312-6c6f2db23c4b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:40.385643 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-d59ea5bc-d6bf-49a1-b312-6c6f2db23c4b admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 09 04:28:40.392621 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 512/1013] 10.222.0.36 () {56 vars in 1147 bytes} [Wed Feb 9 04:28:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:40.393996 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d879d-2a89-4bb3-bd42-9801a0531142 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:40.403191 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d879d-2a89-4bb3-bd42-9801a0531142 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:40.407737 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26876f57-61ba-40c4-af26-f94c404ef769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:40.408465 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26876f57-61ba-40c4-af26-f94c404ef769 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:40.408812 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26876f57-61ba-40c4-af26-f94c404ef769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:40.409174 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26876f57-61ba-40c4-af26-f94c404ef769 admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:40.409948 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26876f57-61ba-40c4-af26-f94c404ef769 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:40.410317 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26876f57-61ba-40c4-af26-f94c404ef769 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:40.412216 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26876f57-61ba-40c4-af26-f94c404ef769 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:40.418011 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 502/1014] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Feb 9 04:28:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:40.424153 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ea5bc-d6bf-49a1-b312-6c6f2db23c4b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:40.433563 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ea5bc-d6bf-49a1-b312-6c6f2db23c4b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:40.438586 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9163152-55c4-461f-9950-c8e75d44d309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:40.439258 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9163152-55c4-461f-9950-c8e75d44d309 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:40.439509 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9163152-55c4-461f-9950-c8e75d44d309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:40.439781 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9163152-55c4-461f-9950-c8e75d44d309 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:40.440490 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9163152-55c4-461f-9950-c8e75d44d309 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:40.440793 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9163152-55c4-461f-9950-c8e75d44d309 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:40.442470 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9163152-55c4-461f-9950-c8e75d44d309 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:40.447920 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 513/1015] 10.222.0.36 () {56 vars in 1143 bytes} [Wed Feb 9 04:28:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:40.453571 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26876f57-61ba-40c4-af26-f94c404ef769 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:40.463011 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26876f57-61ba-40c4-af26-f94c404ef769 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:40.467455 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd7790-933f-4eb0-a592-270ac9308f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:40.468088 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd7790-933f-4eb0-a592-270ac9308f24 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:40.468382 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd7790-933f-4eb0-a592-270ac9308f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:40.468630 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd7790-933f-4eb0-a592-270ac9308f24 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:40.469413 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd7790-933f-4eb0-a592-270ac9308f24 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:40.470976 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd7790-933f-4eb0-a592-270ac9308f24 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:40.486847 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 503/1016] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Feb 9 04:28:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:28:40.650021 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433074d-b3b9-48d3-9b02-0f51d95d9e75 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:40.650533 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433074d-b3b9-48d3-9b02-0f51d95d9e75 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:40.650623 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2433074d-b3b9-48d3-9b02-0f51d95d9e75 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:40.652311 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 514/1017] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:40.657878 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4923c3-e086-46b3-83c3-e76b80ee2a74 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:40.658288 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4923c3-e086-46b3-83c3-e76b80ee2a74 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:40.658432 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4923c3-e086-46b3-83c3-e76b80ee2a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:40.676875 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-5d4923c3-e086-46b3-83c3-e76b80ee2a74 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:40.678089 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-5d4923c3-e086-46b3-83c3-e76b80ee2a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:40.695641 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 504/1018] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:40 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:40.719000 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433074d-b3b9-48d3-9b02-0f51d95d9e75 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:40.731332 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2433074d-b3b9-48d3-9b02-0f51d95d9e75 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:40.735636 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da103f04-77d0-4ec2-9a1b-6f01b51efb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:40.736404 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da103f04-77d0-4ec2-9a1b-6f01b51efb51 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:40.736682 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da103f04-77d0-4ec2-9a1b-6f01b51efb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:40.736952 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da103f04-77d0-4ec2-9a1b-6f01b51efb51 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:40.737794 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da103f04-77d0-4ec2-9a1b-6f01b51efb51 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:40.739382 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da103f04-77d0-4ec2-9a1b-6f01b51efb51 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:40.750628 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-da103f04-77d0-4ec2-9a1b-6f01b51efb51 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 09 04:28:40.751893 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 515/1019] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:40.757871 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4923c3-e086-46b3-83c3-e76b80ee2a74 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:40.766628 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4923c3-e086-46b3-83c3-e76b80ee2a74 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:40.771075 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8b05d-8a3a-4362-a2d4-c0d01d12ab44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:40.771718 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8b05d-8a3a-4362-a2d4-c0d01d12ab44 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:40.771998 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8b05d-8a3a-4362-a2d4-c0d01d12ab44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:40.772271 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f8b05d-8a3a-4362-a2d4-c0d01d12ab44 admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:40.772984 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8b05d-8a3a-4362-a2d4-c0d01d12ab44 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:40.773316 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8b05d-8a3a-4362-a2d4-c0d01d12ab44 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:40.774882 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f8b05d-8a3a-4362-a2d4-c0d01d12ab44 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:40.780410 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 505/1020] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Feb 9 04:28:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:40.786019 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da103f04-77d0-4ec2-9a1b-6f01b51efb51 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:40.801175 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da103f04-77d0-4ec2-9a1b-6f01b51efb51 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:40.805523 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c1cdd-115e-4fc2-985e-a738b76225f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:40.806173 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c1cdd-115e-4fc2-985e-a738b76225f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:40.806455 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c1cdd-115e-4fc2-985e-a738b76225f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:40.806728 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c1cdd-115e-4fc2-985e-a738b76225f7 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:40.807441 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c1cdd-115e-4fc2-985e-a738b76225f7 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:40.807743 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c1cdd-115e-4fc2-985e-a738b76225f7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:40.809597 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c1cdd-115e-4fc2-985e-a738b76225f7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:40.814733 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 516/1021] 10.222.0.36 () {56 vars in 1133 bytes} [Wed Feb 9 04:28:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:40.820218 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8b05d-8a3a-4362-a2d4-c0d01d12ab44 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:40.829721 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f8b05d-8a3a-4362-a2d4-c0d01d12ab44 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:40.834132 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2efe5-f140-437b-b3c4-d5fcaf56e707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:40.834766 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2efe5-f140-437b-b3c4-d5fcaf56e707 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:40.835065 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2efe5-f140-437b-b3c4-d5fcaf56e707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:40.835319 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2efe5-f140-437b-b3c4-d5fcaf56e707 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:40.836263 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2efe5-f140-437b-b3c4-d5fcaf56e707 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:40.837866 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2efe5-f140-437b-b3c4-d5fcaf56e707 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:40.858671 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 506/1022] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Feb 9 04:28:40 2022] POST /identity/v3/endpoints => generated 334 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:28:42.062557 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013b019-79b1-45cb-a85f-0d1305ea52f9 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:42.063097 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013b019-79b1-45cb-a85f-0d1305ea52f9 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:42.063097 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a013b019-79b1-45cb-a85f-0d1305ea52f9 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:42.064923 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 517/1023] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:42.070245 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf245b70-cd7f-45a2-bfb1-e23fe93a8fc3 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:42.070624 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf245b70-cd7f-45a2-bfb1-e23fe93a8fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:42.070804 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf245b70-cd7f-45a2-bfb1-e23fe93a8fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:42.088788 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-cf245b70-cd7f-45a2-bfb1-e23fe93a8fc3 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:42.090056 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-cf245b70-cd7f-45a2-bfb1-e23fe93a8fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:42.108306 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 507/1024] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:42 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:42.133083 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013b019-79b1-45cb-a85f-0d1305ea52f9 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:42.145759 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a013b019-79b1-45cb-a85f-0d1305ea52f9 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:42.150112 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ee2cd-0936-4e49-94bb-b71b92b1ea50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:42.150888 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ee2cd-0936-4e49-94bb-b71b92b1ea50 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:42.151173 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ee2cd-0936-4e49-94bb-b71b92b1ea50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:42.151449 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ee2cd-0936-4e49-94bb-b71b92b1ea50 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:42.152118 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ee2cd-0936-4e49-94bb-b71b92b1ea50 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:42.154338 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ee2cd-0936-4e49-94bb-b71b92b1ea50 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:42.165321 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-6c6ee2cd-0936-4e49-94bb-b71b92b1ea50 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 09 04:28:42.166517 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 518/1025] 10.222.0.36 () {56 vars in 1126 bytes} [Wed Feb 9 04:28:42 2022] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:42.172508 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf245b70-cd7f-45a2-bfb1-e23fe93a8fc3 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:42.184598 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf245b70-cd7f-45a2-bfb1-e23fe93a8fc3 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:42.190553 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fef2d-ab06-4840-9334-d32de30ca6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:42.191216 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fef2d-ab06-4840-9334-d32de30ca6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:42.191502 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fef2d-ab06-4840-9334-d32de30ca6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:42.191781 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fef2d-ab06-4840-9334-d32de30ca6b2 admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:42.194297 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fef2d-ab06-4840-9334-d32de30ca6b2 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:42.194622 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fef2d-ab06-4840-9334-d32de30ca6b2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:42.196590 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fef2d-ab06-4840-9334-d32de30ca6b2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:42.207925 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 508/1026] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:42.209564 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ee2cd-0936-4e49-94bb-b71b92b1ea50 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:42.220018 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ee2cd-0936-4e49-94bb-b71b92b1ea50 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:42.224502 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cc2d5-9d1b-4ed5-898f-f184fbdcd629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:42.225193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cc2d5-9d1b-4ed5-898f-f184fbdcd629 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:42.225477 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cc2d5-9d1b-4ed5-898f-f184fbdcd629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:42.225750 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cc2d5-9d1b-4ed5-898f-f184fbdcd629 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:42.226462 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cc2d5-9d1b-4ed5-898f-f184fbdcd629 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:42.226764 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cc2d5-9d1b-4ed5-898f-f184fbdcd629 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:42.228354 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cc2d5-9d1b-4ed5-898f-f184fbdcd629 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:42.233767 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 519/1027] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:42.239304 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fef2d-ab06-4840-9334-d32de30ca6b2 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:42.250895 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fef2d-ab06-4840-9334-d32de30ca6b2 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:42.256104 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb27e4-0de1-4248-a689-eb4f0133a9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:42.256743 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb27e4-0de1-4248-a689-eb4f0133a9be admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:42.257044 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb27e4-0de1-4248-a689-eb4f0133a9be admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:42.257325 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb27e4-0de1-4248-a689-eb4f0133a9be admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:42.258083 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb27e4-0de1-4248-a689-eb4f0133a9be admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:42.260453 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fb27e4-0de1-4248-a689-eb4f0133a9be admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:42.281157 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 509/1028] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Feb 9 04:28:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:28:42.731548 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c1b5d-3803-45a7-ac38-08bce5b01fe8 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:42.731927 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c1b5d-3803-45a7-ac38-08bce5b01fe8 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:42.732102 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c1b5d-3803-45a7-ac38-08bce5b01fe8 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:42.734052 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 520/1029] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:42.739046 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cd349-c54d-49ee-b08a-d0aa065595a9 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:42.739335 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cd349-c54d-49ee-b08a-d0aa065595a9 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:42.739610 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cd349-c54d-49ee-b08a-d0aa065595a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:42.757246 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-663cd349-c54d-49ee-b08a-d0aa065595a9 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:42.758414 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-663cd349-c54d-49ee-b08a-d0aa065595a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:42.775405 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 510/1030] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:42 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:42.799271 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c1b5d-3803-45a7-ac38-08bce5b01fe8 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:42.811562 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c1b5d-3803-45a7-ac38-08bce5b01fe8 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:42.815774 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032439a1-c215-4ada-8fae-f348cb7ea392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:42.816548 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032439a1-c215-4ada-8fae-f348cb7ea392 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:42.816826 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032439a1-c215-4ada-8fae-f348cb7ea392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:42.817124 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032439a1-c215-4ada-8fae-f348cb7ea392 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:42.818281 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032439a1-c215-4ada-8fae-f348cb7ea392 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:42.819963 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032439a1-c215-4ada-8fae-f348cb7ea392 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:42.821872 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 521/1031] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:42.827176 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cd349-c54d-49ee-b08a-d0aa065595a9 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:42.835841 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cd349-c54d-49ee-b08a-d0aa065595a9 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:42.840206 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8b14f-4543-4f2f-b756-3ea8715dcc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:42.840844 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8b14f-4543-4f2f-b756-3ea8715dcc21 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:42.841153 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8b14f-4543-4f2f-b756-3ea8715dcc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:42.841428 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8b14f-4543-4f2f-b756-3ea8715dcc21 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:42.842147 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8b14f-4543-4f2f-b756-3ea8715dcc21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:42.844010 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8b14f-4543-4f2f-b756-3ea8715dcc21 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:42.877078 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 511/1032] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Feb 9 04:28:42 2022] POST /identity/v3/projects => generated 311 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:28:43.253874 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ae874-c6ff-42d8-b7dc-42a574748c7a None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:43.254433 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ae874-c6ff-42d8-b7dc-42a574748c7a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:43.254433 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ae874-c6ff-42d8-b7dc-42a574748c7a None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:43.256199 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 522/1033] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:43.261715 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4091d-4618-4898-a4f4-1cb52f41e662 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:43.262169 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4091d-4618-4898-a4f4-1cb52f41e662 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:43.262268 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4091d-4618-4898-a4f4-1cb52f41e662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:43.280065 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-7ff4091d-4618-4898-a4f4-1cb52f41e662 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:43.281264 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7ff4091d-4618-4898-a4f4-1cb52f41e662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:43.336163 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 512/1034] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:43 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:28:43.361203 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ae874-c6ff-42d8-b7dc-42a574748c7a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:43.373168 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ae874-c6ff-42d8-b7dc-42a574748c7a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:43.377431 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4635f-6d0b-4dda-b2a6-41fe267ac9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:43.378226 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4635f-6d0b-4dda-b2a6-41fe267ac9cb admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:43.378509 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4635f-6d0b-4dda-b2a6-41fe267ac9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:43.378785 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4635f-6d0b-4dda-b2a6-41fe267ac9cb admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:43.392097 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4635f-6d0b-4dda-b2a6-41fe267ac9cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:43.399513 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-86f4635f-6d0b-4dda-b2a6-41fe267ac9cb admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 09 04:28:43.400888 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 523/1035] 10.222.0.36 () {56 vars in 1141 bytes} [Wed Feb 9 04:28:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:43.407417 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4091d-4618-4898-a4f4-1cb52f41e662 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:43.416938 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4091d-4618-4898-a4f4-1cb52f41e662 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:43.421570 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cbf30-7efd-4458-8d34-b8639c2076f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:43.422237 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cbf30-7efd-4458-8d34-b8639c2076f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:43.422517 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cbf30-7efd-4458-8d34-b8639c2076f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:43.422790 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cbf30-7efd-4458-8d34-b8639c2076f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:43.423555 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cbf30-7efd-4458-8d34-b8639c2076f1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:43.423858 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cbf30-7efd-4458-8d34-b8639c2076f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:43.425476 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cbf30-7efd-4458-8d34-b8639c2076f1 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:43.434147 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 513/1036] 10.222.0.36 () {56 vars in 1136 bytes} [Wed Feb 9 04:28:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:43.439764 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4635f-6d0b-4dda-b2a6-41fe267ac9cb admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:43.450192 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4635f-6d0b-4dda-b2a6-41fe267ac9cb admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:43.454674 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947daeed-6a60-4427-add9-cbd46512aadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:43.455468 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947daeed-6a60-4427-add9-cbd46512aadf admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:43.455750 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947daeed-6a60-4427-add9-cbd46512aadf admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:43.456016 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947daeed-6a60-4427-add9-cbd46512aadf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:43.466578 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947daeed-6a60-4427-add9-cbd46512aadf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:43.468413 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947daeed-6a60-4427-add9-cbd46512aadf admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:43.484669 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-947daeed-6a60-4427-add9-cbd46512aadf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:43.486013 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 524/1037] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:43.491360 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cbf30-7efd-4458-8d34-b8639c2076f1 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:43.500990 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cbf30-7efd-4458-8d34-b8639c2076f1 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:43.505518 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0df321-9be2-4ddd-90be-63d801438bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:43.506109 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0df321-9be2-4ddd-90be-63d801438bae admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:43.506394 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0df321-9be2-4ddd-90be-63d801438bae admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:43.506669 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0df321-9be2-4ddd-90be-63d801438bae admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:43.507396 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0df321-9be2-4ddd-90be-63d801438bae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:43.507700 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0df321-9be2-4ddd-90be-63d801438bae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:43.509298 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0df321-9be2-4ddd-90be-63d801438bae admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:43.521933 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 514/1038] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:43.527178 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947daeed-6a60-4427-add9-cbd46512aadf admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:43.537401 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947daeed-6a60-4427-add9-cbd46512aadf admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:43.541818 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe7ab3-bb36-4762-a97c-011c4c129aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:43.542588 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe7ab3-bb36-4762-a97c-011c4c129aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:43.542878 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe7ab3-bb36-4762-a97c-011c4c129aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:43.543185 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe7ab3-bb36-4762-a97c-011c4c129aa0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:43.553812 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe7ab3-bb36-4762-a97c-011c4c129aa0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:43.555905 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe7ab3-bb36-4762-a97c-011c4c129aa0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:43.571851 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-5efe7ab3-bb36-4762-a97c-011c4c129aa0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 09 04:28:43.574878 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 525/1039] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Feb 9 04:28:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:43.577309 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0df321-9be2-4ddd-90be-63d801438bae admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:43.587317 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0df321-9be2-4ddd-90be-63d801438bae admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:43.592549 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e868bb-fe1e-4c46-ad12-1312f534a78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:43.593235 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e868bb-fe1e-4c46-ad12-1312f534a78f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:43.593520 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e868bb-fe1e-4c46-ad12-1312f534a78f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:43.593842 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e868bb-fe1e-4c46-ad12-1312f534a78f admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:43.594689 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e868bb-fe1e-4c46-ad12-1312f534a78f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:43.595047 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e868bb-fe1e-4c46-ad12-1312f534a78f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:43.596942 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e868bb-fe1e-4c46-ad12-1312f534a78f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:43.614786 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 515/1040] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Feb 9 04:28:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:43.620198 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe7ab3-bb36-4762-a97c-011c4c129aa0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:43.629912 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe7ab3-bb36-4762-a97c-011c4c129aa0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:43.634509 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0f6e8-9f96-4847-9e1b-afde9cb21e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:43.635136 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0f6e8-9f96-4847-9e1b-afde9cb21e6d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:43.635478 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0f6e8-9f96-4847-9e1b-afde9cb21e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:43.635756 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0f6e8-9f96-4847-9e1b-afde9cb21e6d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:43.644136 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0f6e8-9f96-4847-9e1b-afde9cb21e6d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:43.645987 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae0f6e8-9f96-4847-9e1b-afde9cb21e6d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:43.655672 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 526/1041] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:43 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:28:43.661196 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e868bb-fe1e-4c46-ad12-1312f534a78f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:43.671071 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e868bb-fe1e-4c46-ad12-1312f534a78f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:43.675518 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af79e6-bbc4-4f0b-bdf4-21e6cf908d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:43.676289 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af79e6-bbc4-4f0b-bdf4-21e6cf908d86 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:43.676573 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af79e6-bbc4-4f0b-bdf4-21e6cf908d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:43.676845 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af79e6-bbc4-4f0b-bdf4-21e6cf908d86 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:43.687568 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af79e6-bbc4-4f0b-bdf4-21e6cf908d86 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:43.689423 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af79e6-bbc4-4f0b-bdf4-21e6cf908d86 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:43.706979 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-34af79e6-bbc4-4f0b-bdf4-21e6cf908d86 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:43.708358 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 516/1042] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:43.713779 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0f6e8-9f96-4847-9e1b-afde9cb21e6d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:43.723274 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0f6e8-9f96-4847-9e1b-afde9cb21e6d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:43.727817 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e84d9d-3cab-48d3-b838-88b8373b1779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:43.728537 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84d9d-3cab-48d3-b838-88b8373b1779 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:43.728902 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84d9d-3cab-48d3-b838-88b8373b1779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:43.729268 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84d9d-3cab-48d3-b838-88b8373b1779 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:43.730086 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e84d9d-3cab-48d3-b838-88b8373b1779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:43.730458 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e84d9d-3cab-48d3-b838-88b8373b1779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:43.732157 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e84d9d-3cab-48d3-b838-88b8373b1779 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:43.743817 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 527/1043] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:43.749970 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af79e6-bbc4-4f0b-bdf4-21e6cf908d86 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:43.759564 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af79e6-bbc4-4f0b-bdf4-21e6cf908d86 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:43.764534 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c7663-aae6-4a3d-9aa8-398fd132e4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:43.765343 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c7663-aae6-4a3d-9aa8-398fd132e4cb admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:43.765627 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c7663-aae6-4a3d-9aa8-398fd132e4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:43.765902 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c7663-aae6-4a3d-9aa8-398fd132e4cb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:43.772638 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c7663-aae6-4a3d-9aa8-398fd132e4cb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:43.774607 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c7663-aae6-4a3d-9aa8-398fd132e4cb admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:43.787564 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-b40c7663-aae6-4a3d-9aa8-398fd132e4cb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:43.789919 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 517/1044] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:43.794366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e84d9d-3cab-48d3-b838-88b8373b1779 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:43.804047 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e84d9d-3cab-48d3-b838-88b8373b1779 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:43.808466 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e525194-6b7f-47af-892e-bd47daee0a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:43.809667 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e525194-6b7f-47af-892e-bd47daee0a0b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:43.809953 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e525194-6b7f-47af-892e-bd47daee0a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:43.810229 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e525194-6b7f-47af-892e-bd47daee0a0b admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:43.811118 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e525194-6b7f-47af-892e-bd47daee0a0b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:43.811428 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e525194-6b7f-47af-892e-bd47daee0a0b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:43.813343 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e525194-6b7f-47af-892e-bd47daee0a0b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:43.826551 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 528/1045] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:43.832295 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c7663-aae6-4a3d-9aa8-398fd132e4cb admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:43.842462 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c7663-aae6-4a3d-9aa8-398fd132e4cb admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:43.847071 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425ad05-4744-46e5-b2c3-f392f3d210d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:43.847700 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425ad05-4744-46e5-b2c3-f392f3d210d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:43.847981 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425ad05-4744-46e5-b2c3-f392f3d210d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:43.848254 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425ad05-4744-46e5-b2c3-f392f3d210d5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:43.849117 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425ad05-4744-46e5-b2c3-f392f3d210d5 admin admin] RBAC: Adding query filter params (role.id=a4bddbbd5f64404a90db53f5db02078b, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=63fe98c10e974c019e05a2f68d012ba8) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:43.849428 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425ad05-4744-46e5-b2c3-f392f3d210d5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:43.851242 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425ad05-4744-46e5-b2c3-f392f3d210d5 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:43.863174 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 518/1046] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:28:43 2022] GET /identity/v3/role_assignments?user.id=63fe98c10e974c019e05a2f68d012ba8&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=a4bddbbd5f64404a90db53f5db02078b => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:44.510027 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1fe48-99a9-45bd-a268-5d0d012fda64 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:44.510547 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1fe48-99a9-45bd-a268-5d0d012fda64 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:44.510624 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1fe48-99a9-45bd-a268-5d0d012fda64 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:44.512578 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 529/1047] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:44.517683 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af8061-eea3-40aa-9933-5b6a27a9aa56 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:44.518078 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af8061-eea3-40aa-9933-5b6a27a9aa56 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:44.518269 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af8061-eea3-40aa-9933-5b6a27a9aa56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:44.537395 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-29af8061-eea3-40aa-9933-5b6a27a9aa56 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:44.538570 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-29af8061-eea3-40aa-9933-5b6a27a9aa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:44.549641 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 519/1048] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:44 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:44.572133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1fe48-99a9-45bd-a268-5d0d012fda64 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:44.583796 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1fe48-99a9-45bd-a268-5d0d012fda64 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:44.588022 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e2085-5951-4b8a-9b9a-a1d1cd19ebc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:44.588655 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e2085-5951-4b8a-9b9a-a1d1cd19ebc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:44.588934 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e2085-5951-4b8a-9b9a-a1d1cd19ebc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:44.589251 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e2085-5951-4b8a-9b9a-a1d1cd19ebc5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:44.597691 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e2085-5951-4b8a-9b9a-a1d1cd19ebc5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:44.599430 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6e2085-5951-4b8a-9b9a-a1d1cd19ebc5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:44.609283 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 530/1049] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:44 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:28:44.614783 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af8061-eea3-40aa-9933-5b6a27a9aa56 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:44.623585 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af8061-eea3-40aa-9933-5b6a27a9aa56 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:44.629740 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42ab21-745c-4bcd-84d7-1f610f8800c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:44.630531 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42ab21-745c-4bcd-84d7-1f610f8800c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:44.630809 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42ab21-745c-4bcd-84d7-1f610f8800c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:44.631077 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42ab21-745c-4bcd-84d7-1f610f8800c0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:44.632284 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42ab21-745c-4bcd-84d7-1f610f8800c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:44.634027 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42ab21-745c-4bcd-84d7-1f610f8800c0 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:44.635827 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 520/1050] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:45.161554 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea4ad0-af4b-4372-90a5-544bc2fac9f3 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:45.162096 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea4ad0-af4b-4372-90a5-544bc2fac9f3 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:45.162376 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea4ad0-af4b-4372-90a5-544bc2fac9f3 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:45.164155 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 531/1051] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:28:45.169543 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7f4f1-35be-4353-8896-c92cf42ac81c None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:45.169829 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7f4f1-35be-4353-8896-c92cf42ac81c None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:45.170102 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7f4f1-35be-4353-8896-c92cf42ac81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:45.303721 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-c5a7f4f1-35be-4353-8896-c92cf42ac81c None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:45.304893 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-c5a7f4f1-35be-4353-8896-c92cf42ac81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:45.313073 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 521/1052] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:45 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:45.337963 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea4ad0-af4b-4372-90a5-544bc2fac9f3 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:45.349780 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea4ad0-af4b-4372-90a5-544bc2fac9f3 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:45.354077 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2fd9f-6c66-4188-8371-c58ac8a141cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:45.354851 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2fd9f-6c66-4188-8371-c58ac8a141cb admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:45.355131 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2fd9f-6c66-4188-8371-c58ac8a141cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:45.355405 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2fd9f-6c66-4188-8371-c58ac8a141cb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:45.356558 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2fd9f-6c66-4188-8371-c58ac8a141cb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:45.358263 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2fd9f-6c66-4188-8371-c58ac8a141cb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:45.359831 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 532/1053] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:45.365559 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7f4f1-35be-4353-8896-c92cf42ac81c None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:45.374785 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7f4f1-35be-4353-8896-c92cf42ac81c None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:45.379137 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00841f-db4a-4f61-b0b7-31a6a4383a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:45.379774 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00841f-db4a-4f61-b0b7-31a6a4383a03 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:45.380049 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00841f-db4a-4f61-b0b7-31a6a4383a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:45.380316 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00841f-db4a-4f61-b0b7-31a6a4383a03 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:45.381058 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00841f-db4a-4f61-b0b7-31a6a4383a03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:45.382927 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00841f-db4a-4f61-b0b7-31a6a4383a03 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:45.403478 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 522/1054] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Feb 9 04:28:45 2022] POST /identity/v3/users => generated 285 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:28:46.054730 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5fc02-140f-43d2-aa8b-314f4e5f0dde None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:46.055264 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5fc02-140f-43d2-aa8b-314f4e5f0dde None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:46.055264 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5fc02-140f-43d2-aa8b-314f4e5f0dde None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:46.057025 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 533/1055] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:46.062181 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151ae47-769e-4988-bc0e-2c682e04d1cc None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:46.062575 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151ae47-769e-4988-bc0e-2c682e04d1cc None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:46.062849 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151ae47-769e-4988-bc0e-2c682e04d1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:46.079940 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-4151ae47-769e-4988-bc0e-2c682e04d1cc None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:46.081141 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-4151ae47-769e-4988-bc0e-2c682e04d1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:46.088560 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 523/1056] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:46 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:46.112208 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5fc02-140f-43d2-aa8b-314f4e5f0dde None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:46.124268 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5fc02-140f-43d2-aa8b-314f4e5f0dde None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:46.128473 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f2b6f-b26f-48fb-b28b-d5ea60e6bf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:46.129296 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f2b6f-b26f-48fb-b28b-d5ea60e6bf18 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:46.129576 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f2b6f-b26f-48fb-b28b-d5ea60e6bf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:46.129849 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f2b6f-b26f-48fb-b28b-d5ea60e6bf18 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:46.139692 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f2b6f-b26f-48fb-b28b-d5ea60e6bf18 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:46.146918 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-8b4f2b6f-b26f-48fb-b28b-d5ea60e6bf18 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 09 04:28:46.148216 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 534/1057] 10.222.0.36 () {56 vars in 1141 bytes} [Wed Feb 9 04:28:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:46.155839 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151ae47-769e-4988-bc0e-2c682e04d1cc None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:46.164918 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151ae47-769e-4988-bc0e-2c682e04d1cc None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:46.170002 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab90861-2b1f-42d0-bdf2-f8b316a87e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:46.170725 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab90861-2b1f-42d0-bdf2-f8b316a87e24 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:46.171070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab90861-2b1f-42d0-bdf2-f8b316a87e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:46.171406 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab90861-2b1f-42d0-bdf2-f8b316a87e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:46.172227 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab90861-2b1f-42d0-bdf2-f8b316a87e24 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:46.172597 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab90861-2b1f-42d0-bdf2-f8b316a87e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:46.174267 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab90861-2b1f-42d0-bdf2-f8b316a87e24 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:46.182215 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 524/1058] 10.222.0.36 () {56 vars in 1136 bytes} [Wed Feb 9 04:28:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:46.187776 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f2b6f-b26f-48fb-b28b-d5ea60e6bf18 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:46.198146 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f2b6f-b26f-48fb-b28b-d5ea60e6bf18 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:46.202626 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88d96f-042a-48f0-a09c-7df8db10c078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:46.203389 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88d96f-042a-48f0-a09c-7df8db10c078 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:46.203671 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88d96f-042a-48f0-a09c-7df8db10c078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:46.203940 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88d96f-042a-48f0-a09c-7df8db10c078 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:46.213811 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88d96f-042a-48f0-a09c-7df8db10c078 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:46.216254 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88d96f-042a-48f0-a09c-7df8db10c078 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:46.232950 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-af88d96f-042a-48f0-a09c-7df8db10c078 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:46.234142 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 535/1059] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:46.239683 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab90861-2b1f-42d0-bdf2-f8b316a87e24 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:46.249210 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab90861-2b1f-42d0-bdf2-f8b316a87e24 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:46.253581 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47500684-3242-4b47-a9fe-edc44fd0cc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:46.254223 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47500684-3242-4b47-a9fe-edc44fd0cc5c admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:46.254504 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47500684-3242-4b47-a9fe-edc44fd0cc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:46.254774 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47500684-3242-4b47-a9fe-edc44fd0cc5c admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:46.255498 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47500684-3242-4b47-a9fe-edc44fd0cc5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:46.255804 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47500684-3242-4b47-a9fe-edc44fd0cc5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:46.257402 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47500684-3242-4b47-a9fe-edc44fd0cc5c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:46.268607 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 525/1060] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:46.274131 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88d96f-042a-48f0-a09c-7df8db10c078 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:46.284210 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88d96f-042a-48f0-a09c-7df8db10c078 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:46.288880 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb7fb3-7774-4d90-b57f-0ba52c0703c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:46.289681 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb7fb3-7774-4d90-b57f-0ba52c0703c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:46.289963 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb7fb3-7774-4d90-b57f-0ba52c0703c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:46.290238 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb7fb3-7774-4d90-b57f-0ba52c0703c4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:46.297864 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb7fb3-7774-4d90-b57f-0ba52c0703c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:46.299871 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb7fb3-7774-4d90-b57f-0ba52c0703c4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:46.313265 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-7cfb7fb3-7774-4d90-b57f-0ba52c0703c4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 09 04:28:46.318718 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 536/1061] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Feb 9 04:28:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:46.319879 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47500684-3242-4b47-a9fe-edc44fd0cc5c admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:46.329355 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47500684-3242-4b47-a9fe-edc44fd0cc5c admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:46.333769 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91566c90-7fb2-4a84-90fe-e18b96da4b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:46.334405 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91566c90-7fb2-4a84-90fe-e18b96da4b86 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:46.334681 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91566c90-7fb2-4a84-90fe-e18b96da4b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:46.334950 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91566c90-7fb2-4a84-90fe-e18b96da4b86 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:46.335786 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91566c90-7fb2-4a84-90fe-e18b96da4b86 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:46.336087 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91566c90-7fb2-4a84-90fe-e18b96da4b86 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:46.338019 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91566c90-7fb2-4a84-90fe-e18b96da4b86 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:46.359719 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 526/1062] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Feb 9 04:28:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:46.360825 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb7fb3-7774-4d90-b57f-0ba52c0703c4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:46.370089 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb7fb3-7774-4d90-b57f-0ba52c0703c4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:46.374423 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3304c-03b7-48aa-b5dd-e9f8183d1bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:46.375180 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3304c-03b7-48aa-b5dd-e9f8183d1bfe admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:46.375459 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3304c-03b7-48aa-b5dd-e9f8183d1bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:46.375729 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3304c-03b7-48aa-b5dd-e9f8183d1bfe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:46.385484 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3304c-03b7-48aa-b5dd-e9f8183d1bfe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:46.387857 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3304c-03b7-48aa-b5dd-e9f8183d1bfe admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:46.404441 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-61a3304c-03b7-48aa-b5dd-e9f8183d1bfe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:46.405673 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 537/1063] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:46.411183 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91566c90-7fb2-4a84-90fe-e18b96da4b86 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:46.420928 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91566c90-7fb2-4a84-90fe-e18b96da4b86 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:46.425336 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df621c78-e049-4dc4-8215-a438369fbbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:46.425971 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df621c78-e049-4dc4-8215-a438369fbbeb admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:46.426251 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df621c78-e049-4dc4-8215-a438369fbbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:46.426526 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df621c78-e049-4dc4-8215-a438369fbbeb admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:46.427249 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df621c78-e049-4dc4-8215-a438369fbbeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:46.427552 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df621c78-e049-4dc4-8215-a438369fbbeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:46.429132 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df621c78-e049-4dc4-8215-a438369fbbeb admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:46.440133 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 527/1064] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:46.445496 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3304c-03b7-48aa-b5dd-e9f8183d1bfe admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:46.455452 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3304c-03b7-48aa-b5dd-e9f8183d1bfe admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:46.459897 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e4778-6c22-400c-af0b-3605b4e51828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:46.460658 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e4778-6c22-400c-af0b-3605b4e51828 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:46.460933 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e4778-6c22-400c-af0b-3605b4e51828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:46.461235 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e4778-6c22-400c-af0b-3605b4e51828 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:46.468471 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e4778-6c22-400c-af0b-3605b4e51828 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:46.470462 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e4778-6c22-400c-af0b-3605b4e51828 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:46.483019 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-4c3e4778-6c22-400c-af0b-3605b4e51828 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:46.484304 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 538/1065] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:46.489727 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df621c78-e049-4dc4-8215-a438369fbbeb admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:46.499242 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df621c78-e049-4dc4-8215-a438369fbbeb admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:46.503606 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db313f10-252d-47aa-b906-c0e78fae276f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:46.504233 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db313f10-252d-47aa-b906-c0e78fae276f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:46.504511 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db313f10-252d-47aa-b906-c0e78fae276f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:46.504779 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db313f10-252d-47aa-b906-c0e78fae276f admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:46.505606 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db313f10-252d-47aa-b906-c0e78fae276f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:46.505911 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db313f10-252d-47aa-b906-c0e78fae276f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:46.507729 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db313f10-252d-47aa-b906-c0e78fae276f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:46.519751 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 528/1066] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:46.525284 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e4778-6c22-400c-af0b-3605b4e51828 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:46.535865 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e4778-6c22-400c-af0b-3605b4e51828 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:46.540498 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e61a9ad-4953-43eb-8734-7a8449dc1d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:46.541379 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61a9ad-4953-43eb-8734-7a8449dc1d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:46.541659 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61a9ad-4953-43eb-8734-7a8449dc1d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:46.541933 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e61a9ad-4953-43eb-8734-7a8449dc1d48 admin admin] PATH_INFO: `/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/63fe98c10e974c019e05a2f68d012ba8/roles/a4bddbbd5f64404a90db53f5db02078b` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:46.544133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61a9ad-4953-43eb-8734-7a8449dc1d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e618c4377ec64e2e8a6d332696019fac, user_id=63fe98c10e974c019e05a2f68d012ba8, role_id=a4bddbbd5f64404a90db53f5db02078b)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:46.546839 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e61a9ad-4953-43eb-8734-7a8449dc1d48 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:46.561280 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 539/1067] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:28:46 2022] PUT /identity/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/63fe98c10e974c019e05a2f68d012ba8/roles/a4bddbbd5f64404a90db53f5db02078b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:28:47.673637 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b0bb4-30cd-41e5-af36-d5cc24ee8a18 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:47.674155 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b0bb4-30cd-41e5-af36-d5cc24ee8a18 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:47.674277 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b0bb4-30cd-41e5-af36-d5cc24ee8a18 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:47.675952 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 529/1068] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:47.681220 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eb377-89f6-4a70-9926-aacb3206099d None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:47.681627 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eb377-89f6-4a70-9926-aacb3206099d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:47.681915 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eb377-89f6-4a70-9926-aacb3206099d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:47.699188 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-282eb377-89f6-4a70-9926-aacb3206099d None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:47.700364 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-282eb377-89f6-4a70-9926-aacb3206099d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:47.754871 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 540/1069] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:47 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:28:47.778781 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b0bb4-30cd-41e5-af36-d5cc24ee8a18 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:47.791015 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b0bb4-30cd-41e5-af36-d5cc24ee8a18 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:47.795920 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958033f-66b3-46e6-9fa6-9bb207fe45c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:47.796688 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958033f-66b3-46e6-9fa6-9bb207fe45c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:47.796969 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958033f-66b3-46e6-9fa6-9bb207fe45c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:47.797273 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958033f-66b3-46e6-9fa6-9bb207fe45c7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:47.807147 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958033f-66b3-46e6-9fa6-9bb207fe45c7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:47.813939 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-f958033f-66b3-46e6-9fa6-9bb207fe45c7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:28:47.815068 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 530/1070] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:28:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:47.820800 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282eb377-89f6-4a70-9926-aacb3206099d None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:47.829505 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282eb377-89f6-4a70-9926-aacb3206099d None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:47.833924 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed302bd-ba61-4fb8-b15e-cec39cb30dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:47.834569 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed302bd-ba61-4fb8-b15e-cec39cb30dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:47.834852 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed302bd-ba61-4fb8-b15e-cec39cb30dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:47.835135 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed302bd-ba61-4fb8-b15e-cec39cb30dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:47.835893 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed302bd-ba61-4fb8-b15e-cec39cb30dd2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:47.836197 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed302bd-ba61-4fb8-b15e-cec39cb30dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:47.837846 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed302bd-ba61-4fb8-b15e-cec39cb30dd2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:47.846422 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 541/1071] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:28:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:47.851636 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958033f-66b3-46e6-9fa6-9bb207fe45c7 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:47.862087 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958033f-66b3-46e6-9fa6-9bb207fe45c7 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:47.866489 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7983a-cb63-4126-a728-26ef39a343c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:47.867307 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7983a-cb63-4126-a728-26ef39a343c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:47.867591 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7983a-cb63-4126-a728-26ef39a343c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:47.867882 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7983a-cb63-4126-a728-26ef39a343c4 admin admin] PATH_INFO: `/v3/users/22ff762b7a334994924d22be00d9bb5a` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:47.880337 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7983a-cb63-4126-a728-26ef39a343c4 admin admin] RBAC: Authorizing `identity:get_user(user_id=22ff762b7a334994924d22be00d9bb5a)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:47.882494 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7983a-cb63-4126-a728-26ef39a343c4 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:47.884075 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 531/1072] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:28:47 2022] GET /identity/v3/users/22ff762b7a334994924d22be00d9bb5a => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:47.889783 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed302bd-ba61-4fb8-b15e-cec39cb30dd2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:47.898993 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed302bd-ba61-4fb8-b15e-cec39cb30dd2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:47.904036 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61d03a-7352-4c69-bc15-ea3efd07e55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:47.904652 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61d03a-7352-4c69-bc15-ea3efd07e55e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:47.904938 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61d03a-7352-4c69-bc15-ea3efd07e55e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:47.905252 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61d03a-7352-4c69-bc15-ea3efd07e55e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:47.913105 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61d03a-7352-4c69-bc15-ea3efd07e55e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:47.914830 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61d03a-7352-4c69-bc15-ea3efd07e55e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:47.923461 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 542/1073] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:47 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:28:47.928750 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7983a-cb63-4126-a728-26ef39a343c4 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:47.937898 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7983a-cb63-4126-a728-26ef39a343c4 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:47.942357 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9dfb5-8777-457c-abb8-ba1984e615d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:47.943171 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9dfb5-8777-457c-abb8-ba1984e615d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:47.943511 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9dfb5-8777-457c-abb8-ba1984e615d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:47.943790 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9dfb5-8777-457c-abb8-ba1984e615d0 admin admin] PATH_INFO: `/v3/projects/b50cca43472f44e3a60d8cb167e6664d` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:47.944949 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9dfb5-8777-457c-abb8-ba1984e615d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=b50cca43472f44e3a60d8cb167e6664d)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:47.946969 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac9dfb5-8777-457c-abb8-ba1984e615d0 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:47.948588 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 532/1074] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:28:47 2022] GET /identity/v3/projects/b50cca43472f44e3a60d8cb167e6664d => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:47.954802 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61d03a-7352-4c69-bc15-ea3efd07e55e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:47.963292 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61d03a-7352-4c69-bc15-ea3efd07e55e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:47.968356 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9da6b-81f7-488b-84a8-098ed4a84724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:47.968979 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9da6b-81f7-488b-84a8-098ed4a84724 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:47.969300 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9da6b-81f7-488b-84a8-098ed4a84724 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:47.969592 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9da6b-81f7-488b-84a8-098ed4a84724 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:47.970416 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9da6b-81f7-488b-84a8-098ed4a84724 admin admin] RBAC: Adding query filter params (role.id=05ca9a16ef2a450b8cc73ade47f5c7d0, scope.project.id=b50cca43472f44e3a60d8cb167e6664d, user.id=22ff762b7a334994924d22be00d9bb5a) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:47.970730 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9da6b-81f7-488b-84a8-098ed4a84724 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:47.972552 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa9da6b-81f7-488b-84a8-098ed4a84724 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:47.977868 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 543/1075] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:28:47 2022] GET /identity/v3/role_assignments?user.id=22ff762b7a334994924d22be00d9bb5a&scope.project.id=b50cca43472f44e3a60d8cb167e6664d&role.id=05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:48.752522 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e9efb-a766-450e-8861-f4f1d8c160a8 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:48.753056 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e9efb-a766-450e-8861-f4f1d8c160a8 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:48.753241 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e9efb-a766-450e-8861-f4f1d8c160a8 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:48.754954 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 533/1076] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:48.760183 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f99e5-04f1-4079-95bb-4718eebcb218 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:48.760625 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f99e5-04f1-4079-95bb-4718eebcb218 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:48.760717 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f99e5-04f1-4079-95bb-4718eebcb218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:48.777989 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-f71f99e5-04f1-4079-95bb-4718eebcb218 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:48.779269 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f71f99e5-04f1-4079-95bb-4718eebcb218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:48.786996 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 544/1077] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:48 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:48.811113 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e9efb-a766-450e-8861-f4f1d8c160a8 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:48.822922 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9e9efb-a766-450e-8861-f4f1d8c160a8 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:48.827253 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ff66d-7d49-48b6-87c6-eced0e3148df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:48.828104 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ff66d-7d49-48b6-87c6-eced0e3148df admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:48.828443 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ff66d-7d49-48b6-87c6-eced0e3148df admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:48.828775 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ff66d-7d49-48b6-87c6-eced0e3148df admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:48.838604 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ff66d-7d49-48b6-87c6-eced0e3148df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:48.845919 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-a40ff66d-7d49-48b6-87c6-eced0e3148df admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 09 04:28:48.847059 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 534/1078] 10.222.0.36 () {56 vars in 1141 bytes} [Wed Feb 9 04:28:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:48.852752 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f99e5-04f1-4079-95bb-4718eebcb218 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:48.862197 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f99e5-04f1-4079-95bb-4718eebcb218 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:48.866647 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a374c-11cc-4487-a08d-71c339783386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:48.867306 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a374c-11cc-4487-a08d-71c339783386 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:48.867585 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a374c-11cc-4487-a08d-71c339783386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:48.867858 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a374c-11cc-4487-a08d-71c339783386 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:48.868616 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a374c-11cc-4487-a08d-71c339783386 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:48.868922 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a374c-11cc-4487-a08d-71c339783386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:48.870568 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a374c-11cc-4487-a08d-71c339783386 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:48.879442 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 545/1079] 10.222.0.36 () {56 vars in 1136 bytes} [Wed Feb 9 04:28:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:48.885241 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ff66d-7d49-48b6-87c6-eced0e3148df admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:48.895215 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ff66d-7d49-48b6-87c6-eced0e3148df admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:48.899574 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63391c4-5f87-4bdc-ae9d-1b181cae9b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:48.900328 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63391c4-5f87-4bdc-ae9d-1b181cae9b42 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:48.900611 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63391c4-5f87-4bdc-ae9d-1b181cae9b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:48.900881 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63391c4-5f87-4bdc-ae9d-1b181cae9b42 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:48.910784 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63391c4-5f87-4bdc-ae9d-1b181cae9b42 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:48.912870 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63391c4-5f87-4bdc-ae9d-1b181cae9b42 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:48.929549 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-d63391c4-5f87-4bdc-ae9d-1b181cae9b42 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:48.930713 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 535/1080] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:48.936963 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a374c-11cc-4487-a08d-71c339783386 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:48.946510 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a374c-11cc-4487-a08d-71c339783386 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:48.950928 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1df90-3318-4b81-b3d7-c8af27defb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:48.951572 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1df90-3318-4b81-b3d7-c8af27defb6a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:48.951854 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1df90-3318-4b81-b3d7-c8af27defb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:48.952131 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1df90-3318-4b81-b3d7-c8af27defb6a admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:48.952868 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1df90-3318-4b81-b3d7-c8af27defb6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:48.953209 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1df90-3318-4b81-b3d7-c8af27defb6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:48.954818 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb1df90-3318-4b81-b3d7-c8af27defb6a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:48.966712 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 546/1081] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:48.972039 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63391c4-5f87-4bdc-ae9d-1b181cae9b42 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:48.982128 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63391c4-5f87-4bdc-ae9d-1b181cae9b42 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:48.986482 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca084d-eee3-4abc-aa82-6dce13cc1b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:48.987249 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca084d-eee3-4abc-aa82-6dce13cc1b18 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:48.987526 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca084d-eee3-4abc-aa82-6dce13cc1b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:48.987798 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca084d-eee3-4abc-aa82-6dce13cc1b18 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:48.994966 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca084d-eee3-4abc-aa82-6dce13cc1b18 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:48.997614 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca084d-eee3-4abc-aa82-6dce13cc1b18 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:49.010836 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-07ca084d-eee3-4abc-aa82-6dce13cc1b18 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 09 04:28:49.012033 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 536/1082] 10.222.0.36 () {56 vars in 1114 bytes} [Wed Feb 9 04:28:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:28:49.017709 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1df90-3318-4b81-b3d7-c8af27defb6a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:49.027777 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1df90-3318-4b81-b3d7-c8af27defb6a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:49.032165 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83534218-f515-4f76-84bc-2d39d97a658a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:49.032817 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83534218-f515-4f76-84bc-2d39d97a658a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:49.033126 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83534218-f515-4f76-84bc-2d39d97a658a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:49.033398 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83534218-f515-4f76-84bc-2d39d97a658a admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:49.034239 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83534218-f515-4f76-84bc-2d39d97a658a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:49.034542 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83534218-f515-4f76-84bc-2d39d97a658a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:49.036382 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83534218-f515-4f76-84bc-2d39d97a658a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:49.053758 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 547/1083] 10.222.0.36 () {56 vars in 1154 bytes} [Wed Feb 9 04:28:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:49.059350 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca084d-eee3-4abc-aa82-6dce13cc1b18 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:49.068929 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca084d-eee3-4abc-aa82-6dce13cc1b18 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:49.073470 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b05b2-9290-498e-ab5a-60079175c288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:49.074124 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b05b2-9290-498e-ab5a-60079175c288 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:49.074403 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b05b2-9290-498e-ab5a-60079175c288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:49.074673 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b05b2-9290-498e-ab5a-60079175c288 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:49.083389 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b05b2-9290-498e-ab5a-60079175c288 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:49.085156 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b05b2-9290-498e-ab5a-60079175c288 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:49.094442 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 537/1084] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:49 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:28:49.100376 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83534218-f515-4f76-84bc-2d39d97a658a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:49.110571 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83534218-f515-4f76-84bc-2d39d97a658a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:49.114962 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5881e-0d57-417e-86fc-474433dfdf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:49.115732 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5881e-0d57-417e-86fc-474433dfdf68 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:49.116014 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5881e-0d57-417e-86fc-474433dfdf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:49.116289 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5881e-0d57-417e-86fc-474433dfdf68 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:49.126329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5881e-0d57-417e-86fc-474433dfdf68 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:49.128160 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5881e-0d57-417e-86fc-474433dfdf68 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:49.144341 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-72b5881e-0d57-417e-86fc-474433dfdf68 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:28:49.145512 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 548/1085] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:49.151061 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b05b2-9290-498e-ab5a-60079175c288 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:49.160437 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b05b2-9290-498e-ab5a-60079175c288 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:49.165260 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3c7f6-474b-404a-a601-bd99122c9b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:49.165903 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3c7f6-474b-404a-a601-bd99122c9b84 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:49.166187 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3c7f6-474b-404a-a601-bd99122c9b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:49.166463 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b3c7f6-474b-404a-a601-bd99122c9b84 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:49.167224 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3c7f6-474b-404a-a601-bd99122c9b84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:49.167530 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3c7f6-474b-404a-a601-bd99122c9b84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:49.169753 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b3c7f6-474b-404a-a601-bd99122c9b84 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:49.180752 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 538/1086] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:49.186155 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5881e-0d57-417e-86fc-474433dfdf68 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:49.195674 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5881e-0d57-417e-86fc-474433dfdf68 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:49.200112 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25391bf-ea57-4666-8396-bd05c5b3f7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:49.200881 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25391bf-ea57-4666-8396-bd05c5b3f7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:49.201200 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25391bf-ea57-4666-8396-bd05c5b3f7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:49.201479 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25391bf-ea57-4666-8396-bd05c5b3f7d2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:49.208086 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25391bf-ea57-4666-8396-bd05c5b3f7d2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:49.210063 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25391bf-ea57-4666-8396-bd05c5b3f7d2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:49.223148 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-a25391bf-ea57-4666-8396-bd05c5b3f7d2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:28:49.224271 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 549/1087] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:28:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:49.229893 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3c7f6-474b-404a-a601-bd99122c9b84 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:49.239769 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b3c7f6-474b-404a-a601-bd99122c9b84 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:49.244214 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45448f-8bdf-4548-8153-b7058b59c364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:49.244839 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45448f-8bdf-4548-8153-b7058b59c364 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:49.245153 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45448f-8bdf-4548-8153-b7058b59c364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:49.245427 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45448f-8bdf-4548-8153-b7058b59c364 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:49.246252 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45448f-8bdf-4548-8153-b7058b59c364 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:49.246554 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45448f-8bdf-4548-8153-b7058b59c364 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:49.248362 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45448f-8bdf-4548-8153-b7058b59c364 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:49.260830 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 539/1088] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:28:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:49.267070 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25391bf-ea57-4666-8396-bd05c5b3f7d2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:49.277771 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25391bf-ea57-4666-8396-bd05c5b3f7d2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:49.282165 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03dc536-55b3-4540-808f-1feb7f7b4cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:49.282792 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dc536-55b3-4540-808f-1feb7f7b4cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:49.283074 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dc536-55b3-4540-808f-1feb7f7b4cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:49.283346 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03dc536-55b3-4540-808f-1feb7f7b4cc7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:49.284179 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03dc536-55b3-4540-808f-1feb7f7b4cc7 admin admin] RBAC: Adding query filter params (role.id=a4bddbbd5f64404a90db53f5db02078b, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=63fe98c10e974c019e05a2f68d012ba8) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:49.284488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03dc536-55b3-4540-808f-1feb7f7b4cc7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:49.286357 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03dc536-55b3-4540-808f-1feb7f7b4cc7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:49.292158 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 550/1089] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:28:49 2022] GET /identity/v3/role_assignments?user.id=63fe98c10e974c019e05a2f68d012ba8&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=a4bddbbd5f64404a90db53f5db02078b => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:50.194299 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df53a3c-b31a-462b-9380-43da783f1640 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:50.194836 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df53a3c-b31a-462b-9380-43da783f1640 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:50.194836 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df53a3c-b31a-462b-9380-43da783f1640 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:50.197111 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 540/1090] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:50.202902 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488e39d-77c7-4281-8373-ed0508c9b831 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:50.203349 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488e39d-77c7-4281-8373-ed0508c9b831 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:50.203452 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488e39d-77c7-4281-8373-ed0508c9b831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:50.220545 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-f488e39d-77c7-4281-8373-ed0508c9b831 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:50.221777 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f488e39d-77c7-4281-8373-ed0508c9b831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:50.229273 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 551/1091] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:50 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:50.252223 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df53a3c-b31a-462b-9380-43da783f1640 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:50.263891 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df53a3c-b31a-462b-9380-43da783f1640 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:50.268092 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede7c98-fcd1-4b4e-b185-7295a9ff0e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:50.268843 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede7c98-fcd1-4b4e-b185-7295a9ff0e65 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:50.269154 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede7c98-fcd1-4b4e-b185-7295a9ff0e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:50.269427 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede7c98-fcd1-4b4e-b185-7295a9ff0e65 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:50.279182 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede7c98-fcd1-4b4e-b185-7295a9ff0e65 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:50.285859 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-3ede7c98-fcd1-4b4e-b185-7295a9ff0e65 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:28:50.287229 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 541/1092] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:28:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:50.292704 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488e39d-77c7-4281-8373-ed0508c9b831 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:50.301750 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488e39d-77c7-4281-8373-ed0508c9b831 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:50.306133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03a1d0-b873-46d0-87e7-ab7dd2a88ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:50.306768 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03a1d0-b873-46d0-87e7-ab7dd2a88ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:50.307052 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03a1d0-b873-46d0-87e7-ab7dd2a88ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:50.307330 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03a1d0-b873-46d0-87e7-ab7dd2a88ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:50.308094 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03a1d0-b873-46d0-87e7-ab7dd2a88ec8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:50.308969 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03a1d0-b873-46d0-87e7-ab7dd2a88ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:50.310593 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03a1d0-b873-46d0-87e7-ab7dd2a88ec8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:50.318448 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 552/1093] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:28:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:50.323753 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede7c98-fcd1-4b4e-b185-7295a9ff0e65 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:50.333500 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede7c98-fcd1-4b4e-b185-7295a9ff0e65 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:50.337917 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2b48d-0505-4e74-9cce-dd54929cae6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:50.338726 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2b48d-0505-4e74-9cce-dd54929cae6a admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:50.339004 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2b48d-0505-4e74-9cce-dd54929cae6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:50.339274 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2b48d-0505-4e74-9cce-dd54929cae6a admin admin] PATH_INFO: `/v3/users/22ff762b7a334994924d22be00d9bb5a` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:50.340458 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2b48d-0505-4e74-9cce-dd54929cae6a admin admin] RBAC: Authorizing `identity:get_user(user_id=22ff762b7a334994924d22be00d9bb5a)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:50.342591 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2b48d-0505-4e74-9cce-dd54929cae6a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:50.344250 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 542/1094] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:28:50 2022] GET /identity/v3/users/22ff762b7a334994924d22be00d9bb5a => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:50.349111 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03a1d0-b873-46d0-87e7-ab7dd2a88ec8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:50.358590 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03a1d0-b873-46d0-87e7-ab7dd2a88ec8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:50.362994 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c144cc3-4eb8-4249-9762-cf443385b283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:50.363797 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c144cc3-4eb8-4249-9762-cf443385b283 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:50.364078 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c144cc3-4eb8-4249-9762-cf443385b283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:50.364354 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c144cc3-4eb8-4249-9762-cf443385b283 admin admin] PATH_INFO: `/v3/projects/b50cca43472f44e3a60d8cb167e6664d` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:50.365522 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c144cc3-4eb8-4249-9762-cf443385b283 admin admin] RBAC: Authorizing `identity:get_project(project_id=b50cca43472f44e3a60d8cb167e6664d)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:50.367507 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c144cc3-4eb8-4249-9762-cf443385b283 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:50.369105 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 553/1095] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:28:50 2022] GET /identity/v3/projects/b50cca43472f44e3a60d8cb167e6664d => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:50.374780 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2b48d-0505-4e74-9cce-dd54929cae6a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:50.383863 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2b48d-0505-4e74-9cce-dd54929cae6a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:50.388279 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae272442-30e5-4341-9176-6f72fbb1e21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:50.389126 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae272442-30e5-4341-9176-6f72fbb1e21a admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:50.389408 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae272442-30e5-4341-9176-6f72fbb1e21a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:50.389682 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae272442-30e5-4341-9176-6f72fbb1e21a admin admin] PATH_INFO: `/v3/projects/b50cca43472f44e3a60d8cb167e6664d/users/22ff762b7a334994924d22be00d9bb5a/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:50.391602 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae272442-30e5-4341-9176-6f72fbb1e21a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b50cca43472f44e3a60d8cb167e6664d, user_id=22ff762b7a334994924d22be00d9bb5a, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:50.394219 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae272442-30e5-4341-9176-6f72fbb1e21a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:50.406840 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 543/1096] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:28:50 2022] PUT /identity/v3/projects/b50cca43472f44e3a60d8cb167e6664d/users/22ff762b7a334994924d22be00d9bb5a/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:28:52.548306 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbaf86-9725-460f-b51d-a47f9f2043df None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:52.548792 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbaf86-9725-460f-b51d-a47f9f2043df None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:52.548792 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbaf86-9725-460f-b51d-a47f9f2043df None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:52.550601 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 554/1097] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:52.555884 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320941e-3869-4a71-baa7-65f19d250174 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:52.556297 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320941e-3869-4a71-baa7-65f19d250174 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:52.556429 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320941e-3869-4a71-baa7-65f19d250174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:52.573565 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-b320941e-3869-4a71-baa7-65f19d250174 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:52.575437 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-b320941e-3869-4a71-baa7-65f19d250174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:52.629483 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 544/1098] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:52 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:52.654364 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbaf86-9725-460f-b51d-a47f9f2043df None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:52.667019 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbaf86-9725-460f-b51d-a47f9f2043df None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:52.671540 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9630cd-2a47-47fa-8448-8ba3894b11c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:52.672310 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9630cd-2a47-47fa-8448-8ba3894b11c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:52.672589 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9630cd-2a47-47fa-8448-8ba3894b11c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:52.672860 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9630cd-2a47-47fa-8448-8ba3894b11c3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:52.683281 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9630cd-2a47-47fa-8448-8ba3894b11c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:28:52.690022 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-1f9630cd-2a47-47fa-8448-8ba3894b11c3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:28:52.691196 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 555/1099] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:28:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:28:52.697331 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320941e-3869-4a71-baa7-65f19d250174 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:52.706614 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320941e-3869-4a71-baa7-65f19d250174 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:52.711104 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc27687-53f8-4132-9a96-9b524988931a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:52.711747 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc27687-53f8-4132-9a96-9b524988931a admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:52.712032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc27687-53f8-4132-9a96-9b524988931a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:52.712309 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc27687-53f8-4132-9a96-9b524988931a admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:52.713105 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc27687-53f8-4132-9a96-9b524988931a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:52.713413 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc27687-53f8-4132-9a96-9b524988931a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:52.715662 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc27687-53f8-4132-9a96-9b524988931a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:52.723771 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 545/1100] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:28:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:52.729176 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9630cd-2a47-47fa-8448-8ba3894b11c3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:52.738887 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9630cd-2a47-47fa-8448-8ba3894b11c3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:52.743245 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d324668-9782-4a8a-bab0-02d9b88d0be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:52.744065 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d324668-9782-4a8a-bab0-02d9b88d0be1 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:52.744346 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d324668-9782-4a8a-bab0-02d9b88d0be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:52.744619 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d324668-9782-4a8a-bab0-02d9b88d0be1 admin admin] PATH_INFO: `/v3/users/22ff762b7a334994924d22be00d9bb5a` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:52.746350 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d324668-9782-4a8a-bab0-02d9b88d0be1 admin admin] RBAC: Authorizing `identity:get_user(user_id=22ff762b7a334994924d22be00d9bb5a)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:52.748448 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d324668-9782-4a8a-bab0-02d9b88d0be1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:52.750031 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 556/1101] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:28:52 2022] GET /identity/v3/users/22ff762b7a334994924d22be00d9bb5a => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:52.755204 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc27687-53f8-4132-9a96-9b524988931a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:52.765078 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc27687-53f8-4132-9a96-9b524988931a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:52.769514 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1708f-7a1f-449b-a8e4-7b7c24434807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:52.770121 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1708f-7a1f-449b-a8e4-7b7c24434807 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:52.770405 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1708f-7a1f-449b-a8e4-7b7c24434807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:52.770682 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1708f-7a1f-449b-a8e4-7b7c24434807 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:52.778231 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1708f-7a1f-449b-a8e4-7b7c24434807 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:52.779927 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1708f-7a1f-449b-a8e4-7b7c24434807 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:52.788803 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 546/1102] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:52 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:28:52.793903 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d324668-9782-4a8a-bab0-02d9b88d0be1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:52.802856 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d324668-9782-4a8a-bab0-02d9b88d0be1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:52.807213 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b4357-6192-4b0d-ba61-e237d674531d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:52.807983 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b4357-6192-4b0d-ba61-e237d674531d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:52.808763 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b4357-6192-4b0d-ba61-e237d674531d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:52.809075 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b4357-6192-4b0d-ba61-e237d674531d admin admin] PATH_INFO: `/v3/projects/b50cca43472f44e3a60d8cb167e6664d` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:52.810215 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b4357-6192-4b0d-ba61-e237d674531d admin admin] RBAC: Authorizing `identity:get_project(project_id=b50cca43472f44e3a60d8cb167e6664d)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:52.812172 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b4357-6192-4b0d-ba61-e237d674531d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:52.813811 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 557/1103] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:28:52 2022] GET /identity/v3/projects/b50cca43472f44e3a60d8cb167e6664d => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:52.819209 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1708f-7a1f-449b-a8e4-7b7c24434807 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:52.828078 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1708f-7a1f-449b-a8e4-7b7c24434807 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:52.832411 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2607cf-e29f-48cd-b3bf-2c8e032bc2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:52.833023 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2607cf-e29f-48cd-b3bf-2c8e032bc2be admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:52.833304 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2607cf-e29f-48cd-b3bf-2c8e032bc2be admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:52.833572 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2607cf-e29f-48cd-b3bf-2c8e032bc2be admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:52.834381 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2607cf-e29f-48cd-b3bf-2c8e032bc2be admin admin] RBAC: Adding query filter params (role.id=05ca9a16ef2a450b8cc73ade47f5c7d0, scope.project.id=b50cca43472f44e3a60d8cb167e6664d, user.id=22ff762b7a334994924d22be00d9bb5a) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:52.834686 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2607cf-e29f-48cd-b3bf-2c8e032bc2be admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:52.836443 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2607cf-e29f-48cd-b3bf-2c8e032bc2be admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:52.842033 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 547/1104] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:28:52 2022] GET /identity/v3/role_assignments?user.id=22ff762b7a334994924d22be00d9bb5a&scope.project.id=b50cca43472f44e3a60d8cb167e6664d&role.id=05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:55.042567 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7e69e-766a-43a3-b549-9472e2c772a1 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:55.043107 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7e69e-766a-43a3-b549-9472e2c772a1 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:55.043107 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7e69e-766a-43a3-b549-9472e2c772a1 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:55.044948 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 558/1105] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:55.050219 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b185d40-5591-4802-99fe-3013cc5cd49d None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:55.050589 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b185d40-5591-4802-99fe-3013cc5cd49d None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:55.050769 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b185d40-5591-4802-99fe-3013cc5cd49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:55.068433 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-8b185d40-5591-4802-99fe-3013cc5cd49d None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:55.069622 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-8b185d40-5591-4802-99fe-3013cc5cd49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:55.077749 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 548/1106] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:55 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:55.102092 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7e69e-766a-43a3-b549-9472e2c772a1 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:55.113712 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7e69e-766a-43a3-b549-9472e2c772a1 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:55.117952 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e65f1b-857b-4742-b5fd-59a45c49e0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:55.118698 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e65f1b-857b-4742-b5fd-59a45c49e0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:55.119023 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e65f1b-857b-4742-b5fd-59a45c49e0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:55.119295 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e65f1b-857b-4742-b5fd-59a45c49e0b3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:55.120450 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e65f1b-857b-4742-b5fd-59a45c49e0b3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:55.122733 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e65f1b-857b-4742-b5fd-59a45c49e0b3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:55.124249 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 559/1107] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:28:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:55.129348 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b185d40-5591-4802-99fe-3013cc5cd49d None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:55.138445 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b185d40-5591-4802-99fe-3013cc5cd49d None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:55.142911 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52723f-9008-4be6-82c0-5802a7664f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:55.143572 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52723f-9008-4be6-82c0-5802a7664f74 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:55.143852 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52723f-9008-4be6-82c0-5802a7664f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:55.144130 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52723f-9008-4be6-82c0-5802a7664f74 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:55.144836 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52723f-9008-4be6-82c0-5802a7664f74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:55.146746 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52723f-9008-4be6-82c0-5802a7664f74 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:55.165054 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 549/1108] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Feb 9 04:28:55 2022] POST /identity/v3/users => generated 286 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:28:57.392418 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87478ab6-3063-49f0-8620-205c1df06400 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:57.393027 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87478ab6-3063-49f0-8620-205c1df06400 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:57.393027 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87478ab6-3063-49f0-8620-205c1df06400 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:57.394791 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 560/1109] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:57.399922 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5efbe-f4a4-4957-b839-6a387dd9d7bf None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:57.400362 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5efbe-f4a4-4957-b839-6a387dd9d7bf None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:57.400461 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5efbe-f4a4-4957-b839-6a387dd9d7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:57.417839 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-23a5efbe-f4a4-4957-b839-6a387dd9d7bf None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:57.418997 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-23a5efbe-f4a4-4957-b839-6a387dd9d7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:57.426419 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 550/1110] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:57 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:57.451294 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87478ab6-3063-49f0-8620-205c1df06400 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:57.462994 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87478ab6-3063-49f0-8620-205c1df06400 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:57.467324 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d8da3-39ff-4564-a07b-d3424df7c8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:57.468146 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d8da3-39ff-4564-a07b-d3424df7c8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:57.468421 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d8da3-39ff-4564-a07b-d3424df7c8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:57.468691 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d8da3-39ff-4564-a07b-d3424df7c8e1 admin admin] PATH_INFO: `/v3/roles/850547f4dcf34a76a710ddaae9dc30de` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:57.470156 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d8da3-39ff-4564-a07b-d3424df7c8e1 admin admin] RBAC: Authorizing `identity:get_role(role_id=850547f4dcf34a76a710ddaae9dc30de)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:57.471173 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-924d8da3-39ff-4564-a07b-d3424df7c8e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:28:57.471173 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 09 04:28:57.471173 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: Feb 09 04:28:57.472039 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d8da3-39ff-4564-a07b-d3424df7c8e1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:57.473357 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 561/1111] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:28:57 2022] GET /identity/v3/roles/850547f4dcf34a76a710ddaae9dc30de => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:57.478755 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5efbe-f4a4-4957-b839-6a387dd9d7bf None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:57.487440 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a5efbe-f4a4-4957-b839-6a387dd9d7bf None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:57.491871 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f62ca6-bf3c-4de6-a945-e95d9a9f6672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:57.492714 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f62ca6-bf3c-4de6-a945-e95d9a9f6672 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:57.492994 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f62ca6-bf3c-4de6-a945-e95d9a9f6672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:57.493300 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f62ca6-bf3c-4de6-a945-e95d9a9f6672 admin admin] PATH_INFO: `/v3/users/1ebf1d3e46a04fd08a89ba4e4f90a558` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:57.506564 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f62ca6-bf3c-4de6-a945-e95d9a9f6672 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ebf1d3e46a04fd08a89ba4e4f90a558)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:57.508681 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f62ca6-bf3c-4de6-a945-e95d9a9f6672 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:57.510304 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 551/1112] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:28:57 2022] GET /identity/v3/users/1ebf1d3e46a04fd08a89ba4e4f90a558 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:57.516046 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d8da3-39ff-4564-a07b-d3424df7c8e1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:57.525263 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d8da3-39ff-4564-a07b-d3424df7c8e1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:57.529638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35dda1-bf7a-4e00-be70-de2c6eced07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:57.530248 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35dda1-bf7a-4e00-be70-de2c6eced07a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:57.530531 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35dda1-bf7a-4e00-be70-de2c6eced07a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:57.530805 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35dda1-bf7a-4e00-be70-de2c6eced07a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:57.538602 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35dda1-bf7a-4e00-be70-de2c6eced07a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:57.540297 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35dda1-bf7a-4e00-be70-de2c6eced07a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:57.548889 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 562/1113] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:28:57 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:28:57.554328 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f62ca6-bf3c-4de6-a945-e95d9a9f6672 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:57.564118 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f62ca6-bf3c-4de6-a945-e95d9a9f6672 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:57.568512 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00770c-965f-48b6-b01b-5f3b6d817b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:57.569377 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00770c-965f-48b6-b01b-5f3b6d817b5a admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:57.569661 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00770c-965f-48b6-b01b-5f3b6d817b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:57.569938 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00770c-965f-48b6-b01b-5f3b6d817b5a admin admin] PATH_INFO: `/v3/projects/b50cca43472f44e3a60d8cb167e6664d` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:57.571156 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00770c-965f-48b6-b01b-5f3b6d817b5a admin admin] RBAC: Authorizing `identity:get_project(project_id=b50cca43472f44e3a60d8cb167e6664d)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:57.573211 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00770c-965f-48b6-b01b-5f3b6d817b5a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:57.575466 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 552/1114] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:28:57 2022] GET /identity/v3/projects/b50cca43472f44e3a60d8cb167e6664d => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:57.580927 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35dda1-bf7a-4e00-be70-de2c6eced07a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:57.589490 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35dda1-bf7a-4e00-be70-de2c6eced07a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:57.593922 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd658fe2-863d-48d6-93eb-826c49505956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:57.594540 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd658fe2-863d-48d6-93eb-826c49505956 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:57.594822 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd658fe2-863d-48d6-93eb-826c49505956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:57.595096 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd658fe2-863d-48d6-93eb-826c49505956 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:57.595932 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd658fe2-863d-48d6-93eb-826c49505956 admin admin] RBAC: Adding query filter params (role.id=850547f4dcf34a76a710ddaae9dc30de, scope.project.id=b50cca43472f44e3a60d8cb167e6664d, user.id=1ebf1d3e46a04fd08a89ba4e4f90a558) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:28:57.596239 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd658fe2-863d-48d6-93eb-826c49505956 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:57.598088 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd658fe2-863d-48d6-93eb-826c49505956 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:57.603311 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 563/1115] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:28:57 2022] GET /identity/v3/role_assignments?user.id=1ebf1d3e46a04fd08a89ba4e4f90a558&scope.project.id=b50cca43472f44e3a60d8cb167e6664d&role.id=850547f4dcf34a76a710ddaae9dc30de => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:59.765778 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592aaafc-a893-4019-ac6a-9a1c3e91e040 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:59.766381 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592aaafc-a893-4019-ac6a-9a1c3e91e040 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:59.766381 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592aaafc-a893-4019-ac6a-9a1c3e91e040 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:59.768093 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 553/1116] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:28:59.773299 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05b9b2-ebb4-4eb3-9356-e6b1897e63ef None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:59.773677 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05b9b2-ebb4-4eb3-9356-e6b1897e63ef None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:59.773858 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05b9b2-ebb4-4eb3-9356-e6b1897e63ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:59.791682 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-5f05b9b2-ebb4-4eb3-9356-e6b1897e63ef None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:28:59.793449 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5f05b9b2-ebb4-4eb3-9356-e6b1897e63ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:28:59.800936 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 564/1117] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:28:59 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:28:59.823240 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592aaafc-a893-4019-ac6a-9a1c3e91e040 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:59.834975 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592aaafc-a893-4019-ac6a-9a1c3e91e040 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:59.839783 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361d7fd-439d-4be1-9bc2-10e7c86ef318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:59.840603 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361d7fd-439d-4be1-9bc2-10e7c86ef318 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:59.840881 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361d7fd-439d-4be1-9bc2-10e7c86ef318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:59.841190 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361d7fd-439d-4be1-9bc2-10e7c86ef318 admin admin] PATH_INFO: `/v3/roles/850547f4dcf34a76a710ddaae9dc30de` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:59.842646 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361d7fd-439d-4be1-9bc2-10e7c86ef318 admin admin] RBAC: Authorizing `identity:get_role(role_id=850547f4dcf34a76a710ddaae9dc30de)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:59.843644 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING py.warnings [None req-d361d7fd-439d-4be1-9bc2-10e7c86ef318 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:28:59.843644 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: warnings.warn(msg) Feb 09 04:28:59.843644 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: Feb 09 04:28:59.844506 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361d7fd-439d-4be1-9bc2-10e7c86ef318 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:59.845834 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 554/1118] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:28:59 2022] GET /identity/v3/roles/850547f4dcf34a76a710ddaae9dc30de => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:59.850965 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05b9b2-ebb4-4eb3-9356-e6b1897e63ef None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:59.860079 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05b9b2-ebb4-4eb3-9356-e6b1897e63ef None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:59.864489 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44cf5e-5bf7-4c42-95b7-33b26c1fbfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:59.865349 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44cf5e-5bf7-4c42-95b7-33b26c1fbfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:59.865630 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44cf5e-5bf7-4c42-95b7-33b26c1fbfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:59.865901 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e44cf5e-5bf7-4c42-95b7-33b26c1fbfd2 admin admin] PATH_INFO: `/v3/users/1ebf1d3e46a04fd08a89ba4e4f90a558` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:59.867099 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44cf5e-5bf7-4c42-95b7-33b26c1fbfd2 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ebf1d3e46a04fd08a89ba4e4f90a558)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:59.869247 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e44cf5e-5bf7-4c42-95b7-33b26c1fbfd2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:59.870935 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 565/1119] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:28:59 2022] GET /identity/v3/users/1ebf1d3e46a04fd08a89ba4e4f90a558 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:28:59.875639 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361d7fd-439d-4be1-9bc2-10e7c86ef318 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:59.884606 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361d7fd-439d-4be1-9bc2-10e7c86ef318 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:59.889711 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d934288-df22-43d4-bbf9-9bfce815f65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:59.890494 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d934288-df22-43d4-bbf9-9bfce815f65a admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:59.890773 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d934288-df22-43d4-bbf9-9bfce815f65a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:59.891048 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d934288-df22-43d4-bbf9-9bfce815f65a admin admin] PATH_INFO: `/v3/projects/b50cca43472f44e3a60d8cb167e6664d` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:59.892191 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d934288-df22-43d4-bbf9-9bfce815f65a admin admin] RBAC: Authorizing `identity:get_project(project_id=b50cca43472f44e3a60d8cb167e6664d)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:59.894197 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d934288-df22-43d4-bbf9-9bfce815f65a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:59.895794 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 555/1120] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:28:59 2022] GET /identity/v3/projects/b50cca43472f44e3a60d8cb167e6664d => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:28:59.900822 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44cf5e-5bf7-4c42-95b7-33b26c1fbfd2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:28:59.910398 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e44cf5e-5bf7-4c42-95b7-33b26c1fbfd2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:28:59.915080 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9c9b2-9ac6-4310-9687-48cd9c63cedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:28:59.915898 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9c9b2-9ac6-4310-9687-48cd9c63cedf admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:28:59.916182 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9c9b2-9ac6-4310-9687-48cd9c63cedf admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:28:59.916463 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9c9b2-9ac6-4310-9687-48cd9c63cedf admin admin] PATH_INFO: `/v3/projects/b50cca43472f44e3a60d8cb167e6664d/users/1ebf1d3e46a04fd08a89ba4e4f90a558/roles/850547f4dcf34a76a710ddaae9dc30de` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:28:59.918654 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9c9b2-9ac6-4310-9687-48cd9c63cedf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b50cca43472f44e3a60d8cb167e6664d, user_id=1ebf1d3e46a04fd08a89ba4e4f90a558, role_id=850547f4dcf34a76a710ddaae9dc30de)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:28:59.921271 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9c9b2-9ac6-4310-9687-48cd9c63cedf admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:28:59.933549 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 566/1121] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:28:59 2022] PUT /identity/v3/projects/b50cca43472f44e3a60d8cb167e6664d/users/1ebf1d3e46a04fd08a89ba4e4f90a558/roles/850547f4dcf34a76a710ddaae9dc30de => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:29:02.129134 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0935e-9600-4bcc-8d4d-2caf008b2709 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:02.129697 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0935e-9600-4bcc-8d4d-2caf008b2709 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:02.129697 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0935e-9600-4bcc-8d4d-2caf008b2709 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:02.131468 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 556/1122] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:29:02.137330 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a74996-d904-4d80-97c1-70f452c241aa None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:02.138055 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a74996-d904-4d80-97c1-70f452c241aa None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:02.138338 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a74996-d904-4d80-97c1-70f452c241aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:02.155557 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-c7a74996-d904-4d80-97c1-70f452c241aa None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:29:02.156738 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c7a74996-d904-4d80-97c1-70f452c241aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:29:02.211928 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 567/1123] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:29:02 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:29:02.237232 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0935e-9600-4bcc-8d4d-2caf008b2709 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:02.249067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0935e-9600-4bcc-8d4d-2caf008b2709 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:02.253348 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1a3ce-cb72-4426-ac11-577b217ee3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:02.254170 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1a3ce-cb72-4426-ac11-577b217ee3ff admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:02.254450 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1a3ce-cb72-4426-ac11-577b217ee3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:02.254722 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1a3ce-cb72-4426-ac11-577b217ee3ff admin admin] PATH_INFO: `/v3/roles/850547f4dcf34a76a710ddaae9dc30de` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:02.256181 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1a3ce-cb72-4426-ac11-577b217ee3ff admin admin] RBAC: Authorizing `identity:get_role(role_id=850547f4dcf34a76a710ddaae9dc30de)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:02.257787 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1a3ce-cb72-4426-ac11-577b217ee3ff admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:02.259088 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 557/1124] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:29:02 2022] GET /identity/v3/roles/850547f4dcf34a76a710ddaae9dc30de => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:02.264788 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a74996-d904-4d80-97c1-70f452c241aa None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:02.274847 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a74996-d904-4d80-97c1-70f452c241aa None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:02.281728 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01e821-9b05-4434-9e3c-b779408ae1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:02.282578 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01e821-9b05-4434-9e3c-b779408ae1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:02.282864 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01e821-9b05-4434-9e3c-b779408ae1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:02.283138 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01e821-9b05-4434-9e3c-b779408ae1d4 admin admin] PATH_INFO: `/v3/users/1ebf1d3e46a04fd08a89ba4e4f90a558` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:02.284350 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01e821-9b05-4434-9e3c-b779408ae1d4 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ebf1d3e46a04fd08a89ba4e4f90a558)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:02.286797 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01e821-9b05-4434-9e3c-b779408ae1d4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:02.288382 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 568/1125] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:29:02 2022] GET /identity/v3/users/1ebf1d3e46a04fd08a89ba4e4f90a558 => generated 286 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:02.293891 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1a3ce-cb72-4426-ac11-577b217ee3ff admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:02.303221 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1a3ce-cb72-4426-ac11-577b217ee3ff admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:02.307651 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b3b5e-b9a8-4043-b6e8-fb7d19b62a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:02.308297 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b3b5e-b9a8-4043-b6e8-fb7d19b62a4a admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:02.308578 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b3b5e-b9a8-4043-b6e8-fb7d19b62a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:02.308851 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b3b5e-b9a8-4043-b6e8-fb7d19b62a4a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:02.316308 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b3b5e-b9a8-4043-b6e8-fb7d19b62a4a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:02.318044 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b3b5e-b9a8-4043-b6e8-fb7d19b62a4a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:02.327101 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 558/1126] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:29:02 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:29:02.332300 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01e821-9b05-4434-9e3c-b779408ae1d4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:02.342067 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01e821-9b05-4434-9e3c-b779408ae1d4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:02.346458 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e96861-3fd8-4ce5-bca5-24837c65974a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:02.347254 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e96861-3fd8-4ce5-bca5-24837c65974a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:02.347538 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e96861-3fd8-4ce5-bca5-24837c65974a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:02.347817 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e96861-3fd8-4ce5-bca5-24837c65974a admin admin] PATH_INFO: `/v3/projects/b50cca43472f44e3a60d8cb167e6664d` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:02.349025 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e96861-3fd8-4ce5-bca5-24837c65974a admin admin] RBAC: Authorizing `identity:get_project(project_id=b50cca43472f44e3a60d8cb167e6664d)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:02.351017 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e96861-3fd8-4ce5-bca5-24837c65974a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:02.352620 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 569/1127] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:29:02 2022] GET /identity/v3/projects/b50cca43472f44e3a60d8cb167e6664d => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:02.358152 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b3b5e-b9a8-4043-b6e8-fb7d19b62a4a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:02.366436 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b3b5e-b9a8-4043-b6e8-fb7d19b62a4a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:02.370881 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1678133-f959-4f5c-8d97-8f89b307ae1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:02.371472 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1678133-f959-4f5c-8d97-8f89b307ae1a admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:02.371752 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1678133-f959-4f5c-8d97-8f89b307ae1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:02.372024 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1678133-f959-4f5c-8d97-8f89b307ae1a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:02.372837 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1678133-f959-4f5c-8d97-8f89b307ae1a admin admin] RBAC: Adding query filter params (role.id=850547f4dcf34a76a710ddaae9dc30de, scope.project.id=b50cca43472f44e3a60d8cb167e6664d, user.id=1ebf1d3e46a04fd08a89ba4e4f90a558) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:29:02.373186 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1678133-f959-4f5c-8d97-8f89b307ae1a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:02.374947 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1678133-f959-4f5c-8d97-8f89b307ae1a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:02.380673 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 559/1128] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:29:02 2022] GET /identity/v3/role_assignments?user.id=1ebf1d3e46a04fd08a89ba4e4f90a558&scope.project.id=b50cca43472f44e3a60d8cb167e6664d&role.id=850547f4dcf34a76a710ddaae9dc30de => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:29:04.568129 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04faba1-eb44-4bbc-8076-0c73050d76a4 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:04.568555 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04faba1-eb44-4bbc-8076-0c73050d76a4 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:04.568674 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04faba1-eb44-4bbc-8076-0c73050d76a4 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:04.570477 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 570/1129] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:29:04.575794 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda0ea1-1e1c-4249-aaf9-dba924e0df4a None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:04.576210 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda0ea1-1e1c-4249-aaf9-dba924e0df4a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:04.576345 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda0ea1-1e1c-4249-aaf9-dba924e0df4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:04.593514 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-6eda0ea1-1e1c-4249-aaf9-dba924e0df4a None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:29:04.594689 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-6eda0ea1-1e1c-4249-aaf9-dba924e0df4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:29:04.602179 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 560/1130] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:29:04 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:29:04.626599 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04faba1-eb44-4bbc-8076-0c73050d76a4 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:04.638343 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04faba1-eb44-4bbc-8076-0c73050d76a4 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:04.642658 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7327b011-68ab-44f5-b2bc-99f3aef167f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:04.643421 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327b011-68ab-44f5-b2bc-99f3aef167f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:04.643700 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327b011-68ab-44f5-b2bc-99f3aef167f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:04.643970 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7327b011-68ab-44f5-b2bc-99f3aef167f0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:04.645152 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327b011-68ab-44f5-b2bc-99f3aef167f0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:04.646913 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7327b011-68ab-44f5-b2bc-99f3aef167f0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:04.648514 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 571/1131] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:29:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:04.654565 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda0ea1-1e1c-4249-aaf9-dba924e0df4a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:04.664713 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda0ea1-1e1c-4249-aaf9-dba924e0df4a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:04.669726 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7116779-70fb-4d08-9704-945c4ad18f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:04.670369 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7116779-70fb-4d08-9704-945c4ad18f2e admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:04.670652 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7116779-70fb-4d08-9704-945c4ad18f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:04.670928 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7116779-70fb-4d08-9704-945c4ad18f2e admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:04.671652 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7116779-70fb-4d08-9704-945c4ad18f2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:04.673564 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7116779-70fb-4d08-9704-945c4ad18f2e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:04.698032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 561/1132] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Feb 9 04:29:04 2022] POST /identity/v3/projects => generated 311 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:29:06.907144 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f785b-4b32-4c77-82e0-4a75ddd278cb None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:06.907656 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f785b-4b32-4c77-82e0-4a75ddd278cb None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:06.907656 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f785b-4b32-4c77-82e0-4a75ddd278cb None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:06.909420 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 572/1133] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:29:06.914911 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe0565-9c26-4e7c-b8de-dae3885f8a65 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:06.915326 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe0565-9c26-4e7c-b8de-dae3885f8a65 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:06.915462 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe0565-9c26-4e7c-b8de-dae3885f8a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:06.932597 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-3afe0565-9c26-4e7c-b8de-dae3885f8a65 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:29:06.933798 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-3afe0565-9c26-4e7c-b8de-dae3885f8a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:29:06.988028 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 562/1134] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:29:06 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:29:07.013526 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f785b-4b32-4c77-82e0-4a75ddd278cb None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:07.025312 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f785b-4b32-4c77-82e0-4a75ddd278cb None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:07.029556 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b0f17-f54b-43e5-b4df-50bc849dbb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:07.030325 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b0f17-f54b-43e5-b4df-50bc849dbb7e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:07.030607 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b0f17-f54b-43e5-b4df-50bc849dbb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:07.030885 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b0f17-f54b-43e5-b4df-50bc849dbb7e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:07.032034 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b0f17-f54b-43e5-b4df-50bc849dbb7e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:07.033753 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b0f17-f54b-43e5-b4df-50bc849dbb7e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:07.035290 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 573/1135] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:29:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:07.040651 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe0565-9c26-4e7c-b8de-dae3885f8a65 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:07.049188 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe0565-9c26-4e7c-b8de-dae3885f8a65 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:07.053577 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1b780-3f56-4485-9158-821c49e0ab8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:07.054210 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1b780-3f56-4485-9158-821c49e0ab8d admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:07.054491 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1b780-3f56-4485-9158-821c49e0ab8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:07.054765 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1b780-3f56-4485-9158-821c49e0ab8d admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:07.055480 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1b780-3f56-4485-9158-821c49e0ab8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:07.057384 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1b780-3f56-4485-9158-821c49e0ab8d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:07.077656 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 563/1136] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Feb 9 04:29:07 2022] POST /identity/v3/users => generated 286 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:29:09.321459 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a198fe6-6773-4fff-830e-b21013363f34 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:09.321981 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a198fe6-6773-4fff-830e-b21013363f34 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:09.322099 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a198fe6-6773-4fff-830e-b21013363f34 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:09.323817 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 574/1137] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:29:09.329069 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84a685-e806-4c14-8abd-be65deb5d078 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:09.329432 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84a685-e806-4c14-8abd-be65deb5d078 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:09.329622 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84a685-e806-4c14-8abd-be65deb5d078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:09.347215 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-9e84a685-e806-4c14-8abd-be65deb5d078 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:29:09.348380 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-9e84a685-e806-4c14-8abd-be65deb5d078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:29:09.356478 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 564/1138] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:29:09 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:29:09.379139 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a198fe6-6773-4fff-830e-b21013363f34 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:09.391017 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a198fe6-6773-4fff-830e-b21013363f34 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:09.395243 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18063539-fed3-4acd-86ac-d3b68d149c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:09.396100 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18063539-fed3-4acd-86ac-d3b68d149c39 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:09.396393 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18063539-fed3-4acd-86ac-d3b68d149c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:09.396666 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18063539-fed3-4acd-86ac-d3b68d149c39 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:09.407079 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18063539-fed3-4acd-86ac-d3b68d149c39 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:29:09.414081 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-18063539-fed3-4acd-86ac-d3b68d149c39 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:29:09.415199 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 575/1139] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:29:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:29:09.421203 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84a685-e806-4c14-8abd-be65deb5d078 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:09.429742 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84a685-e806-4c14-8abd-be65deb5d078 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:09.434102 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609daa5-5a59-4c17-823a-b4e82c78a6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:09.434728 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609daa5-5a59-4c17-823a-b4e82c78a6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:09.435006 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609daa5-5a59-4c17-823a-b4e82c78a6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:09.435275 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0609daa5-5a59-4c17-823a-b4e82c78a6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:09.436014 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609daa5-5a59-4c17-823a-b4e82c78a6f9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:29:09.436315 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609daa5-5a59-4c17-823a-b4e82c78a6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:09.437899 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0609daa5-5a59-4c17-823a-b4e82c78a6f9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:09.445866 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 565/1140] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:29:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:09.450943 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18063539-fed3-4acd-86ac-d3b68d149c39 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:09.460561 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18063539-fed3-4acd-86ac-d3b68d149c39 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:09.465541 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc368d-1385-40dd-a814-84f8a8cc945f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:09.466354 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc368d-1385-40dd-a814-84f8a8cc945f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:09.466636 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc368d-1385-40dd-a814-84f8a8cc945f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:09.466911 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc368d-1385-40dd-a814-84f8a8cc945f admin admin] PATH_INFO: `/v3/users/c549fd86633c436e961112c6e7158050` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:09.479433 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc368d-1385-40dd-a814-84f8a8cc945f admin admin] RBAC: Authorizing `identity:get_user(user_id=c549fd86633c436e961112c6e7158050)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:09.482187 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc368d-1385-40dd-a814-84f8a8cc945f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:09.483758 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 576/1141] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:29:09 2022] GET /identity/v3/users/c549fd86633c436e961112c6e7158050 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:09.488863 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609daa5-5a59-4c17-823a-b4e82c78a6f9 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:09.498059 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0609daa5-5a59-4c17-823a-b4e82c78a6f9 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:09.502397 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8837c08-3c9b-4475-ba61-4d4b8bf13c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:09.502997 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8837c08-3c9b-4475-ba61-4d4b8bf13c9f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:09.503275 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8837c08-3c9b-4475-ba61-4d4b8bf13c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:09.503547 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8837c08-3c9b-4475-ba61-4d4b8bf13c9f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:09.510950 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8837c08-3c9b-4475-ba61-4d4b8bf13c9f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:09.512636 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8837c08-3c9b-4475-ba61-4d4b8bf13c9f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:09.521079 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 566/1142] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:29:09 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:29:09.526139 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc368d-1385-40dd-a814-84f8a8cc945f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:09.535730 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc368d-1385-40dd-a814-84f8a8cc945f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:09.540389 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec28fb08-dbbf-4056-bcd5-2e47d04e7e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:09.541226 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28fb08-dbbf-4056-bcd5-2e47d04e7e24 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:09.541511 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28fb08-dbbf-4056-bcd5-2e47d04e7e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:09.541785 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28fb08-dbbf-4056-bcd5-2e47d04e7e24 admin admin] PATH_INFO: `/v3/projects/f0b2bb62a02b42738382e22527b2ad02` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:09.543535 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28fb08-dbbf-4056-bcd5-2e47d04e7e24 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0b2bb62a02b42738382e22527b2ad02)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:09.545564 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec28fb08-dbbf-4056-bcd5-2e47d04e7e24 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:09.547347 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 577/1143] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:29:09 2022] GET /identity/v3/projects/f0b2bb62a02b42738382e22527b2ad02 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:09.552643 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8837c08-3c9b-4475-ba61-4d4b8bf13c9f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:09.561269 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8837c08-3c9b-4475-ba61-4d4b8bf13c9f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:09.565748 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65212004-afec-4409-91c0-e51845977ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:09.566368 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65212004-afec-4409-91c0-e51845977ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:09.566651 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65212004-afec-4409-91c0-e51845977ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:09.566952 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65212004-afec-4409-91c0-e51845977ce2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:09.567778 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65212004-afec-4409-91c0-e51845977ce2 admin admin] RBAC: Adding query filter params (role.id=05ca9a16ef2a450b8cc73ade47f5c7d0, scope.project.id=f0b2bb62a02b42738382e22527b2ad02, user.id=c549fd86633c436e961112c6e7158050) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:29:09.568089 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65212004-afec-4409-91c0-e51845977ce2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:09.569963 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65212004-afec-4409-91c0-e51845977ce2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:09.575429 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 567/1144] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:29:09 2022] GET /identity/v3/role_assignments?user.id=c549fd86633c436e961112c6e7158050&scope.project.id=f0b2bb62a02b42738382e22527b2ad02&role.id=05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:11.788057 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3f76d-bc37-4751-8cb1-3ddd33ae8360 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:11.788574 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3f76d-bc37-4751-8cb1-3ddd33ae8360 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:11.788659 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3f76d-bc37-4751-8cb1-3ddd33ae8360 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:11.790395 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 578/1145] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:29:11.795578 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d68be-5e61-431c-a8a3-6f800766294f None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:11.795998 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d68be-5e61-431c-a8a3-6f800766294f None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:11.796129 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d68be-5e61-431c-a8a3-6f800766294f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:11.813752 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-b22d68be-5e61-431c-a8a3-6f800766294f None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:29:11.814856 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-b22d68be-5e61-431c-a8a3-6f800766294f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:29:11.822213 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 568/1146] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:29:11 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:29:11.845457 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3f76d-bc37-4751-8cb1-3ddd33ae8360 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:11.857340 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3f76d-bc37-4751-8cb1-3ddd33ae8360 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:11.861652 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8b927-304f-41ea-af3d-c571b25a242d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:11.862417 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8b927-304f-41ea-af3d-c571b25a242d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:11.862702 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8b927-304f-41ea-af3d-c571b25a242d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:11.862981 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8b927-304f-41ea-af3d-c571b25a242d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:11.873387 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8b927-304f-41ea-af3d-c571b25a242d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:29:11.880197 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-06b8b927-304f-41ea-af3d-c571b25a242d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:29:11.881360 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 579/1147] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:29:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:29:11.887245 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d68be-5e61-431c-a8a3-6f800766294f None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:11.895876 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d68be-5e61-431c-a8a3-6f800766294f None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:11.900328 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d94a6-c24a-436c-a0fc-cb7db85dc422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:11.900969 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d94a6-c24a-436c-a0fc-cb7db85dc422 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:11.901283 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d94a6-c24a-436c-a0fc-cb7db85dc422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:11.901555 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d94a6-c24a-436c-a0fc-cb7db85dc422 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:11.902308 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d94a6-c24a-436c-a0fc-cb7db85dc422 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:29:11.902610 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d94a6-c24a-436c-a0fc-cb7db85dc422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:11.904177 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d94a6-c24a-436c-a0fc-cb7db85dc422 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:11.912319 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 569/1148] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:29:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:11.918204 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8b927-304f-41ea-af3d-c571b25a242d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:11.927963 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8b927-304f-41ea-af3d-c571b25a242d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:11.932385 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c75b88-674d-4234-812c-6f5a4ff47df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:11.933830 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c75b88-674d-4234-812c-6f5a4ff47df4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:11.934116 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c75b88-674d-4234-812c-6f5a4ff47df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:11.934392 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c75b88-674d-4234-812c-6f5a4ff47df4 admin admin] PATH_INFO: `/v3/users/c549fd86633c436e961112c6e7158050` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:11.935600 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c75b88-674d-4234-812c-6f5a4ff47df4 admin admin] RBAC: Authorizing `identity:get_user(user_id=c549fd86633c436e961112c6e7158050)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:11.937761 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c75b88-674d-4234-812c-6f5a4ff47df4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:11.939306 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 580/1149] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:29:11 2022] GET /identity/v3/users/c549fd86633c436e961112c6e7158050 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:29:11.944428 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d94a6-c24a-436c-a0fc-cb7db85dc422 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:11.953434 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d94a6-c24a-436c-a0fc-cb7db85dc422 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:11.957812 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cfb62-c8bf-4843-8b04-f04723516cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:11.958611 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cfb62-c8bf-4843-8b04-f04723516cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:11.958889 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cfb62-c8bf-4843-8b04-f04723516cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:11.959161 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cfb62-c8bf-4843-8b04-f04723516cb7 admin admin] PATH_INFO: `/v3/projects/f0b2bb62a02b42738382e22527b2ad02` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:11.960317 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cfb62-c8bf-4843-8b04-f04723516cb7 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0b2bb62a02b42738382e22527b2ad02)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:11.962319 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cfb62-c8bf-4843-8b04-f04723516cb7 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:11.963911 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 570/1150] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:29:11 2022] GET /identity/v3/projects/f0b2bb62a02b42738382e22527b2ad02 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:29:11.969298 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c75b88-674d-4234-812c-6f5a4ff47df4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:11.978327 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c75b88-674d-4234-812c-6f5a4ff47df4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:11.983224 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c7ff4-c8bb-4df7-8f37-65ccfcf647c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:11.984054 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c7ff4-c8bb-4df7-8f37-65ccfcf647c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:11.984336 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c7ff4-c8bb-4df7-8f37-65ccfcf647c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:11.984610 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c7ff4-c8bb-4df7-8f37-65ccfcf647c2 admin admin] PATH_INFO: `/v3/projects/f0b2bb62a02b42738382e22527b2ad02/users/c549fd86633c436e961112c6e7158050/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:11.986577 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c7ff4-c8bb-4df7-8f37-65ccfcf647c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b2bb62a02b42738382e22527b2ad02, user_id=c549fd86633c436e961112c6e7158050, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:11.989216 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c7ff4-c8bb-4df7-8f37-65ccfcf647c2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:12.002192 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 581/1151] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:29:11 2022] PUT /identity/v3/projects/f0b2bb62a02b42738382e22527b2ad02/users/c549fd86633c436e961112c6e7158050/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:29:14.177839 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86841c-6195-47a8-94af-635a02abdc90 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:14.178387 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86841c-6195-47a8-94af-635a02abdc90 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:14.178387 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86841c-6195-47a8-94af-635a02abdc90 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:14.180170 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 571/1152] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:29:14.186009 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c72b01-0af7-4cd7-8187-bb1cbfcf7e52 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:14.186445 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c72b01-0af7-4cd7-8187-bb1cbfcf7e52 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:14.186551 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c72b01-0af7-4cd7-8187-bb1cbfcf7e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:14.203669 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-63c72b01-0af7-4cd7-8187-bb1cbfcf7e52 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:29:14.204859 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-63c72b01-0af7-4cd7-8187-bb1cbfcf7e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:29:14.260208 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 582/1153] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:29:14 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:29:14.283500 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86841c-6195-47a8-94af-635a02abdc90 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:14.296141 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86841c-6195-47a8-94af-635a02abdc90 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:14.300412 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33794365-517e-4a6a-9fd6-f6279e60daaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:14.301214 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33794365-517e-4a6a-9fd6-f6279e60daaf admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:14.301500 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33794365-517e-4a6a-9fd6-f6279e60daaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:14.301775 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33794365-517e-4a6a-9fd6-f6279e60daaf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:14.312232 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33794365-517e-4a6a-9fd6-f6279e60daaf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:29:14.319049 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-33794365-517e-4a6a-9fd6-f6279e60daaf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:29:14.320167 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 572/1154] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:29:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:29:14.325574 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c72b01-0af7-4cd7-8187-bb1cbfcf7e52 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:14.334072 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c72b01-0af7-4cd7-8187-bb1cbfcf7e52 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:14.338453 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954eddd0-6a84-4102-af73-9fd2b13294d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:14.339098 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954eddd0-6a84-4102-af73-9fd2b13294d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:14.339378 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954eddd0-6a84-4102-af73-9fd2b13294d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:14.339653 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954eddd0-6a84-4102-af73-9fd2b13294d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:14.340407 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954eddd0-6a84-4102-af73-9fd2b13294d8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:29:14.340709 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954eddd0-6a84-4102-af73-9fd2b13294d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:14.342426 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954eddd0-6a84-4102-af73-9fd2b13294d8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:14.350313 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 583/1155] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:29:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:14.356017 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33794365-517e-4a6a-9fd6-f6279e60daaf admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:14.365761 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33794365-517e-4a6a-9fd6-f6279e60daaf admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:14.370768 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b00a6c-886a-4f03-a944-3e9792797c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:14.371569 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b00a6c-886a-4f03-a944-3e9792797c9d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:14.371861 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b00a6c-886a-4f03-a944-3e9792797c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:14.372139 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b00a6c-886a-4f03-a944-3e9792797c9d admin admin] PATH_INFO: `/v3/users/c549fd86633c436e961112c6e7158050` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:14.373591 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b00a6c-886a-4f03-a944-3e9792797c9d admin admin] RBAC: Authorizing `identity:get_user(user_id=c549fd86633c436e961112c6e7158050)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:14.375727 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b00a6c-886a-4f03-a944-3e9792797c9d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:14.377301 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 573/1156] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:29:14 2022] GET /identity/v3/users/c549fd86633c436e961112c6e7158050 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:14.382295 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954eddd0-6a84-4102-af73-9fd2b13294d8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:14.391261 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954eddd0-6a84-4102-af73-9fd2b13294d8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:14.395632 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3191728-b5aa-42de-8779-31672130e77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:14.396233 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3191728-b5aa-42de-8779-31672130e77a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:14.396515 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3191728-b5aa-42de-8779-31672130e77a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:14.396789 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3191728-b5aa-42de-8779-31672130e77a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:14.404235 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3191728-b5aa-42de-8779-31672130e77a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:14.405953 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3191728-b5aa-42de-8779-31672130e77a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:14.414841 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 584/1157] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:29:14 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:29:14.420158 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b00a6c-886a-4f03-a944-3e9792797c9d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:14.429318 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b00a6c-886a-4f03-a944-3e9792797c9d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:14.434352 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7973211-68cd-4064-8285-4609342ed3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:14.435138 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7973211-68cd-4064-8285-4609342ed3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:14.435421 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7973211-68cd-4064-8285-4609342ed3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:14.435698 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7973211-68cd-4064-8285-4609342ed3d3 admin admin] PATH_INFO: `/v3/projects/f0b2bb62a02b42738382e22527b2ad02` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:14.436852 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7973211-68cd-4064-8285-4609342ed3d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=f0b2bb62a02b42738382e22527b2ad02)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:14.438856 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7973211-68cd-4064-8285-4609342ed3d3 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:14.440456 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 574/1158] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:29:14 2022] GET /identity/v3/projects/f0b2bb62a02b42738382e22527b2ad02 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:29:14.445710 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3191728-b5aa-42de-8779-31672130e77a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:14.453941 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3191728-b5aa-42de-8779-31672130e77a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:14.458359 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fecc3-f07e-4865-a064-871d1006252e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:14.458955 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fecc3-f07e-4865-a064-871d1006252e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:14.459237 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fecc3-f07e-4865-a064-871d1006252e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:14.459512 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fecc3-f07e-4865-a064-871d1006252e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:14.460327 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15fecc3-f07e-4865-a064-871d1006252e admin admin] RBAC: Adding query filter params (role.id=05ca9a16ef2a450b8cc73ade47f5c7d0, scope.project.id=f0b2bb62a02b42738382e22527b2ad02, user.id=c549fd86633c436e961112c6e7158050) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:29:14.460640 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15fecc3-f07e-4865-a064-871d1006252e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:14.462457 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15fecc3-f07e-4865-a064-871d1006252e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:14.468223 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 585/1159] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:29:14 2022] GET /identity/v3/role_assignments?user.id=c549fd86633c436e961112c6e7158050&scope.project.id=f0b2bb62a02b42738382e22527b2ad02&role.id=05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:29:16.642915 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e6a7e-3019-4f77-9ce4-ffefba1cef9f None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:16.643437 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e6a7e-3019-4f77-9ce4-ffefba1cef9f None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:16.643525 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e6a7e-3019-4f77-9ce4-ffefba1cef9f None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:16.645276 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 575/1160] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:29:16.650496 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fb450-f7eb-418c-97db-b1f0412e0173 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:16.650912 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fb450-f7eb-418c-97db-b1f0412e0173 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:16.651651 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569fb450-f7eb-418c-97db-b1f0412e0173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:16.669151 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-569fb450-f7eb-418c-97db-b1f0412e0173 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:29:16.670328 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-569fb450-f7eb-418c-97db-b1f0412e0173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:29:16.677817 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 586/1161] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:29:16 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:29:16.700380 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e6a7e-3019-4f77-9ce4-ffefba1cef9f None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:16.712248 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e6a7e-3019-4f77-9ce4-ffefba1cef9f None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:16.717151 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fef129-6dae-4e45-94c5-48e00d1f9e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:16.717773 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fef129-6dae-4e45-94c5-48e00d1f9e95 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:16.718058 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fef129-6dae-4e45-94c5-48e00d1f9e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:16.718335 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fef129-6dae-4e45-94c5-48e00d1f9e95 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:16.725851 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fef129-6dae-4e45-94c5-48e00d1f9e95 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:16.727572 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fef129-6dae-4e45-94c5-48e00d1f9e95 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:16.736183 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 576/1162] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:29:16 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:29:16.741444 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fb450-f7eb-418c-97db-b1f0412e0173 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:16.750536 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569fb450-f7eb-418c-97db-b1f0412e0173 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:16.754924 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef000a-50b7-4055-9941-7d24e2e56a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:16.755691 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef000a-50b7-4055-9941-7d24e2e56a00 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:16.755973 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef000a-50b7-4055-9941-7d24e2e56a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:16.756248 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef000a-50b7-4055-9941-7d24e2e56a00 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:16.763517 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef000a-50b7-4055-9941-7d24e2e56a00 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:16.765365 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef000a-50b7-4055-9941-7d24e2e56a00 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:16.778591 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-daef000a-50b7-4055-9941-7d24e2e56a00 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 09 04:29:16.779684 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 587/1163] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Feb 9 04:29:16 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:29:16.785228 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fef129-6dae-4e45-94c5-48e00d1f9e95 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:16.793930 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fef129-6dae-4e45-94c5-48e00d1f9e95 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:16.798449 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacbd50-bf96-4c29-8d0b-bbfd97f87df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:16.799025 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacbd50-bf96-4c29-8d0b-bbfd97f87df9 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:16.799306 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacbd50-bf96-4c29-8d0b-bbfd97f87df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:16.799579 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacbd50-bf96-4c29-8d0b-bbfd97f87df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:16.800293 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aacbd50-bf96-4c29-8d0b-bbfd97f87df9 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:29:16.800595 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aacbd50-bf96-4c29-8d0b-bbfd97f87df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:16.802152 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aacbd50-bf96-4c29-8d0b-bbfd97f87df9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:16.809685 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 577/1164] 10.222.0.36 () {56 vars in 1136 bytes} [Wed Feb 9 04:29:16 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:18.989418 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab1d40-686c-4ca9-a653-2c06fbebdf30 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:18.989942 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab1d40-686c-4ca9-a653-2c06fbebdf30 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:18.989942 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab1d40-686c-4ca9-a653-2c06fbebdf30 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:18.991712 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 588/1165] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:29:18.997580 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e3c13-78cb-40b5-9ed9-372ea1473e4c None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:18.998000 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e3c13-78cb-40b5-9ed9-372ea1473e4c None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:18.998133 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e3c13-78cb-40b5-9ed9-372ea1473e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:19.015349 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-270e3c13-78cb-40b5-9ed9-372ea1473e4c None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:29:19.016531 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-270e3c13-78cb-40b5-9ed9-372ea1473e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:29:19.024075 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 578/1166] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:29:18 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:29:19.048189 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab1d40-686c-4ca9-a653-2c06fbebdf30 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:19.059867 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab1d40-686c-4ca9-a653-2c06fbebdf30 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:19.064135 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0b694-d075-4b10-aca8-6a51f8a17be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:19.064757 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0b694-d075-4b10-aca8-6a51f8a17be2 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:19.065057 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0b694-d075-4b10-aca8-6a51f8a17be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:19.065334 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0b694-d075-4b10-aca8-6a51f8a17be2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:19.066082 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0b694-d075-4b10-aca8-6a51f8a17be2 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:19.067081 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-07b0b694-d075-4b10-aca8-6a51f8a17be2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:29:19.067081 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 09 04:29:19.067081 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: Feb 09 04:29:19.067953 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0b694-d075-4b10-aca8-6a51f8a17be2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:19.081660 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 589/1167] 10.222.0.36 () {60 vars in 1159 bytes} [Wed Feb 9 04:29:19 2022] POST /identity/v3/domains => generated 267 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:29:21.296674 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda7100-4400-478c-b2b2-488bcde3b842 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:21.297276 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda7100-4400-478c-b2b2-488bcde3b842 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:21.297276 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda7100-4400-478c-b2b2-488bcde3b842 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:21.299015 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 579/1168] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:29:21.304206 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d795bf-dd05-46c6-8f2c-e25b1595b061 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:21.304637 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d795bf-dd05-46c6-8f2c-e25b1595b061 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:21.304763 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d795bf-dd05-46c6-8f2c-e25b1595b061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:21.323575 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-96d795bf-dd05-46c6-8f2c-e25b1595b061 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:29:21.324747 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-96d795bf-dd05-46c6-8f2c-e25b1595b061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:29:21.378463 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 590/1169] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:29:21 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:29:21.402899 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda7100-4400-478c-b2b2-488bcde3b842 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:21.415102 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda7100-4400-478c-b2b2-488bcde3b842 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:21.419375 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321c5dd-88a4-40ab-bf81-136b89415f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:21.420201 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321c5dd-88a4-40ab-bf81-136b89415f36 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:21.420484 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321c5dd-88a4-40ab-bf81-136b89415f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:21.420760 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321c5dd-88a4-40ab-bf81-136b89415f36 admin admin] PATH_INFO: `/v3/domains/38b35ba3a50a48a2ad7a13595453bccc` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:21.430927 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321c5dd-88a4-40ab-bf81-136b89415f36 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=38b35ba3a50a48a2ad7a13595453bccc)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:21.433455 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321c5dd-88a4-40ab-bf81-136b89415f36 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:21.435016 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 580/1170] 10.222.0.36 () {56 vars in 1204 bytes} [Wed Feb 9 04:29:21 2022] GET /identity/v3/domains/38b35ba3a50a48a2ad7a13595453bccc => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:21.440410 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d795bf-dd05-46c6-8f2c-e25b1595b061 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:21.449838 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d795bf-dd05-46c6-8f2c-e25b1595b061 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:21.455054 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a490a-accc-4853-a2fe-1dc0147a43be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:21.455697 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a490a-accc-4853-a2fe-1dc0147a43be admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:21.455978 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a490a-accc-4853-a2fe-1dc0147a43be admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:21.456278 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a490a-accc-4853-a2fe-1dc0147a43be admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:21.456994 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a490a-accc-4853-a2fe-1dc0147a43be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:21.458916 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a490a-accc-4853-a2fe-1dc0147a43be admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:21.482774 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 591/1171] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Feb 9 04:29:21 2022] POST /identity/v3/projects => generated 361 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:29:23.671133 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123aa0f-5c03-482b-8e31-2b963c4b6fb4 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:23.671672 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123aa0f-5c03-482b-8e31-2b963c4b6fb4 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:23.671672 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123aa0f-5c03-482b-8e31-2b963c4b6fb4 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:23.673475 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 581/1172] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:29:23.678509 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f28f0a-a64f-4b1c-848d-4d7462e9a040 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:23.678890 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f28f0a-a64f-4b1c-848d-4d7462e9a040 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:23.679072 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f28f0a-a64f-4b1c-848d-4d7462e9a040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:23.696169 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-e8f28f0a-a64f-4b1c-848d-4d7462e9a040 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:29:23.697365 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e8f28f0a-a64f-4b1c-848d-4d7462e9a040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:29:23.751026 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 592/1173] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:29:23 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:29:23.775281 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123aa0f-5c03-482b-8e31-2b963c4b6fb4 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:23.787963 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123aa0f-5c03-482b-8e31-2b963c4b6fb4 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:23.792792 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21a1af-1b0b-4db5-bec2-2bf68f1525c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:23.793650 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21a1af-1b0b-4db5-bec2-2bf68f1525c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:23.793926 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21a1af-1b0b-4db5-bec2-2bf68f1525c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:23.794195 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21a1af-1b0b-4db5-bec2-2bf68f1525c0 admin admin] PATH_INFO: `/v3/domains/38b35ba3a50a48a2ad7a13595453bccc` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:23.795342 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21a1af-1b0b-4db5-bec2-2bf68f1525c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=38b35ba3a50a48a2ad7a13595453bccc)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:23.797287 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21a1af-1b0b-4db5-bec2-2bf68f1525c0 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:23.798866 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 582/1174] 10.222.0.36 () {56 vars in 1204 bytes} [Wed Feb 9 04:29:23 2022] GET /identity/v3/domains/38b35ba3a50a48a2ad7a13595453bccc => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:23.803822 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f28f0a-a64f-4b1c-848d-4d7462e9a040 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:23.812350 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f28f0a-a64f-4b1c-848d-4d7462e9a040 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:23.816663 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ed0fe-d991-4b74-9b19-14ec2aa9104d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:23.817333 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ed0fe-d991-4b74-9b19-14ec2aa9104d admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:23.817613 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ed0fe-d991-4b74-9b19-14ec2aa9104d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:23.817882 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ed0fe-d991-4b74-9b19-14ec2aa9104d admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:23.818586 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ed0fe-d991-4b74-9b19-14ec2aa9104d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:23.820466 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ed0fe-d991-4b74-9b19-14ec2aa9104d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:23.839636 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 593/1175] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Feb 9 04:29:23 2022] POST /identity/v3/users => generated 311 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:29:26.030400 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a5b05-cb1e-4091-853b-79d411d9be20 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:26.030927 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a5b05-cb1e-4091-853b-79d411d9be20 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:26.030927 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a5b05-cb1e-4091-853b-79d411d9be20 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:26.032690 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 583/1176] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:29:26.038225 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421231a6-657a-4d12-8c5e-0d98d55f4fd8 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:26.038658 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421231a6-657a-4d12-8c5e-0d98d55f4fd8 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:26.038861 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421231a6-657a-4d12-8c5e-0d98d55f4fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:26.056261 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-421231a6-657a-4d12-8c5e-0d98d55f4fd8 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:29:26.057992 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-421231a6-657a-4d12-8c5e-0d98d55f4fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:29:26.065586 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 594/1177] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:29:26 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:29:26.089416 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a5b05-cb1e-4091-853b-79d411d9be20 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:26.101144 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a5b05-cb1e-4091-853b-79d411d9be20 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:26.105419 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c265110-b98e-4d47-a51c-af3815eec3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:26.106172 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c265110-b98e-4d47-a51c-af3815eec3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:26.106449 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c265110-b98e-4d47-a51c-af3815eec3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:26.106720 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c265110-b98e-4d47-a51c-af3815eec3a5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:26.116720 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c265110-b98e-4d47-a51c-af3815eec3a5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:29:26.124045 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-3c265110-b98e-4d47-a51c-af3815eec3a5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:29:26.125180 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 584/1178] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:29:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:29:26.130625 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421231a6-657a-4d12-8c5e-0d98d55f4fd8 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:26.139822 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421231a6-657a-4d12-8c5e-0d98d55f4fd8 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:26.144267 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411911a-ec00-44ee-a0b7-fb0bde97227b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:26.144912 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411911a-ec00-44ee-a0b7-fb0bde97227b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:26.145230 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411911a-ec00-44ee-a0b7-fb0bde97227b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:26.145511 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411911a-ec00-44ee-a0b7-fb0bde97227b admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:26.146270 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411911a-ec00-44ee-a0b7-fb0bde97227b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:29:26.146576 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411911a-ec00-44ee-a0b7-fb0bde97227b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:26.148174 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411911a-ec00-44ee-a0b7-fb0bde97227b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:26.156019 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 595/1179] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:29:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:26.161468 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c265110-b98e-4d47-a51c-af3815eec3a5 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:26.172268 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c265110-b98e-4d47-a51c-af3815eec3a5 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:26.178204 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2db35-8721-4e0a-8551-13ec8f921d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:26.179045 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2db35-8721-4e0a-8551-13ec8f921d4f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:26.179328 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2db35-8721-4e0a-8551-13ec8f921d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:26.179602 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2db35-8721-4e0a-8551-13ec8f921d4f admin admin] PATH_INFO: `/v3/users/3713f8f127724a22b4846039d8504309` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:26.197606 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2db35-8721-4e0a-8551-13ec8f921d4f admin admin] RBAC: Authorizing `identity:get_user(user_id=3713f8f127724a22b4846039d8504309)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:26.201316 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2db35-8721-4e0a-8551-13ec8f921d4f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:26.203905 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 585/1180] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:29:26 2022] GET /identity/v3/users/3713f8f127724a22b4846039d8504309 => generated 311 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:26.209590 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411911a-ec00-44ee-a0b7-fb0bde97227b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:26.219220 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411911a-ec00-44ee-a0b7-fb0bde97227b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:26.223617 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8e844-9192-493f-8086-58524b8310b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:26.224237 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8e844-9192-493f-8086-58524b8310b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:26.224517 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8e844-9192-493f-8086-58524b8310b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:26.224787 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8e844-9192-493f-8086-58524b8310b3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:26.234094 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8e844-9192-493f-8086-58524b8310b3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:26.235918 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f8e844-9192-493f-8086-58524b8310b3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:26.245818 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 596/1181] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:29:26 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:29:26.251568 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2db35-8721-4e0a-8551-13ec8f921d4f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:26.261066 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2db35-8721-4e0a-8551-13ec8f921d4f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:26.265521 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4800f33-86a6-4f45-8e58-6f7cc575f426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:26.266352 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4800f33-86a6-4f45-8e58-6f7cc575f426 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:26.266634 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4800f33-86a6-4f45-8e58-6f7cc575f426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:26.266910 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4800f33-86a6-4f45-8e58-6f7cc575f426 admin admin] PATH_INFO: `/v3/projects/4c7df57619a34c269e8b6f1f7f966d10` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:26.268082 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4800f33-86a6-4f45-8e58-6f7cc575f426 admin admin] RBAC: Authorizing `identity:get_project(project_id=4c7df57619a34c269e8b6f1f7f966d10)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:26.270139 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4800f33-86a6-4f45-8e58-6f7cc575f426 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:26.271795 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 586/1182] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:29:26 2022] GET /identity/v3/projects/4c7df57619a34c269e8b6f1f7f966d10 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:29:26.277272 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8e844-9192-493f-8086-58524b8310b3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:26.286102 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f8e844-9192-493f-8086-58524b8310b3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:26.290500 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e15647-3426-4577-85b4-564f4ba7be3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:26.291121 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e15647-3426-4577-85b4-564f4ba7be3f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:26.291900 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e15647-3426-4577-85b4-564f4ba7be3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:26.292178 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e15647-3426-4577-85b4-564f4ba7be3f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:26.293024 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e15647-3426-4577-85b4-564f4ba7be3f admin admin] RBAC: Adding query filter params (role.id=05ca9a16ef2a450b8cc73ade47f5c7d0, scope.project.id=4c7df57619a34c269e8b6f1f7f966d10, user.id=3713f8f127724a22b4846039d8504309) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:29:26.293355 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e15647-3426-4577-85b4-564f4ba7be3f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:26.295161 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e15647-3426-4577-85b4-564f4ba7be3f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:26.300348 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 597/1183] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:29:26 2022] GET /identity/v3/role_assignments?user.id=3713f8f127724a22b4846039d8504309&scope.project.id=4c7df57619a34c269e8b6f1f7f966d10&role.id=05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:28.561770 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee386dc-7fe6-44ad-809f-b23947673afa None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:28.562290 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee386dc-7fe6-44ad-809f-b23947673afa None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:28.562290 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee386dc-7fe6-44ad-809f-b23947673afa None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:28.564296 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 587/1184] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:29:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:29:28.571977 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4fc90-01f8-4882-9e11-3987c1ee2e0a None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:28.572944 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4fc90-01f8-4882-9e11-3987c1ee2e0a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:28.573092 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4fc90-01f8-4882-9e11-3987c1ee2e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:28.597842 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-f3d4fc90-01f8-4882-9e11-3987c1ee2e0a None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:29:28.599064 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f3d4fc90-01f8-4882-9e11-3987c1ee2e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:29:28.608844 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 598/1185] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:29:28 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:29:28.637747 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee386dc-7fe6-44ad-809f-b23947673afa None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:28.649594 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee386dc-7fe6-44ad-809f-b23947673afa None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:28.654543 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb1af3-4348-4930-9691-f783483ba966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:28.655301 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb1af3-4348-4930-9691-f783483ba966 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:28.655577 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb1af3-4348-4930-9691-f783483ba966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:28.655849 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb1af3-4348-4930-9691-f783483ba966 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:28.665896 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb1af3-4348-4930-9691-f783483ba966 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:29:28.672621 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-e4fb1af3-4348-4930-9691-f783483ba966 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:29:28.673777 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 588/1186] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:29:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:29:28.679514 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4fc90-01f8-4882-9e11-3987c1ee2e0a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:28.688402 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4fc90-01f8-4882-9e11-3987c1ee2e0a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:28.696603 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34681e3f-6dda-4ab8-8664-8d48ea977751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:28.697306 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34681e3f-6dda-4ab8-8664-8d48ea977751 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:28.698169 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34681e3f-6dda-4ab8-8664-8d48ea977751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:28.698448 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34681e3f-6dda-4ab8-8664-8d48ea977751 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:28.699214 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34681e3f-6dda-4ab8-8664-8d48ea977751 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:29:28.699523 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34681e3f-6dda-4ab8-8664-8d48ea977751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:28.701167 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34681e3f-6dda-4ab8-8664-8d48ea977751 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:28.709145 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 599/1187] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:29:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:28.715890 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb1af3-4348-4930-9691-f783483ba966 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:28.725274 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb1af3-4348-4930-9691-f783483ba966 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:28.729849 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162da7de-7c2f-4308-a62b-2c8acc8b446f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:28.730675 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162da7de-7c2f-4308-a62b-2c8acc8b446f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:28.730954 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162da7de-7c2f-4308-a62b-2c8acc8b446f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:28.731228 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162da7de-7c2f-4308-a62b-2c8acc8b446f admin admin] PATH_INFO: `/v3/users/3713f8f127724a22b4846039d8504309` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:28.732395 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162da7de-7c2f-4308-a62b-2c8acc8b446f admin admin] RBAC: Authorizing `identity:get_user(user_id=3713f8f127724a22b4846039d8504309)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:28.734524 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162da7de-7c2f-4308-a62b-2c8acc8b446f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:28.736061 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 589/1188] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:29:28 2022] GET /identity/v3/users/3713f8f127724a22b4846039d8504309 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:28.741236 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34681e3f-6dda-4ab8-8664-8d48ea977751 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:28.750956 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34681e3f-6dda-4ab8-8664-8d48ea977751 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:28.755367 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c06e21-dfb9-4e65-8698-b05f7a6b4624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:28.756183 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c06e21-dfb9-4e65-8698-b05f7a6b4624 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:28.756467 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c06e21-dfb9-4e65-8698-b05f7a6b4624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:28.756755 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c06e21-dfb9-4e65-8698-b05f7a6b4624 admin admin] PATH_INFO: `/v3/projects/4c7df57619a34c269e8b6f1f7f966d10` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:28.757963 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c06e21-dfb9-4e65-8698-b05f7a6b4624 admin admin] RBAC: Authorizing `identity:get_project(project_id=4c7df57619a34c269e8b6f1f7f966d10)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:28.760552 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c06e21-dfb9-4e65-8698-b05f7a6b4624 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:28.762329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 600/1189] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:29:28 2022] GET /identity/v3/projects/4c7df57619a34c269e8b6f1f7f966d10 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:28.767564 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162da7de-7c2f-4308-a62b-2c8acc8b446f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:28.777346 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162da7de-7c2f-4308-a62b-2c8acc8b446f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:28.781800 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb857de-a99e-44da-b23e-cd715c6cf7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:28.782621 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb857de-a99e-44da-b23e-cd715c6cf7b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:28.782899 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb857de-a99e-44da-b23e-cd715c6cf7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:28.783172 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb857de-a99e-44da-b23e-cd715c6cf7b1 admin admin] PATH_INFO: `/v3/projects/4c7df57619a34c269e8b6f1f7f966d10/users/3713f8f127724a22b4846039d8504309/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:28.785113 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb857de-a99e-44da-b23e-cd715c6cf7b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c7df57619a34c269e8b6f1f7f966d10, user_id=3713f8f127724a22b4846039d8504309, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:28.787943 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb857de-a99e-44da-b23e-cd715c6cf7b1 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:28.801422 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 590/1190] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:29:28 2022] PUT /identity/v3/projects/4c7df57619a34c269e8b6f1f7f966d10/users/3713f8f127724a22b4846039d8504309/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:29:30.949324 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccd990-06e3-4c0d-a99f-5b8a5d391991 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:30.949834 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccd990-06e3-4c0d-a99f-5b8a5d391991 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:30.949834 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccd990-06e3-4c0d-a99f-5b8a5d391991 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:30.951568 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 601/1191] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:29:30.956839 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a217949-dde5-4787-b9d3-152214315fef None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:30.957288 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a217949-dde5-4787-b9d3-152214315fef None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:30.957416 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a217949-dde5-4787-b9d3-152214315fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:30.974145 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-7a217949-dde5-4787-b9d3-152214315fef None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:29:30.975310 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7a217949-dde5-4787-b9d3-152214315fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:29:31.029990 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 591/1192] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:29:30 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:29:31.053630 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccd990-06e3-4c0d-a99f-5b8a5d391991 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:31.066046 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccd990-06e3-4c0d-a99f-5b8a5d391991 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:31.070385 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad773c8-d68f-41a1-8336-77d8aa0529d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:31.071148 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad773c8-d68f-41a1-8336-77d8aa0529d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:31.071432 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad773c8-d68f-41a1-8336-77d8aa0529d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:31.071709 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad773c8-d68f-41a1-8336-77d8aa0529d3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:31.082343 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad773c8-d68f-41a1-8336-77d8aa0529d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:29:31.089134 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-0ad773c8-d68f-41a1-8336-77d8aa0529d3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:29:31.090262 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 602/1193] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:29:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:29:31.095677 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a217949-dde5-4787-b9d3-152214315fef None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:31.104177 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a217949-dde5-4787-b9d3-152214315fef None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:31.108562 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d359da2-c7b6-41a3-a20f-f8a1ed9e46b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:31.109224 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d359da2-c7b6-41a3-a20f-f8a1ed9e46b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:31.109535 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d359da2-c7b6-41a3-a20f-f8a1ed9e46b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:31.109810 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d359da2-c7b6-41a3-a20f-f8a1ed9e46b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:31.110557 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d359da2-c7b6-41a3-a20f-f8a1ed9e46b3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:29:31.110858 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d359da2-c7b6-41a3-a20f-f8a1ed9e46b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:31.112422 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d359da2-c7b6-41a3-a20f-f8a1ed9e46b3 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:31.120957 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 592/1194] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:29:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:31.126376 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad773c8-d68f-41a1-8336-77d8aa0529d3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:31.136967 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad773c8-d68f-41a1-8336-77d8aa0529d3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:31.141361 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315e651-0221-432a-b445-c82ef74c9a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:31.142183 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315e651-0221-432a-b445-c82ef74c9a74 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:31.142463 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315e651-0221-432a-b445-c82ef74c9a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:31.142737 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315e651-0221-432a-b445-c82ef74c9a74 admin admin] PATH_INFO: `/v3/users/3713f8f127724a22b4846039d8504309` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:31.143916 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315e651-0221-432a-b445-c82ef74c9a74 admin admin] RBAC: Authorizing `identity:get_user(user_id=3713f8f127724a22b4846039d8504309)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:31.146057 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315e651-0221-432a-b445-c82ef74c9a74 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:31.147624 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 603/1195] 10.222.0.36 () {56 vars in 1198 bytes} [Wed Feb 9 04:29:31 2022] GET /identity/v3/users/3713f8f127724a22b4846039d8504309 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:31.152657 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d359da2-c7b6-41a3-a20f-f8a1ed9e46b3 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:31.162109 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d359da2-c7b6-41a3-a20f-f8a1ed9e46b3 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:31.166527 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e36c2a-1aa1-4ba5-97e7-7a8a08a208f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:31.167133 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e36c2a-1aa1-4ba5-97e7-7a8a08a208f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:31.167413 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e36c2a-1aa1-4ba5-97e7-7a8a08a208f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:31.167689 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e36c2a-1aa1-4ba5-97e7-7a8a08a208f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:31.175098 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e36c2a-1aa1-4ba5-97e7-7a8a08a208f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:31.176805 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e36c2a-1aa1-4ba5-97e7-7a8a08a208f8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:31.185757 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 593/1196] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:29:31 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:29:31.191072 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315e651-0221-432a-b445-c82ef74c9a74 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:31.203044 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315e651-0221-432a-b445-c82ef74c9a74 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:31.209915 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f42ae8-81a0-41dc-9d86-83d4071e14b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:31.211108 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f42ae8-81a0-41dc-9d86-83d4071e14b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:31.211544 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f42ae8-81a0-41dc-9d86-83d4071e14b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:31.211830 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f42ae8-81a0-41dc-9d86-83d4071e14b5 admin admin] PATH_INFO: `/v3/projects/4c7df57619a34c269e8b6f1f7f966d10` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:31.213045 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f42ae8-81a0-41dc-9d86-83d4071e14b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=4c7df57619a34c269e8b6f1f7f966d10)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:31.215096 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f42ae8-81a0-41dc-9d86-83d4071e14b5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:31.216767 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 604/1197] 10.222.0.36 () {56 vars in 1207 bytes} [Wed Feb 9 04:29:31 2022] GET /identity/v3/projects/4c7df57619a34c269e8b6f1f7f966d10 => generated 361 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:29:31.222619 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e36c2a-1aa1-4ba5-97e7-7a8a08a208f8 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:29:31.231336 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e36c2a-1aa1-4ba5-97e7-7a8a08a208f8 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:29:31.235805 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65b64e-374b-431b-b896-49cba7429a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:29:31.236428 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65b64e-374b-431b-b896-49cba7429a3f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:29:31.236707 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65b64e-374b-431b-b896-49cba7429a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:29:31.236977 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65b64e-374b-431b-b896-49cba7429a3f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:29:31.237828 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65b64e-374b-431b-b896-49cba7429a3f admin admin] RBAC: Adding query filter params (role.id=05ca9a16ef2a450b8cc73ade47f5c7d0, scope.project.id=4c7df57619a34c269e8b6f1f7f966d10, user.id=3713f8f127724a22b4846039d8504309) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:29:31.238134 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65b64e-374b-431b-b896-49cba7429a3f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:29:31.239939 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65b64e-374b-431b-b896-49cba7429a3f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:29:31.246063 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 594/1198] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:29:31 2022] GET /identity/v3/role_assignments?user.id=3713f8f127724a22b4846039d8504309&scope.project.id=4c7df57619a34c269e8b6f1f7f966d10&role.id=05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:30:31.266089 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c2c7f-ac56-4f8c-b833-c6d9c1e90a85 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:31.267124 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c2c7f-ac56-4f8c-b833-c6d9c1e90a85 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:31.267124 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c2c7f-ac56-4f8c-b833-c6d9c1e90a85 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:31.268772 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 605/1199] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:30:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:30:31.274450 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee433e-1d38-4b9a-90ed-0adb39fd2ba8 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:31.274887 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee433e-1d38-4b9a-90ed-0adb39fd2ba8 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:31.275098 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee433e-1d38-4b9a-90ed-0adb39fd2ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:31.300335 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-acee433e-1d38-4b9a-90ed-0adb39fd2ba8 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:30:31.301567 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-acee433e-1d38-4b9a-90ed-0adb39fd2ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:30:31.313222 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 595/1200] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:30:31 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:30:31.335015 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c2c7f-ac56-4f8c-b833-c6d9c1e90a85 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:31.348849 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c2c7f-ac56-4f8c-b833-c6d9c1e90a85 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:31.354125 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bd1eb-d443-4231-b638-8a0e052eb347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:31.354880 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bd1eb-d443-4231-b638-8a0e052eb347 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:31.355161 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bd1eb-d443-4231-b638-8a0e052eb347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:31.355432 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bd1eb-d443-4231-b638-8a0e052eb347 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:31.366419 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bd1eb-d443-4231-b638-8a0e052eb347 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:31.368231 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bd1eb-d443-4231-b638-8a0e052eb347 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:31.390700 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-834bd1eb-d443-4231-b638-8a0e052eb347 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:30:31.393050 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 606/1201] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:30:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:31.401386 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee433e-1d38-4b9a-90ed-0adb39fd2ba8 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:31.412540 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee433e-1d38-4b9a-90ed-0adb39fd2ba8 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:31.417601 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf4035-d8e2-477a-876a-77a6be30affd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:31.418743 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf4035-d8e2-477a-876a-77a6be30affd admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:31.419082 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf4035-d8e2-477a-876a-77a6be30affd admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:31.419540 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf4035-d8e2-477a-876a-77a6be30affd admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:31.420569 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf4035-d8e2-477a-876a-77a6be30affd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:31.420981 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf4035-d8e2-477a-876a-77a6be30affd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:31.423421 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf4035-d8e2-477a-876a-77a6be30affd admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:31.438524 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 596/1202] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:31.446152 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bd1eb-d443-4231-b638-8a0e052eb347 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:31.462790 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bd1eb-d443-4231-b638-8a0e052eb347 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:31.470900 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20ac29-92cc-472b-93a4-b29b115451b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:31.472019 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20ac29-92cc-472b-93a4-b29b115451b3 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:31.472473 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20ac29-92cc-472b-93a4-b29b115451b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:31.472928 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20ac29-92cc-472b-93a4-b29b115451b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:31.474259 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20ac29-92cc-472b-93a4-b29b115451b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:31.477279 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e20ac29-92cc-472b-93a4-b29b115451b3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:31.503794 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 607/1203] 10.222.0.36 () {60 vars in 1153 bytes} [Wed Feb 9 04:30:31 2022] POST /identity/v3/users => generated 251 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:30:34.094902 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262f652-78cb-48a8-9145-872399b2140c None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:34.096407 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262f652-78cb-48a8-9145-872399b2140c None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:34.096407 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262f652-78cb-48a8-9145-872399b2140c None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:34.097423 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 597/1204] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:30:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:30:34.103211 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0655ee3-dfb8-4664-980f-97e882e9dd6a None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:34.103646 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0655ee3-dfb8-4664-980f-97e882e9dd6a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:34.103788 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0655ee3-dfb8-4664-980f-97e882e9dd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:34.124388 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-f0655ee3-dfb8-4664-980f-97e882e9dd6a None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:30:34.125634 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f0655ee3-dfb8-4664-980f-97e882e9dd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:30:34.141170 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 608/1205] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:30:34 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:30:34.164344 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262f652-78cb-48a8-9145-872399b2140c None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:34.178630 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262f652-78cb-48a8-9145-872399b2140c None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:34.184655 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac384b60-5d84-4940-9d1d-d096ccfe7172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:34.185484 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac384b60-5d84-4940-9d1d-d096ccfe7172 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:34.185770 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac384b60-5d84-4940-9d1d-d096ccfe7172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:34.186047 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac384b60-5d84-4940-9d1d-d096ccfe7172 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:34.198780 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac384b60-5d84-4940-9d1d-d096ccfe7172 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:30:34.207464 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-ac384b60-5d84-4940-9d1d-d096ccfe7172 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 09 04:30:34.208834 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 598/1206] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:30:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:34.216687 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0655ee3-dfb8-4664-980f-97e882e9dd6a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:34.227587 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0655ee3-dfb8-4664-980f-97e882e9dd6a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:34.233030 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13e377-e1d2-43af-ac73-6741e47695f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:34.233824 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13e377-e1d2-43af-ac73-6741e47695f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:34.234175 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13e377-e1d2-43af-ac73-6741e47695f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:34.234470 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13e377-e1d2-43af-ac73-6741e47695f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:34.235413 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13e377-e1d2-43af-ac73-6741e47695f3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:34.235790 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13e377-e1d2-43af-ac73-6741e47695f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:34.237794 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13e377-e1d2-43af-ac73-6741e47695f3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:34.250811 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 609/1207] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Feb 9 04:30:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:34.257289 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac384b60-5d84-4940-9d1d-d096ccfe7172 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:34.268788 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac384b60-5d84-4940-9d1d-d096ccfe7172 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:34.274497 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8666872-ae3a-4c10-bbdc-5824aa19922d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:34.275318 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8666872-ae3a-4c10-bbdc-5824aa19922d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:34.275605 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8666872-ae3a-4c10-bbdc-5824aa19922d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:34.275881 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8666872-ae3a-4c10-bbdc-5824aa19922d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:34.288533 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8666872-ae3a-4c10-bbdc-5824aa19922d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:34.290540 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8666872-ae3a-4c10-bbdc-5824aa19922d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:34.310623 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-e8666872-ae3a-4c10-bbdc-5824aa19922d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:30:34.312374 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 599/1208] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:30:34.318028 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13e377-e1d2-43af-ac73-6741e47695f3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:34.328719 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13e377-e1d2-43af-ac73-6741e47695f3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:34.334049 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496551e1-675b-4ee6-9e84-4949e71090b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:34.334874 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496551e1-675b-4ee6-9e84-4949e71090b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:34.335226 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496551e1-675b-4ee6-9e84-4949e71090b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:34.335636 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496551e1-675b-4ee6-9e84-4949e71090b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:34.336692 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496551e1-675b-4ee6-9e84-4949e71090b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:34.337030 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496551e1-675b-4ee6-9e84-4949e71090b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:34.338968 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496551e1-675b-4ee6-9e84-4949e71090b9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:34.352881 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 610/1209] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:34.358653 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8666872-ae3a-4c10-bbdc-5824aa19922d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:34.370257 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8666872-ae3a-4c10-bbdc-5824aa19922d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:34.375577 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa300053-be31-44a3-9f8c-95f240f3077c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:34.376412 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa300053-be31-44a3-9f8c-95f240f3077c admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:34.376689 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa300053-be31-44a3-9f8c-95f240f3077c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:34.377023 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa300053-be31-44a3-9f8c-95f240f3077c admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:34.386243 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa300053-be31-44a3-9f8c-95f240f3077c admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:34.388404 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa300053-be31-44a3-9f8c-95f240f3077c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:34.403205 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-aa300053-be31-44a3-9f8c-95f240f3077c admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 09 04:30:34.404804 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 600/1210] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:30:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:30:34.410834 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496551e1-675b-4ee6-9e84-4949e71090b9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:34.421759 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496551e1-675b-4ee6-9e84-4949e71090b9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:34.430372 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed083715-a04a-4388-94e5-ffda1bb068b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:34.431049 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed083715-a04a-4388-94e5-ffda1bb068b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:34.431333 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed083715-a04a-4388-94e5-ffda1bb068b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:34.431640 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed083715-a04a-4388-94e5-ffda1bb068b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:34.432720 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed083715-a04a-4388-94e5-ffda1bb068b4 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:34.433137 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed083715-a04a-4388-94e5-ffda1bb068b4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:34.435014 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed083715-a04a-4388-94e5-ffda1bb068b4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:34.453040 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 611/1211] 10.222.0.36 () {56 vars in 1164 bytes} [Wed Feb 9 04:30:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:34.458691 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa300053-be31-44a3-9f8c-95f240f3077c admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:34.470100 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa300053-be31-44a3-9f8c-95f240f3077c admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:34.475229 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f4d42-ade4-4ff5-8c90-694917b48ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:34.476395 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f4d42-ade4-4ff5-8c90-694917b48ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:34.476898 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f4d42-ade4-4ff5-8c90-694917b48ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:34.478764 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f4d42-ade4-4ff5-8c90-694917b48ab0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:34.490155 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f4d42-ade4-4ff5-8c90-694917b48ab0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:34.492198 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f4d42-ade4-4ff5-8c90-694917b48ab0 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:34.502622 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 601/1212] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:30:34 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:30:34.509074 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed083715-a04a-4388-94e5-ffda1bb068b4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:34.519317 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed083715-a04a-4388-94e5-ffda1bb068b4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:34.525029 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c6c56-447d-4ab5-a0a7-efa68fe86ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:34.525881 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c6c56-447d-4ab5-a0a7-efa68fe86ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:34.526161 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c6c56-447d-4ab5-a0a7-efa68fe86ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:34.526433 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364c6c56-447d-4ab5-a0a7-efa68fe86ff7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:34.537984 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c6c56-447d-4ab5-a0a7-efa68fe86ff7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:34.540611 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364c6c56-447d-4ab5-a0a7-efa68fe86ff7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:34.557943 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-364c6c56-447d-4ab5-a0a7-efa68fe86ff7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:30:34.560420 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 612/1213] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:34.565322 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f4d42-ade4-4ff5-8c90-694917b48ab0 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:34.579788 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f4d42-ade4-4ff5-8c90-694917b48ab0 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:34.585745 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cead7f-7e3e-4976-b726-b59df1746eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:34.586427 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cead7f-7e3e-4976-b726-b59df1746eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:34.586764 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cead7f-7e3e-4976-b726-b59df1746eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:34.587054 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cead7f-7e3e-4976-b726-b59df1746eb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:34.587861 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cead7f-7e3e-4976-b726-b59df1746eb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:34.588172 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cead7f-7e3e-4976-b726-b59df1746eb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:34.589942 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cead7f-7e3e-4976-b726-b59df1746eb5 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:34.602562 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 602/1214] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:34.608554 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c6c56-447d-4ab5-a0a7-efa68fe86ff7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:34.618607 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364c6c56-447d-4ab5-a0a7-efa68fe86ff7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:34.623180 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcca70e-d6d0-4d99-9395-20642c599102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:34.623966 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcca70e-d6d0-4d99-9395-20642c599102 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:34.624252 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcca70e-d6d0-4d99-9395-20642c599102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:34.624534 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcca70e-d6d0-4d99-9395-20642c599102 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:34.632829 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcca70e-d6d0-4d99-9395-20642c599102 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:34.635329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcca70e-d6d0-4d99-9395-20642c599102 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:34.650060 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-ffcca70e-d6d0-4d99-9395-20642c599102 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:30:34.655969 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 613/1215] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:30:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:34.657702 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cead7f-7e3e-4976-b726-b59df1746eb5 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:34.668488 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cead7f-7e3e-4976-b726-b59df1746eb5 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:34.673556 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb74716-3ee0-49f5-900e-49c93669a51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:34.674283 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb74716-3ee0-49f5-900e-49c93669a51d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:34.674620 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb74716-3ee0-49f5-900e-49c93669a51d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:34.674894 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb74716-3ee0-49f5-900e-49c93669a51d admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:34.675788 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb74716-3ee0-49f5-900e-49c93669a51d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:34.676175 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb74716-3ee0-49f5-900e-49c93669a51d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:34.678050 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb74716-3ee0-49f5-900e-49c93669a51d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:34.697999 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 603/1216] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:30:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:34.700031 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcca70e-d6d0-4d99-9395-20642c599102 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:34.711423 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcca70e-d6d0-4d99-9395-20642c599102 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:34.718183 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050a3dc-0c22-42be-add8-5b50b0cf9c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:34.718874 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050a3dc-0c22-42be-add8-5b50b0cf9c80 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:34.719160 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050a3dc-0c22-42be-add8-5b50b0cf9c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:34.719436 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050a3dc-0c22-42be-add8-5b50b0cf9c80 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:34.720290 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050a3dc-0c22-42be-add8-5b50b0cf9c80 admin admin] RBAC: Adding query filter params (role.id=0f98a58e4d884f4aa616093ea30cb15e, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=add56fc0cfd8403b86c5ef23fd374a5a) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:34.720629 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050a3dc-0c22-42be-add8-5b50b0cf9c80 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:34.722539 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050a3dc-0c22-42be-add8-5b50b0cf9c80 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:34.728577 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 614/1217] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:30:34 2022] GET /identity/v3/role_assignments?user.id=add56fc0cfd8403b86c5ef23fd374a5a&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=0f98a58e4d884f4aa616093ea30cb15e => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:30:37.049961 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b90252-163d-490a-bf56-49fd6a892d71 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:37.050538 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b90252-163d-490a-bf56-49fd6a892d71 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:37.050538 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b90252-163d-490a-bf56-49fd6a892d71 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:37.052428 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 604/1218] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:30:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:30:37.059092 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6d38a-7c64-4fb9-ac8b-72a5c3a41d2b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:37.059553 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6d38a-7c64-4fb9-ac8b-72a5c3a41d2b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:37.059649 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6d38a-7c64-4fb9-ac8b-72a5c3a41d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:37.080664 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-98b6d38a-7c64-4fb9-ac8b-72a5c3a41d2b None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:30:37.081905 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-98b6d38a-7c64-4fb9-ac8b-72a5c3a41d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:30:37.090220 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 615/1219] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:30:37 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:30:37.117061 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b90252-163d-490a-bf56-49fd6a892d71 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:37.135402 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b90252-163d-490a-bf56-49fd6a892d71 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:37.140897 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f56b37-fe94-4b67-98e1-87455c05aea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:37.141764 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f56b37-fe94-4b67-98e1-87455c05aea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:37.142091 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f56b37-fe94-4b67-98e1-87455c05aea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:37.142395 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f56b37-fe94-4b67-98e1-87455c05aea4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:37.155174 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f56b37-fe94-4b67-98e1-87455c05aea4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:30:37.163743 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-09f56b37-fe94-4b67-98e1-87455c05aea4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 09 04:30:37.164970 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 605/1220] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:30:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:37.175531 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6d38a-7c64-4fb9-ac8b-72a5c3a41d2b None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:37.181537 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6d38a-7c64-4fb9-ac8b-72a5c3a41d2b None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:37.189964 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d9276-9a99-4b30-97ba-23b85bc2a0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:37.190647 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d9276-9a99-4b30-97ba-23b85bc2a0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:37.190934 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d9276-9a99-4b30-97ba-23b85bc2a0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:37.191214 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d9276-9a99-4b30-97ba-23b85bc2a0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:37.191999 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d9276-9a99-4b30-97ba-23b85bc2a0e5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:37.192306 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d9276-9a99-4b30-97ba-23b85bc2a0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:37.193964 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d9276-9a99-4b30-97ba-23b85bc2a0e5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:37.208427 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 616/1221] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Feb 9 04:30:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:37.210252 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f56b37-fe94-4b67-98e1-87455c05aea4 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:37.224254 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f56b37-fe94-4b67-98e1-87455c05aea4 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:37.230497 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1501b-46fc-47fc-9e56-e08575aa5e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:37.231452 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1501b-46fc-47fc-9e56-e08575aa5e18 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:37.231838 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1501b-46fc-47fc-9e56-e08575aa5e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:37.232198 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1501b-46fc-47fc-9e56-e08575aa5e18 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:37.245380 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1501b-46fc-47fc-9e56-e08575aa5e18 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:37.247858 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1501b-46fc-47fc-9e56-e08575aa5e18 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:37.269251 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-27d1501b-46fc-47fc-9e56-e08575aa5e18 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:30:37.270818 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 606/1222] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:30:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:37.276877 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d9276-9a99-4b30-97ba-23b85bc2a0e5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:37.287969 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d9276-9a99-4b30-97ba-23b85bc2a0e5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:37.295785 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3298a-d2f4-4c40-a3eb-af04f20a82de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:37.296652 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3298a-d2f4-4c40-a3eb-af04f20a82de admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:37.297052 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3298a-d2f4-4c40-a3eb-af04f20a82de admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:37.297452 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3298a-d2f4-4c40-a3eb-af04f20a82de admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:37.299423 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3298a-d2f4-4c40-a3eb-af04f20a82de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:37.299423 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3298a-d2f4-4c40-a3eb-af04f20a82de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:37.300420 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f3298a-d2f4-4c40-a3eb-af04f20a82de admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:37.314920 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 617/1223] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:37.321928 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1501b-46fc-47fc-9e56-e08575aa5e18 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:37.334357 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1501b-46fc-47fc-9e56-e08575aa5e18 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:37.339722 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1deb5c-2480-4b2b-9f0e-07fa14045885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:37.340549 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1deb5c-2480-4b2b-9f0e-07fa14045885 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:37.340832 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1deb5c-2480-4b2b-9f0e-07fa14045885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:37.341151 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1deb5c-2480-4b2b-9f0e-07fa14045885 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:37.351460 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1deb5c-2480-4b2b-9f0e-07fa14045885 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:37.353568 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1deb5c-2480-4b2b-9f0e-07fa14045885 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:37.368673 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-3d1deb5c-2480-4b2b-9f0e-07fa14045885 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 09 04:30:37.370085 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 607/1224] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:30:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:37.376141 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3298a-d2f4-4c40-a3eb-af04f20a82de admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:37.386351 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3298a-d2f4-4c40-a3eb-af04f20a82de admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:37.391264 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31617fbf-0ae7-4690-9671-844018bcd845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:37.392031 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31617fbf-0ae7-4690-9671-844018bcd845 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:37.392386 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31617fbf-0ae7-4690-9671-844018bcd845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:37.392739 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31617fbf-0ae7-4690-9671-844018bcd845 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:37.393708 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31617fbf-0ae7-4690-9671-844018bcd845 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:37.394145 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31617fbf-0ae7-4690-9671-844018bcd845 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:37.396720 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31617fbf-0ae7-4690-9671-844018bcd845 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:37.418259 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 618/1225] 10.222.0.36 () {56 vars in 1164 bytes} [Wed Feb 9 04:30:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:37.426264 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1deb5c-2480-4b2b-9f0e-07fa14045885 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:37.438442 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1deb5c-2480-4b2b-9f0e-07fa14045885 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:37.443859 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f838b-9de9-4685-ad54-4e307a34c324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:37.444798 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f838b-9de9-4685-ad54-4e307a34c324 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:37.445215 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f838b-9de9-4685-ad54-4e307a34c324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:37.445559 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f838b-9de9-4685-ad54-4e307a34c324 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:37.462441 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f838b-9de9-4685-ad54-4e307a34c324 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:37.464346 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f838b-9de9-4685-ad54-4e307a34c324 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:37.485331 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-6f6f838b-9de9-4685-ad54-4e307a34c324 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:30:37.486905 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 608/1226] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:30:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:37.493690 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31617fbf-0ae7-4690-9671-844018bcd845 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:37.504625 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31617fbf-0ae7-4690-9671-844018bcd845 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:37.513234 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6885ab-e25a-4236-890c-4c6a1eca1827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:37.513916 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6885ab-e25a-4236-890c-4c6a1eca1827 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:37.514200 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6885ab-e25a-4236-890c-4c6a1eca1827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:37.514478 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6885ab-e25a-4236-890c-4c6a1eca1827 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:37.515230 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6885ab-e25a-4236-890c-4c6a1eca1827 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:37.515541 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6885ab-e25a-4236-890c-4c6a1eca1827 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:37.517193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6885ab-e25a-4236-890c-4c6a1eca1827 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:37.530490 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 619/1227] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:37.536575 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f838b-9de9-4685-ad54-4e307a34c324 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:37.549790 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f838b-9de9-4685-ad54-4e307a34c324 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:37.555201 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f00ad9-4763-4719-8310-3b76923ad58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:37.556060 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f00ad9-4763-4719-8310-3b76923ad58f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:37.556459 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f00ad9-4763-4719-8310-3b76923ad58f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:37.556737 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f00ad9-4763-4719-8310-3b76923ad58f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:37.565034 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f00ad9-4763-4719-8310-3b76923ad58f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:37.567383 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f00ad9-4763-4719-8310-3b76923ad58f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:37.584973 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-06f00ad9-4763-4719-8310-3b76923ad58f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:30:37.586719 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 609/1228] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:30:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:37.592802 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6885ab-e25a-4236-890c-4c6a1eca1827 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:37.604873 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6885ab-e25a-4236-890c-4c6a1eca1827 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:37.609683 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f8286-8dc1-4057-b813-30aa5adf453d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:37.610879 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f8286-8dc1-4057-b813-30aa5adf453d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:37.611507 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f8286-8dc1-4057-b813-30aa5adf453d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:37.615916 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f8286-8dc1-4057-b813-30aa5adf453d admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:37.617384 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f8286-8dc1-4057-b813-30aa5adf453d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:37.617709 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f8286-8dc1-4057-b813-30aa5adf453d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:37.619652 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f8286-8dc1-4057-b813-30aa5adf453d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:37.641053 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 620/1229] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:30:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:37.643060 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f00ad9-4763-4719-8310-3b76923ad58f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:37.655100 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f00ad9-4763-4719-8310-3b76923ad58f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:37.660194 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e8ec6-4c60-459f-9fd9-2a6f2512ff58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:37.661271 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e8ec6-4c60-459f-9fd9-2a6f2512ff58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:37.661672 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e8ec6-4c60-459f-9fd9-2a6f2512ff58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:37.662052 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e8ec6-4c60-459f-9fd9-2a6f2512ff58 admin admin] PATH_INFO: `/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/add56fc0cfd8403b86c5ef23fd374a5a/roles/0f98a58e4d884f4aa616093ea30cb15e` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:37.677136 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e8ec6-4c60-459f-9fd9-2a6f2512ff58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e618c4377ec64e2e8a6d332696019fac, user_id=add56fc0cfd8403b86c5ef23fd374a5a, role_id=0f98a58e4d884f4aa616093ea30cb15e)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:37.679979 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e8ec6-4c60-459f-9fd9-2a6f2512ff58 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:37.693586 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 610/1230] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:30:37 2022] PUT /identity/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/add56fc0cfd8403b86c5ef23fd374a5a/roles/0f98a58e4d884f4aa616093ea30cb15e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:30:40.111123 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a571d5-248c-4f7d-924e-206068f457b5 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:40.111787 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a571d5-248c-4f7d-924e-206068f457b5 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:40.111787 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a571d5-248c-4f7d-924e-206068f457b5 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:40.113781 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 621/1231] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:30:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:30:40.120138 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8706a64-c3c1-4766-9c6f-647b596ae23b None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:40.120581 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8706a64-c3c1-4766-9c6f-647b596ae23b None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:40.120695 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8706a64-c3c1-4766-9c6f-647b596ae23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:40.140865 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-b8706a64-c3c1-4766-9c6f-647b596ae23b None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:30:40.142364 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-b8706a64-c3c1-4766-9c6f-647b596ae23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:30:40.210539 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 611/1232] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:30:40 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:30:40.240610 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a571d5-248c-4f7d-924e-206068f457b5 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:40.257978 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a571d5-248c-4f7d-924e-206068f457b5 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:40.263664 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae20d6-6ea7-4522-96ce-c2a4a86c91fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:40.264534 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae20d6-6ea7-4522-96ce-c2a4a86c91fc admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:40.264813 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae20d6-6ea7-4522-96ce-c2a4a86c91fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:40.265116 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae20d6-6ea7-4522-96ce-c2a4a86c91fc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:40.276699 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae20d6-6ea7-4522-96ce-c2a4a86c91fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:30:40.284053 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-fdae20d6-6ea7-4522-96ce-c2a4a86c91fc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 09 04:30:40.285348 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 622/1233] 10.222.0.36 () {56 vars in 1123 bytes} [Wed Feb 9 04:30:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:40.292873 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8706a64-c3c1-4766-9c6f-647b596ae23b None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:40.302749 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8706a64-c3c1-4766-9c6f-647b596ae23b None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:40.308895 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d22363-37c9-4f2d-bc24-e126cb4a1225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:40.309761 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d22363-37c9-4f2d-bc24-e126cb4a1225 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:40.310046 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d22363-37c9-4f2d-bc24-e126cb4a1225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:40.310325 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d22363-37c9-4f2d-bc24-e126cb4a1225 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:40.311089 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d22363-37c9-4f2d-bc24-e126cb4a1225 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:40.311395 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d22363-37c9-4f2d-bc24-e126cb4a1225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:40.312999 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d22363-37c9-4f2d-bc24-e126cb4a1225 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:40.322896 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 612/1234] 10.222.0.36 () {56 vars in 1124 bytes} [Wed Feb 9 04:30:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:40.328952 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae20d6-6ea7-4522-96ce-c2a4a86c91fc admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:40.340010 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae20d6-6ea7-4522-96ce-c2a4a86c91fc admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:40.346312 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865896c8-6e78-49fb-869e-c9025f9e99ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:40.347102 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865896c8-6e78-49fb-869e-c9025f9e99ba admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:40.347383 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865896c8-6e78-49fb-869e-c9025f9e99ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:40.347663 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865896c8-6e78-49fb-869e-c9025f9e99ba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:40.360859 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865896c8-6e78-49fb-869e-c9025f9e99ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:40.362800 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865896c8-6e78-49fb-869e-c9025f9e99ba admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:40.380234 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-865896c8-6e78-49fb-869e-c9025f9e99ba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:30:40.381477 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 623/1235] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:30:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:30:40.387905 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d22363-37c9-4f2d-bc24-e126cb4a1225 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:40.401585 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d22363-37c9-4f2d-bc24-e126cb4a1225 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:40.407274 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f49f34-5b1d-4f9d-8376-42cfd01b942c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:40.408029 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f49f34-5b1d-4f9d-8376-42cfd01b942c admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:40.408351 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f49f34-5b1d-4f9d-8376-42cfd01b942c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:40.408919 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f49f34-5b1d-4f9d-8376-42cfd01b942c admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:40.409850 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f49f34-5b1d-4f9d-8376-42cfd01b942c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:40.410196 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f49f34-5b1d-4f9d-8376-42cfd01b942c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:40.412321 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f49f34-5b1d-4f9d-8376-42cfd01b942c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:40.425813 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 613/1236] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:40.431389 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865896c8-6e78-49fb-869e-c9025f9e99ba admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:40.445557 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865896c8-6e78-49fb-869e-c9025f9e99ba admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:40.451278 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebc9a7-679d-4505-896c-3e098bb0169a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:40.452112 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebc9a7-679d-4505-896c-3e098bb0169a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:40.452394 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebc9a7-679d-4505-896c-3e098bb0169a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:40.452682 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebc9a7-679d-4505-896c-3e098bb0169a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:40.461722 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebc9a7-679d-4505-896c-3e098bb0169a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:40.463813 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebc9a7-679d-4505-896c-3e098bb0169a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:40.480471 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-85ebc9a7-679d-4505-896c-3e098bb0169a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 09 04:30:40.482359 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 624/1237] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:30:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:40.487958 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f49f34-5b1d-4f9d-8376-42cfd01b942c admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:40.502340 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f49f34-5b1d-4f9d-8376-42cfd01b942c admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:40.507894 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c818f-c449-4c0c-8586-99676322c9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:40.508555 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c818f-c449-4c0c-8586-99676322c9be admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:40.508836 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c818f-c449-4c0c-8586-99676322c9be admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:40.509160 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c818f-c449-4c0c-8586-99676322c9be admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:40.510809 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c818f-c449-4c0c-8586-99676322c9be admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:40.511119 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c818f-c449-4c0c-8586-99676322c9be admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:40.513328 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c818f-c449-4c0c-8586-99676322c9be admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:40.534871 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 614/1238] 10.222.0.36 () {56 vars in 1164 bytes} [Wed Feb 9 04:30:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:40.540742 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebc9a7-679d-4505-896c-3e098bb0169a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:40.553793 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebc9a7-679d-4505-896c-3e098bb0169a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:40.558851 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdca6b7-882e-49c5-becf-1efa129a8b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:40.559492 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdca6b7-882e-49c5-becf-1efa129a8b47 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:40.559798 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdca6b7-882e-49c5-becf-1efa129a8b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:40.560134 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdca6b7-882e-49c5-becf-1efa129a8b47 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:40.569878 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdca6b7-882e-49c5-becf-1efa129a8b47 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:40.571642 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdca6b7-882e-49c5-becf-1efa129a8b47 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:40.581889 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 625/1239] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:30:40 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:30:40.588574 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c818f-c449-4c0c-8586-99676322c9be admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:40.606076 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c818f-c449-4c0c-8586-99676322c9be admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:40.612572 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440f682-ec33-4e34-8168-b8c81cf56c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:40.613735 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440f682-ec33-4e34-8168-b8c81cf56c14 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:40.613963 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440f682-ec33-4e34-8168-b8c81cf56c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:40.614243 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440f682-ec33-4e34-8168-b8c81cf56c14 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:40.625201 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440f682-ec33-4e34-8168-b8c81cf56c14 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:40.627044 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440f682-ec33-4e34-8168-b8c81cf56c14 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:40.645638 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-0440f682-ec33-4e34-8168-b8c81cf56c14 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:30:40.646959 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 615/1240] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:30:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:40.653335 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdca6b7-882e-49c5-becf-1efa129a8b47 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:40.663566 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdca6b7-882e-49c5-becf-1efa129a8b47 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:40.668432 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb571b33-3395-4da1-9f1c-b872888af6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:40.669225 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb571b33-3395-4da1-9f1c-b872888af6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:40.669440 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb571b33-3395-4da1-9f1c-b872888af6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:40.669697 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb571b33-3395-4da1-9f1c-b872888af6d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:40.670437 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb571b33-3395-4da1-9f1c-b872888af6d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:40.670744 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb571b33-3395-4da1-9f1c-b872888af6d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:40.672359 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb571b33-3395-4da1-9f1c-b872888af6d5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:40.685592 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 626/1241] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:30:40.691275 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440f682-ec33-4e34-8168-b8c81cf56c14 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:40.702212 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440f682-ec33-4e34-8168-b8c81cf56c14 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:40.706818 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44232f52-9bcc-4e6c-b8ae-990bbf7fc601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:40.707666 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44232f52-9bcc-4e6c-b8ae-990bbf7fc601 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:40.708015 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44232f52-9bcc-4e6c-b8ae-990bbf7fc601 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:40.708353 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44232f52-9bcc-4e6c-b8ae-990bbf7fc601 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:40.717229 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44232f52-9bcc-4e6c-b8ae-990bbf7fc601 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:40.719169 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44232f52-9bcc-4e6c-b8ae-990bbf7fc601 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:40.733321 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-44232f52-9bcc-4e6c-b8ae-990bbf7fc601 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:30:40.734804 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 616/1242] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:30:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:40.741626 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb571b33-3395-4da1-9f1c-b872888af6d5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:40.752885 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb571b33-3395-4da1-9f1c-b872888af6d5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:40.757794 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31503d5-ae13-469e-9906-b534a900faef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:40.758536 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31503d5-ae13-469e-9906-b534a900faef admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:40.758822 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31503d5-ae13-469e-9906-b534a900faef admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:40.759104 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31503d5-ae13-469e-9906-b534a900faef admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:40.759904 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31503d5-ae13-469e-9906-b534a900faef admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:40.760211 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31503d5-ae13-469e-9906-b534a900faef admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:40.762467 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31503d5-ae13-469e-9906-b534a900faef admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:40.777877 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 627/1243] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:30:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:40.785110 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44232f52-9bcc-4e6c-b8ae-990bbf7fc601 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:40.797493 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44232f52-9bcc-4e6c-b8ae-990bbf7fc601 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:40.804118 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831d8cf-4189-4fac-8aa3-1f53294f0a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:40.804118 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831d8cf-4189-4fac-8aa3-1f53294f0a07 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:40.804118 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831d8cf-4189-4fac-8aa3-1f53294f0a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:40.804454 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831d8cf-4189-4fac-8aa3-1f53294f0a07 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:40.805152 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831d8cf-4189-4fac-8aa3-1f53294f0a07 admin admin] RBAC: Adding query filter params (role.id=0f98a58e4d884f4aa616093ea30cb15e, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=add56fc0cfd8403b86c5ef23fd374a5a) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:40.805462 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831d8cf-4189-4fac-8aa3-1f53294f0a07 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:40.807423 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831d8cf-4189-4fac-8aa3-1f53294f0a07 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:40.814193 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 617/1244] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:30:40 2022] GET /identity/v3/role_assignments?user.id=add56fc0cfd8403b86c5ef23fd374a5a&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=0f98a58e4d884f4aa616093ea30cb15e => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:43.254164 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285b019-fd4a-4282-8246-be8e897dd63b None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:43.254858 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285b019-fd4a-4282-8246-be8e897dd63b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:43.254858 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a285b019-fd4a-4282-8246-be8e897dd63b None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:43.257360 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 628/1245] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:30:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:30:43.263508 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac180b7-3471-480a-8f77-14103d41504e None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:43.263980 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac180b7-3471-480a-8f77-14103d41504e None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:43.264059 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac180b7-3471-480a-8f77-14103d41504e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:43.283085 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-2ac180b7-3471-480a-8f77-14103d41504e None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:30:43.284668 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-2ac180b7-3471-480a-8f77-14103d41504e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:30:43.293653 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 618/1246] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:30:43 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:30:43.321479 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285b019-fd4a-4282-8246-be8e897dd63b None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:43.334329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a285b019-fd4a-4282-8246-be8e897dd63b None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:43.339272 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e504b-d6c8-4502-af25-8244020c8fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:43.340055 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e504b-d6c8-4502-af25-8244020c8fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:43.340416 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e504b-d6c8-4502-af25-8244020c8fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:43.340643 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e504b-d6c8-4502-af25-8244020c8fe6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:43.355212 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e504b-d6c8-4502-af25-8244020c8fe6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:30:43.363002 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-d89e504b-d6c8-4502-af25-8244020c8fe6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:30:43.364222 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 629/1247] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:30:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:43.370838 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac180b7-3471-480a-8f77-14103d41504e None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:43.383578 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac180b7-3471-480a-8f77-14103d41504e None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:43.388328 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b2822-3d25-4f04-a62d-4df71ff603e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:43.388986 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b2822-3d25-4f04-a62d-4df71ff603e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:43.390214 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b2822-3d25-4f04-a62d-4df71ff603e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:43.390524 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b2822-3d25-4f04-a62d-4df71ff603e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:43.391265 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b2822-3d25-4f04-a62d-4df71ff603e2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:43.391572 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b2822-3d25-4f04-a62d-4df71ff603e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:43.393185 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b2822-3d25-4f04-a62d-4df71ff603e2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:43.403738 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 619/1248] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:30:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:43.409664 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e504b-d6c8-4502-af25-8244020c8fe6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:43.425252 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e504b-d6c8-4502-af25-8244020c8fe6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:43.432073 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044528c3-c17e-4857-9440-b39280b511c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:43.433651 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044528c3-c17e-4857-9440-b39280b511c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:43.434017 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044528c3-c17e-4857-9440-b39280b511c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:43.434277 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044528c3-c17e-4857-9440-b39280b511c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:43.446710 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044528c3-c17e-4857-9440-b39280b511c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:43.448775 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044528c3-c17e-4857-9440-b39280b511c2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:43.467621 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-044528c3-c17e-4857-9440-b39280b511c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:30:43.469163 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 630/1249] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:43.476043 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b2822-3d25-4f04-a62d-4df71ff603e2 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:43.487213 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b2822-3d25-4f04-a62d-4df71ff603e2 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:43.493443 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0ccd5-4733-4375-9b39-f01474499faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:43.494306 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0ccd5-4733-4375-9b39-f01474499faa admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:43.494651 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0ccd5-4733-4375-9b39-f01474499faa admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:43.494929 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0ccd5-4733-4375-9b39-f01474499faa admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:43.495667 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0ccd5-4733-4375-9b39-f01474499faa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:43.495965 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0ccd5-4733-4375-9b39-f01474499faa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:43.497592 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0ccd5-4733-4375-9b39-f01474499faa admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:43.510909 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 620/1250] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:43.516680 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044528c3-c17e-4857-9440-b39280b511c2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:43.530702 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044528c3-c17e-4857-9440-b39280b511c2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:43.536535 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6f8dd-4f7a-48d8-b6ed-3ee08e755509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:43.537399 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6f8dd-4f7a-48d8-b6ed-3ee08e755509 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:43.538300 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6f8dd-4f7a-48d8-b6ed-3ee08e755509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:43.538582 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b6f8dd-4f7a-48d8-b6ed-3ee08e755509 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:43.548944 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6f8dd-4f7a-48d8-b6ed-3ee08e755509 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:43.550677 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b6f8dd-4f7a-48d8-b6ed-3ee08e755509 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:43.568085 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-35b6f8dd-4f7a-48d8-b6ed-3ee08e755509 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 09 04:30:43.574762 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 631/1251] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:30:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:43.576548 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0ccd5-4733-4375-9b39-f01474499faa admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:43.588860 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0ccd5-4733-4375-9b39-f01474499faa admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:43.593562 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02cf41-2166-4e22-b62b-81204e429a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:43.594228 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02cf41-2166-4e22-b62b-81204e429a5e admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:43.594507 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02cf41-2166-4e22-b62b-81204e429a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:43.594777 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02cf41-2166-4e22-b62b-81204e429a5e admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:43.595629 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02cf41-2166-4e22-b62b-81204e429a5e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:43.595930 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02cf41-2166-4e22-b62b-81204e429a5e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:43.597794 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02cf41-2166-4e22-b62b-81204e429a5e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:43.620964 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 621/1252] 10.222.0.36 () {56 vars in 1164 bytes} [Wed Feb 9 04:30:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:43.627179 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6f8dd-4f7a-48d8-b6ed-3ee08e755509 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:43.638416 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b6f8dd-4f7a-48d8-b6ed-3ee08e755509 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:43.644064 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1ba04-a9af-44e4-9921-ebe61b10b097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:43.644913 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1ba04-a9af-44e4-9921-ebe61b10b097 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:43.645343 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1ba04-a9af-44e4-9921-ebe61b10b097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:43.645591 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1ba04-a9af-44e4-9921-ebe61b10b097 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:43.655938 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1ba04-a9af-44e4-9921-ebe61b10b097 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:43.658199 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1ba04-a9af-44e4-9921-ebe61b10b097 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:43.673449 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 632/1253] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:30:43 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:30:43.680756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02cf41-2166-4e22-b62b-81204e429a5e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:43.697492 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02cf41-2166-4e22-b62b-81204e429a5e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:43.703152 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e855b-9c81-425e-b997-1a877d11b468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:43.703972 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e855b-9c81-425e-b997-1a877d11b468 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:43.704252 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e855b-9c81-425e-b997-1a877d11b468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:43.704526 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e855b-9c81-425e-b997-1a877d11b468 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:43.716172 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e855b-9c81-425e-b997-1a877d11b468 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:43.718105 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e855b-9c81-425e-b997-1a877d11b468 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:43.737251 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-087e855b-9c81-425e-b997-1a877d11b468 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:30:43.738706 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 622/1254] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:43.745283 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1ba04-a9af-44e4-9921-ebe61b10b097 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:43.757125 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1ba04-a9af-44e4-9921-ebe61b10b097 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:43.763699 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c1242-efe6-4fad-b3ca-41f9bd65c784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:43.764400 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c1242-efe6-4fad-b3ca-41f9bd65c784 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:43.764763 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c1242-efe6-4fad-b3ca-41f9bd65c784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:43.765197 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c1242-efe6-4fad-b3ca-41f9bd65c784 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:43.766001 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c1242-efe6-4fad-b3ca-41f9bd65c784 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:43.766404 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c1242-efe6-4fad-b3ca-41f9bd65c784 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:43.768143 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c1242-efe6-4fad-b3ca-41f9bd65c784 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:43.781808 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 633/1255] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:30:43.787499 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e855b-9c81-425e-b997-1a877d11b468 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:43.800623 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e855b-9c81-425e-b997-1a877d11b468 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:43.805964 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fbcd1-089c-4f5a-b4a0-1f7559df77fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:43.807030 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fbcd1-089c-4f5a-b4a0-1f7559df77fa admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:43.807509 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fbcd1-089c-4f5a-b4a0-1f7559df77fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:43.807839 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fbcd1-089c-4f5a-b4a0-1f7559df77fa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:43.815672 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fbcd1-089c-4f5a-b4a0-1f7559df77fa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:43.818634 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fbcd1-089c-4f5a-b4a0-1f7559df77fa admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:43.833967 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-350fbcd1-089c-4f5a-b4a0-1f7559df77fa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:30:43.835873 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 623/1256] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:30:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:30:43.841553 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c1242-efe6-4fad-b3ca-41f9bd65c784 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:43.853734 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c1242-efe6-4fad-b3ca-41f9bd65c784 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:43.860203 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4f5e9-2064-4c39-aa74-25f0e2cff92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:43.861038 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4f5e9-2064-4c39-aa74-25f0e2cff92a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:43.861349 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4f5e9-2064-4c39-aa74-25f0e2cff92a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:43.861690 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4f5e9-2064-4c39-aa74-25f0e2cff92a admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:43.862539 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4f5e9-2064-4c39-aa74-25f0e2cff92a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:43.862875 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4f5e9-2064-4c39-aa74-25f0e2cff92a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:43.864822 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4f5e9-2064-4c39-aa74-25f0e2cff92a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:43.879179 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 634/1257] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:30:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:43.886232 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fbcd1-089c-4f5a-b4a0-1f7559df77fa admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:43.897893 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fbcd1-089c-4f5a-b4a0-1f7559df77fa admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:43.902769 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa840af-497e-4270-809d-210aa12ad2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:43.903422 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa840af-497e-4270-809d-210aa12ad2bf admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:43.903705 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa840af-497e-4270-809d-210aa12ad2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:43.903978 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa840af-497e-4270-809d-210aa12ad2bf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:43.904828 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa840af-497e-4270-809d-210aa12ad2bf admin admin] RBAC: Adding query filter params (role.id=05ca9a16ef2a450b8cc73ade47f5c7d0, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=add56fc0cfd8403b86c5ef23fd374a5a) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:43.905182 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa840af-497e-4270-809d-210aa12ad2bf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:43.907024 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa840af-497e-4270-809d-210aa12ad2bf admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:43.913918 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 624/1258] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:30:43 2022] GET /identity/v3/role_assignments?user.id=add56fc0cfd8403b86c5ef23fd374a5a&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:30:46.468545 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3615b7-2d5f-4858-b660-bd08926f2a1f None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:46.469096 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3615b7-2d5f-4858-b660-bd08926f2a1f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:46.469096 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3615b7-2d5f-4858-b660-bd08926f2a1f None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:46.470860 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 635/1259] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:30:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:30:46.479297 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ea475-cece-40ff-846d-cc3ed6951b56 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:46.479297 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ea475-cece-40ff-846d-cc3ed6951b56 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:46.479297 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ea475-cece-40ff-846d-cc3ed6951b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:46.497156 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-d37ea475-cece-40ff-846d-cc3ed6951b56 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:30:46.498760 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-d37ea475-cece-40ff-846d-cc3ed6951b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:30:46.506876 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 625/1260] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:30:46 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:30:46.531780 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3615b7-2d5f-4858-b660-bd08926f2a1f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:46.548500 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3615b7-2d5f-4858-b660-bd08926f2a1f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:46.558998 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387078aa-0398-4182-9aed-80dcdfbddf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:46.563639 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387078aa-0398-4182-9aed-80dcdfbddf65 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:46.563994 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387078aa-0398-4182-9aed-80dcdfbddf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:46.564334 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387078aa-0398-4182-9aed-80dcdfbddf65 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:46.578093 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387078aa-0398-4182-9aed-80dcdfbddf65 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:30:46.585134 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-387078aa-0398-4182-9aed-80dcdfbddf65 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:30:46.586731 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 636/1261] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:30:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:46.592632 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ea475-cece-40ff-846d-cc3ed6951b56 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:46.603592 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ea475-cece-40ff-846d-cc3ed6951b56 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:46.607813 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e93270-ffdd-4dcd-9893-d1a8ae9d855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:46.608479 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e93270-ffdd-4dcd-9893-d1a8ae9d855a admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:46.608763 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e93270-ffdd-4dcd-9893-d1a8ae9d855a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:46.609090 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e93270-ffdd-4dcd-9893-d1a8ae9d855a admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:46.609838 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e93270-ffdd-4dcd-9893-d1a8ae9d855a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:46.610147 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e93270-ffdd-4dcd-9893-d1a8ae9d855a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:46.611736 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e93270-ffdd-4dcd-9893-d1a8ae9d855a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:46.621296 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 626/1262] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:30:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:46.626841 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387078aa-0398-4182-9aed-80dcdfbddf65 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:46.637932 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387078aa-0398-4182-9aed-80dcdfbddf65 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:46.643135 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c0c66-d15e-4681-afb4-931fbfa860bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:46.643943 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c0c66-d15e-4681-afb4-931fbfa860bc admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:46.644228 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c0c66-d15e-4681-afb4-931fbfa860bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:46.644505 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2c0c66-d15e-4681-afb4-931fbfa860bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:46.655509 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c0c66-d15e-4681-afb4-931fbfa860bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:46.657400 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2c0c66-d15e-4681-afb4-931fbfa860bc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:46.675996 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-0a2c0c66-d15e-4681-afb4-931fbfa860bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:30:46.677770 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 637/1263] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:30:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:46.684654 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e93270-ffdd-4dcd-9893-d1a8ae9d855a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:46.695756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e93270-ffdd-4dcd-9893-d1a8ae9d855a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:46.701089 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf3c1f-a2bf-4998-bec6-501cb766001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:46.702232 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf3c1f-a2bf-4998-bec6-501cb766001c admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:46.702346 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf3c1f-a2bf-4998-bec6-501cb766001c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:46.702599 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf3c1f-a2bf-4998-bec6-501cb766001c admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:46.703344 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf3c1f-a2bf-4998-bec6-501cb766001c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:46.703693 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf3c1f-a2bf-4998-bec6-501cb766001c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:46.705308 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf3c1f-a2bf-4998-bec6-501cb766001c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:46.720558 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 627/1264] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:30:46.726719 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c0c66-d15e-4681-afb4-931fbfa860bc admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:46.738960 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2c0c66-d15e-4681-afb4-931fbfa860bc admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:46.743561 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6b9be-e96d-4079-befd-8aab1ce7a858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:46.744489 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6b9be-e96d-4079-befd-8aab1ce7a858 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:46.744842 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6b9be-e96d-4079-befd-8aab1ce7a858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:46.745200 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6b9be-e96d-4079-befd-8aab1ce7a858 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:46.755566 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6b9be-e96d-4079-befd-8aab1ce7a858 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:46.757828 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6b9be-e96d-4079-befd-8aab1ce7a858 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:46.775564 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-86a6b9be-e96d-4079-befd-8aab1ce7a858 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 09 04:30:46.777104 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 638/1265] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:30:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:30:46.782927 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf3c1f-a2bf-4998-bec6-501cb766001c admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:46.793848 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf3c1f-a2bf-4998-bec6-501cb766001c admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:46.800554 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb3aba-aaf7-42d4-a428-70894ddf2ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:46.801387 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb3aba-aaf7-42d4-a428-70894ddf2ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:46.801677 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb3aba-aaf7-42d4-a428-70894ddf2ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:46.801952 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb3aba-aaf7-42d4-a428-70894ddf2ba3 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:46.802835 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb3aba-aaf7-42d4-a428-70894ddf2ba3 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:46.803209 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb3aba-aaf7-42d4-a428-70894ddf2ba3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:46.805075 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb3aba-aaf7-42d4-a428-70894ddf2ba3 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:46.823989 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 628/1266] 10.222.0.36 () {56 vars in 1164 bytes} [Wed Feb 9 04:30:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:30:46.829698 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6b9be-e96d-4079-befd-8aab1ce7a858 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:46.840208 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6b9be-e96d-4079-befd-8aab1ce7a858 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:46.845741 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d76b5-879a-4c3f-879c-fbfe626c4f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:46.846541 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d76b5-879a-4c3f-879c-fbfe626c4f6b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:46.846868 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d76b5-879a-4c3f-879c-fbfe626c4f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:46.847104 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d76b5-879a-4c3f-879c-fbfe626c4f6b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:46.860337 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d76b5-879a-4c3f-879c-fbfe626c4f6b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:46.865897 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d76b5-879a-4c3f-879c-fbfe626c4f6b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:46.891986 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-041d76b5-879a-4c3f-879c-fbfe626c4f6b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:30:46.893269 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 639/1267] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:30:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:30:46.900245 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb3aba-aaf7-42d4-a428-70894ddf2ba3 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:46.914240 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb3aba-aaf7-42d4-a428-70894ddf2ba3 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:46.919559 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0c016-bc5d-4a7b-8d49-e3305dcb80f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:46.920241 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0c016-bc5d-4a7b-8d49-e3305dcb80f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:46.920530 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0c016-bc5d-4a7b-8d49-e3305dcb80f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:46.920808 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0c016-bc5d-4a7b-8d49-e3305dcb80f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:46.921577 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0c016-bc5d-4a7b-8d49-e3305dcb80f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:46.921910 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0c016-bc5d-4a7b-8d49-e3305dcb80f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:46.923498 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0c016-bc5d-4a7b-8d49-e3305dcb80f6 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:46.935315 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 629/1268] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:46.941022 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d76b5-879a-4c3f-879c-fbfe626c4f6b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:46.952790 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d76b5-879a-4c3f-879c-fbfe626c4f6b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:46.957780 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463c02f-a700-448a-afce-340618d75648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:46.958561 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463c02f-a700-448a-afce-340618d75648 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:46.958842 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463c02f-a700-448a-afce-340618d75648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:46.959120 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463c02f-a700-448a-afce-340618d75648 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:46.969253 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463c02f-a700-448a-afce-340618d75648 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:46.971999 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463c02f-a700-448a-afce-340618d75648 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:46.987738 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-b463c02f-a700-448a-afce-340618d75648 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:30:46.993178 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 640/1269] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:30:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:30:46.996109 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0c016-bc5d-4a7b-8d49-e3305dcb80f6 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:47.012059 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0c016-bc5d-4a7b-8d49-e3305dcb80f6 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:47.017955 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c73ed-4459-46b9-8e31-0b885cccf3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:47.018866 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c73ed-4459-46b9-8e31-0b885cccf3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:47.020201 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c73ed-4459-46b9-8e31-0b885cccf3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:47.020201 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c73ed-4459-46b9-8e31-0b885cccf3a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:47.020375 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c73ed-4459-46b9-8e31-0b885cccf3a4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:47.020687 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c73ed-4459-46b9-8e31-0b885cccf3a4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:47.023875 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c73ed-4459-46b9-8e31-0b885cccf3a4 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:47.039171 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 630/1270] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:30:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:47.046517 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463c02f-a700-448a-afce-340618d75648 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:47.058172 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463c02f-a700-448a-afce-340618d75648 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:47.062837 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be857a8-3945-4cc3-893d-6a01d700dcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:47.063716 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be857a8-3945-4cc3-893d-6a01d700dcda admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:47.064069 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be857a8-3945-4cc3-893d-6a01d700dcda admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:47.064292 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be857a8-3945-4cc3-893d-6a01d700dcda admin admin] PATH_INFO: `/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/add56fc0cfd8403b86c5ef23fd374a5a/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:47.066313 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be857a8-3945-4cc3-893d-6a01d700dcda admin admin] RBAC: Authorizing `identity:create_grant(project_id=e618c4377ec64e2e8a6d332696019fac, user_id=add56fc0cfd8403b86c5ef23fd374a5a, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:47.069040 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be857a8-3945-4cc3-893d-6a01d700dcda admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:47.084968 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 641/1271] 10.222.0.36 () {58 vars in 1460 bytes} [Wed Feb 9 04:30:47 2022] PUT /identity/v3/projects/e618c4377ec64e2e8a6d332696019fac/users/add56fc0cfd8403b86c5ef23fd374a5a/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:30:49.523619 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303b3d5-47be-4ae1-b8b1-4f4177a0e4c9 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:49.524209 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303b3d5-47be-4ae1-b8b1-4f4177a0e4c9 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:49.524209 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d303b3d5-47be-4ae1-b8b1-4f4177a0e4c9 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:49.526323 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 631/1272] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:30:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:30:49.532342 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5ffe1-f6c0-4432-8e4d-67c867a8155b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:49.532770 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5ffe1-f6c0-4432-8e4d-67c867a8155b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:49.532910 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5ffe1-f6c0-4432-8e4d-67c867a8155b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:49.553640 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-78e5ffe1-f6c0-4432-8e4d-67c867a8155b None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:30:49.554910 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-78e5ffe1-f6c0-4432-8e4d-67c867a8155b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:30:49.622426 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 642/1273] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:30:49 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:30:49.649326 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303b3d5-47be-4ae1-b8b1-4f4177a0e4c9 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:49.663916 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d303b3d5-47be-4ae1-b8b1-4f4177a0e4c9 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:49.670284 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899869b-73b7-45b2-a74e-5681abc9e836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:49.671590 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899869b-73b7-45b2-a74e-5681abc9e836 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:49.672067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899869b-73b7-45b2-a74e-5681abc9e836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:49.672913 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899869b-73b7-45b2-a74e-5681abc9e836 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:49.685693 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899869b-73b7-45b2-a74e-5681abc9e836 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 09 04:30:49.692484 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-4899869b-73b7-45b2-a74e-5681abc9e836 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 09 04:30:49.695252 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 632/1274] 10.222.0.36 () {56 vars in 1117 bytes} [Wed Feb 9 04:30:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:49.701195 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5ffe1-f6c0-4432-8e4d-67c867a8155b None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:49.712876 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5ffe1-f6c0-4432-8e4d-67c867a8155b None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:49.718281 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07159fc-f751-4a15-a87c-1e4d8bd49f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:49.719205 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07159fc-f751-4a15-a87c-1e4d8bd49f23 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:49.719530 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07159fc-f751-4a15-a87c-1e4d8bd49f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:49.719936 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07159fc-f751-4a15-a87c-1e4d8bd49f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:49.720687 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07159fc-f751-4a15-a87c-1e4d8bd49f23 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:49.721058 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07159fc-f751-4a15-a87c-1e4d8bd49f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:49.723006 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07159fc-f751-4a15-a87c-1e4d8bd49f23 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:49.734446 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 643/1275] 10.222.0.36 () {56 vars in 1120 bytes} [Wed Feb 9 04:30:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:49.739142 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899869b-73b7-45b2-a74e-5681abc9e836 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:49.749663 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899869b-73b7-45b2-a74e-5681abc9e836 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:49.755147 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880db69-41ef-414b-b20a-ec0b62f67c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:49.756119 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880db69-41ef-414b-b20a-ec0b62f67c9b admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:49.757114 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880db69-41ef-414b-b20a-ec0b62f67c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:49.757512 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880db69-41ef-414b-b20a-ec0b62f67c9b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:49.770347 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880db69-41ef-414b-b20a-ec0b62f67c9b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:49.772592 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b880db69-41ef-414b-b20a-ec0b62f67c9b admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:49.790062 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-b880db69-41ef-414b-b20a-ec0b62f67c9b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:30:49.791284 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 633/1276] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:30:49.798035 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07159fc-f751-4a15-a87c-1e4d8bd49f23 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:49.808985 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07159fc-f751-4a15-a87c-1e4d8bd49f23 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:49.813928 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96038e8a-9de7-49a5-9157-f225e8e8134d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:49.814649 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96038e8a-9de7-49a5-9157-f225e8e8134d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:49.814932 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96038e8a-9de7-49a5-9157-f225e8e8134d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:49.815223 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96038e8a-9de7-49a5-9157-f225e8e8134d admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:49.815936 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96038e8a-9de7-49a5-9157-f225e8e8134d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:49.816242 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96038e8a-9de7-49a5-9157-f225e8e8134d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:49.818075 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96038e8a-9de7-49a5-9157-f225e8e8134d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:49.830573 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 644/1277] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:49.836686 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880db69-41ef-414b-b20a-ec0b62f67c9b admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:49.847258 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880db69-41ef-414b-b20a-ec0b62f67c9b admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:49.851997 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcf766-d76b-4e46-aedf-7ffc9671f781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:49.852785 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcf766-d76b-4e46-aedf-7ffc9671f781 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:49.853105 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcf766-d76b-4e46-aedf-7ffc9671f781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:49.853390 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcf766-d76b-4e46-aedf-7ffc9671f781 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:49.861732 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dcf766-d76b-4e46-aedf-7ffc9671f781 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:49.864097 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dcf766-d76b-4e46-aedf-7ffc9671f781 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:49.878679 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-c1dcf766-d76b-4e46-aedf-7ffc9671f781 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 09 04:30:49.879850 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 634/1278] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:30:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:49.886456 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96038e8a-9de7-49a5-9157-f225e8e8134d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:49.897149 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96038e8a-9de7-49a5-9157-f225e8e8134d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:49.901982 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23573e-b1a2-4ff9-9877-57dee29aaf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:49.902635 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23573e-b1a2-4ff9-9877-57dee29aaf77 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:49.902917 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23573e-b1a2-4ff9-9877-57dee29aaf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:49.903192 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23573e-b1a2-4ff9-9877-57dee29aaf77 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:49.904041 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23573e-b1a2-4ff9-9877-57dee29aaf77 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:49.904348 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23573e-b1a2-4ff9-9877-57dee29aaf77 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:49.906228 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23573e-b1a2-4ff9-9877-57dee29aaf77 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:49.931121 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 645/1279] 10.222.0.36 () {56 vars in 1164 bytes} [Wed Feb 9 04:30:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:49.936909 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcf766-d76b-4e46-aedf-7ffc9671f781 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:49.949558 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcf766-d76b-4e46-aedf-7ffc9671f781 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:49.955052 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79437d62-2bb6-4cf1-947d-c178a6ee708f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:49.955755 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79437d62-2bb6-4cf1-947d-c178a6ee708f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:49.956100 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79437d62-2bb6-4cf1-947d-c178a6ee708f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:49.956441 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79437d62-2bb6-4cf1-947d-c178a6ee708f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:49.964301 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79437d62-2bb6-4cf1-947d-c178a6ee708f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:49.966159 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79437d62-2bb6-4cf1-947d-c178a6ee708f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:49.976222 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 635/1280] 10.222.0.36 () {58 vars in 1324 bytes} [Wed Feb 9 04:30:49 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:30:49.982655 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23573e-b1a2-4ff9-9877-57dee29aaf77 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:49.993084 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23573e-b1a2-4ff9-9877-57dee29aaf77 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:49.998289 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97ccbf-5d9b-448e-ab95-f80e1669e997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:49.999091 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97ccbf-5d9b-448e-ab95-f80e1669e997 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:49.999376 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97ccbf-5d9b-448e-ab95-f80e1669e997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:49.999651 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97ccbf-5d9b-448e-ab95-f80e1669e997 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:50.010706 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97ccbf-5d9b-448e-ab95-f80e1669e997 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:50.012535 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97ccbf-5d9b-448e-ab95-f80e1669e997 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:50.030239 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-5a97ccbf-5d9b-448e-ab95-f80e1669e997 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 09 04:30:50.031738 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 646/1281] 10.222.0.36 () {56 vars in 1129 bytes} [Wed Feb 9 04:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:50.037948 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79437d62-2bb6-4cf1-947d-c178a6ee708f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:50.048817 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79437d62-2bb6-4cf1-947d-c178a6ee708f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:50.055234 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808f706-7574-4445-8d8c-ee5e5cc5e6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:50.055887 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808f706-7574-4445-8d8c-ee5e5cc5e6bb admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:50.056168 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808f706-7574-4445-8d8c-ee5e5cc5e6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:50.056489 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808f706-7574-4445-8d8c-ee5e5cc5e6bb admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:50.057340 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808f706-7574-4445-8d8c-ee5e5cc5e6bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:50.057641 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808f706-7574-4445-8d8c-ee5e5cc5e6bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:50.059505 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808f706-7574-4445-8d8c-ee5e5cc5e6bb admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:50.074610 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 636/1282] 10.222.0.36 () {56 vars in 1130 bytes} [Wed Feb 9 04:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:50.080567 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97ccbf-5d9b-448e-ab95-f80e1669e997 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:50.090322 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97ccbf-5d9b-448e-ab95-f80e1669e997 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:50.095276 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4556549-acc1-4046-a486-a593da029e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:50.096115 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4556549-acc1-4046-a486-a593da029e54 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:50.096404 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4556549-acc1-4046-a486-a593da029e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:50.096679 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4556549-acc1-4046-a486-a593da029e54 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:50.105470 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4556549-acc1-4046-a486-a593da029e54 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:50.108006 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4556549-acc1-4046-a486-a593da029e54 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:50.124389 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING keystone.server.flask.application [None req-f4556549-acc1-4046-a486-a593da029e54 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 09 04:30:50.125963 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 647/1283] 10.222.0.36 () {56 vars in 1132 bytes} [Wed Feb 9 04:30:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:50.135522 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808f706-7574-4445-8d8c-ee5e5cc5e6bb admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:50.145813 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808f706-7574-4445-8d8c-ee5e5cc5e6bb admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:50.150546 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6044f-1fa7-420a-a8fe-8ff6f09652ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:50.151216 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6044f-1fa7-420a-a8fe-8ff6f09652ea admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:50.151496 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6044f-1fa7-420a-a8fe-8ff6f09652ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:50.151765 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6044f-1fa7-420a-a8fe-8ff6f09652ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:50.152569 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6044f-1fa7-420a-a8fe-8ff6f09652ea admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:50.152873 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6044f-1fa7-420a-a8fe-8ff6f09652ea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:50.154784 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6044f-1fa7-420a-a8fe-8ff6f09652ea admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:50.173551 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 637/1284] 10.222.0.36 () {56 vars in 1169 bytes} [Wed Feb 9 04:30:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:50.175488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4556549-acc1-4046-a486-a593da029e54 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:50.187145 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4556549-acc1-4046-a486-a593da029e54 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:50.191872 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5133f46-9e7f-4a30-8777-2653240348b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:50.192545 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5133f46-9e7f-4a30-8777-2653240348b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:50.192829 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5133f46-9e7f-4a30-8777-2653240348b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:50.193145 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5133f46-9e7f-4a30-8777-2653240348b3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:50.194008 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5133f46-9e7f-4a30-8777-2653240348b3 admin admin] RBAC: Adding query filter params (role.id=05ca9a16ef2a450b8cc73ade47f5c7d0, scope.project.id=e618c4377ec64e2e8a6d332696019fac, user.id=add56fc0cfd8403b86c5ef23fd374a5a) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:50.194317 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5133f46-9e7f-4a30-8777-2653240348b3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:50.196197 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5133f46-9e7f-4a30-8777-2653240348b3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:50.209053 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 648/1285] 10.222.0.36 () {56 vars in 1395 bytes} [Wed Feb 9 04:30:50 2022] GET /identity/v3/role_assignments?user.id=add56fc0cfd8403b86c5ef23fd374a5a&scope.project.id=e618c4377ec64e2e8a6d332696019fac&role.id=05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:52.445669 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6ba4f-af40-4989-8d57-b4e4fca9e25f None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:52.446197 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6ba4f-af40-4989-8d57-b4e4fca9e25f None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:52.446197 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6ba4f-af40-4989-8d57-b4e4fca9e25f None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:52.447967 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 638/1286] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:30:52.453207 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fd422-9b32-4600-bf5c-0e0ec631a450 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:52.453627 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fd422-9b32-4600-bf5c-0e0ec631a450 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:52.453756 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fd422-9b32-4600-bf5c-0e0ec631a450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:52.470860 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a75fd422-9b32-4600-bf5c-0e0ec631a450 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:30:52.472041 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a75fd422-9b32-4600-bf5c-0e0ec631a450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:30:52.480068 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 649/1287] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:30:52 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:30:52.502370 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6ba4f-af40-4989-8d57-b4e4fca9e25f None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:52.514104 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6ba4f-af40-4989-8d57-b4e4fca9e25f None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:52.518368 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251837f-03db-4bdb-8f2a-a7fef1c92dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:52.519122 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251837f-03db-4bdb-8f2a-a7fef1c92dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:52.519399 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251837f-03db-4bdb-8f2a-a7fef1c92dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:52.519667 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251837f-03db-4bdb-8f2a-a7fef1c92dd0 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:52.520315 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251837f-03db-4bdb-8f2a-a7fef1c92dd0 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:52.521938 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251837f-03db-4bdb-8f2a-a7fef1c92dd0 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:52.532670 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-6251837f-03db-4bdb-8f2a-a7fef1c92dd0 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 09 04:30:52.534047 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 639/1288] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Feb 9 04:30:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:52.540116 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fd422-9b32-4600-bf5c-0e0ec631a450 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:52.548936 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fd422-9b32-4600-bf5c-0e0ec631a450 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:52.554000 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b8c7b7-5c50-4e36-b2d6-2e00f49c2757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:52.554650 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8c7b7-5c50-4e36-b2d6-2e00f49c2757 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:52.554931 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8c7b7-5c50-4e36-b2d6-2e00f49c2757 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:52.555202 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b8c7b7-5c50-4e36-b2d6-2e00f49c2757 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:52.555918 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8c7b7-5c50-4e36-b2d6-2e00f49c2757 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:52.556221 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8c7b7-5c50-4e36-b2d6-2e00f49c2757 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:52.557855 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b8c7b7-5c50-4e36-b2d6-2e00f49c2757 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:52.562547 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 650/1289] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Feb 9 04:30:52 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:52.567812 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251837f-03db-4bdb-8f2a-a7fef1c92dd0 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:52.577126 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251837f-03db-4bdb-8f2a-a7fef1c92dd0 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:52.581540 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4801e-bd3a-4fe3-a2f4-3ffcdf3e92f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:52.582164 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4801e-bd3a-4fe3-a2f4-3ffcdf3e92f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:52.582444 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4801e-bd3a-4fe3-a2f4-3ffcdf3e92f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:52.582716 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4801e-bd3a-4fe3-a2f4-3ffcdf3e92f6 admin admin] PATH_INFO: `/v3/services` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:52.583419 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4801e-bd3a-4fe3-a2f4-3ffcdf3e92f6 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:52.583720 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4801e-bd3a-4fe3-a2f4-3ffcdf3e92f6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:52.585296 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4801e-bd3a-4fe3-a2f4-3ffcdf3e92f6 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:52.591959 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 640/1290] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Feb 9 04:30:52 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:54.758311 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b187f0c-6d3d-44f0-b061-a8a928ec1907 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:54.758844 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b187f0c-6d3d-44f0-b061-a8a928ec1907 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:54.758844 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b187f0c-6d3d-44f0-b061-a8a928ec1907 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:54.760633 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 651/1291] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:30:54.765860 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe430591-9782-4188-ad0e-666ca46d382b None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:54.766232 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe430591-9782-4188-ad0e-666ca46d382b None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:54.766406 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe430591-9782-4188-ad0e-666ca46d382b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:54.783903 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-fe430591-9782-4188-ad0e-666ca46d382b None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:30:54.785093 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-fe430591-9782-4188-ad0e-666ca46d382b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:30:54.793085 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 641/1292] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:30:54 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:30:54.816230 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b187f0c-6d3d-44f0-b061-a8a928ec1907 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:54.827939 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b187f0c-6d3d-44f0-b061-a8a928ec1907 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:54.832180 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da5eb2-253f-490e-9574-ce2695eb0299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:54.832808 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da5eb2-253f-490e-9574-ce2695eb0299 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:54.833122 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da5eb2-253f-490e-9574-ce2695eb0299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:54.833398 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da5eb2-253f-490e-9574-ce2695eb0299 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:54.834149 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da5eb2-253f-490e-9574-ce2695eb0299 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:54.835734 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da5eb2-253f-490e-9574-ce2695eb0299 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:54.848193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 652/1293] 10.222.0.36 () {60 vars in 1162 bytes} [Wed Feb 9 04:30:54 2022] POST /identity/v3/services => generated 246 bytes in 32 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:30:57.095018 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61797e2-ebc0-4a15-b7c0-1a47e4d3e04c None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:57.095566 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61797e2-ebc0-4a15-b7c0-1a47e4d3e04c None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:57.095566 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61797e2-ebc0-4a15-b7c0-1a47e4d3e04c None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:57.097354 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 642/1294] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:30:57.102612 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd85b0-f0e6-433d-bfb9-01d68fcc3766 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:57.102989 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd85b0-f0e6-433d-bfb9-01d68fcc3766 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:57.103163 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd85b0-f0e6-433d-bfb9-01d68fcc3766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:57.120659 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-bcfd85b0-f0e6-433d-bfb9-01d68fcc3766 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:30:57.121853 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-bcfd85b0-f0e6-433d-bfb9-01d68fcc3766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:30:57.138432 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 653/1295] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:30:57 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:30:57.161961 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61797e2-ebc0-4a15-b7c0-1a47e4d3e04c None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:57.173555 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61797e2-ebc0-4a15-b7c0-1a47e4d3e04c None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:57.177836 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84970b-577e-4e85-8898-7d89bbcb7bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:57.178595 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84970b-577e-4e85-8898-7d89bbcb7bec admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:57.178870 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84970b-577e-4e85-8898-7d89bbcb7bec admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:57.179137 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84970b-577e-4e85-8898-7d89bbcb7bec admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:57.179789 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84970b-577e-4e85-8898-7d89bbcb7bec admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:57.181397 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84970b-577e-4e85-8898-7d89bbcb7bec admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:57.193782 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-8f84970b-577e-4e85-8898-7d89bbcb7bec admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 09 04:30:57.194913 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 643/1296] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Feb 9 04:30:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 09 04:30:57.200674 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd85b0-f0e6-433d-bfb9-01d68fcc3766 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:57.212626 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd85b0-f0e6-433d-bfb9-01d68fcc3766 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:57.220814 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f3019-6c11-4c0a-a19d-b46b55edd30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:57.221962 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f3019-6c11-4c0a-a19d-b46b55edd30f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:57.222401 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f3019-6c11-4c0a-a19d-b46b55edd30f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:57.223121 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f3019-6c11-4c0a-a19d-b46b55edd30f admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:57.224410 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f3019-6c11-4c0a-a19d-b46b55edd30f admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:57.224937 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f3019-6c11-4c0a-a19d-b46b55edd30f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:57.227869 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f3019-6c11-4c0a-a19d-b46b55edd30f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:57.235494 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 654/1297] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Feb 9 04:30:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:57.242089 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84970b-577e-4e85-8898-7d89bbcb7bec admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:57.258204 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84970b-577e-4e85-8898-7d89bbcb7bec admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:57.264644 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b678d-81e8-4529-a763-1c4a3894f90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:57.265714 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b678d-81e8-4529-a763-1c4a3894f90a admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:57.266085 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b678d-81e8-4529-a763-1c4a3894f90a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:57.266465 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b678d-81e8-4529-a763-1c4a3894f90a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:57.267690 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b678d-81e8-4529-a763-1c4a3894f90a admin admin] RBAC: Adding query filter params (interface=public, service_id=b316d817b2f34bd08b54a2756a7ed0fb, region_id=RegionOne) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:57.268181 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b678d-81e8-4529-a763-1c4a3894f90a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:57.270669 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b678d-81e8-4529-a763-1c4a3894f90a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:57.276071 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 644/1298] 10.222.0.36 () {56 vars in 1272 bytes} [Wed Feb 9 04:30:57 2022] GET /identity/v3/endpoints?service_id=b316d817b2f34bd08b54a2756a7ed0fb&interface=public®ion_id=RegionOne => generated 194 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:30:57.282366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f3019-6c11-4c0a-a19d-b46b55edd30f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:57.293116 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f3019-6c11-4c0a-a19d-b46b55edd30f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:57.297612 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6b597-fdc3-4fa9-9de3-ec98164df064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:57.298256 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6b597-fdc3-4fa9-9de3-ec98164df064 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:57.298541 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6b597-fdc3-4fa9-9de3-ec98164df064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:57.298818 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6b597-fdc3-4fa9-9de3-ec98164df064 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:57.299515 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6b597-fdc3-4fa9-9de3-ec98164df064 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:57.301138 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6b597-fdc3-4fa9-9de3-ec98164df064 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:57.308210 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 655/1299] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Feb 9 04:30:57 2022] GET /identity/v3/services => generated 2191 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:30:59.478583 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24428cf2-9916-49c6-97e4-5c6af16c4abd None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:59.479244 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24428cf2-9916-49c6-97e4-5c6af16c4abd None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:59.479347 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24428cf2-9916-49c6-97e4-5c6af16c4abd None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:59.481087 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 645/1300] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:30:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:30:59.486434 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddea82-36b3-40b8-9b12-84817ca9095b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:59.486828 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddea82-36b3-40b8-9b12-84817ca9095b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:59.486993 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ddea82-36b3-40b8-9b12-84817ca9095b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:59.504730 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-84ddea82-36b3-40b8-9b12-84817ca9095b None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:30:59.505944 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-84ddea82-36b3-40b8-9b12-84817ca9095b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:30:59.514176 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 656/1301] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:30:59 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:30:59.537178 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24428cf2-9916-49c6-97e4-5c6af16c4abd None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:59.549247 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24428cf2-9916-49c6-97e4-5c6af16c4abd None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:59.554089 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327acdfc-6a4b-4ecc-855f-18f521bfbdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:59.554859 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327acdfc-6a4b-4ecc-855f-18f521bfbdc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:59.555140 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327acdfc-6a4b-4ecc-855f-18f521bfbdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:59.555412 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327acdfc-6a4b-4ecc-855f-18f521bfbdc6 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:59.556070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327acdfc-6a4b-4ecc-855f-18f521bfbdc6 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:59.557679 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327acdfc-6a4b-4ecc-855f-18f521bfbdc6 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:59.568465 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING keystone.server.flask.application [None req-327acdfc-6a4b-4ecc-855f-18f521bfbdc6 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 09 04:30:59.570252 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 646/1302] 10.222.0.36 () {56 vars in 1138 bytes} [Wed Feb 9 04:30:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 09 04:30:59.576182 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddea82-36b3-40b8-9b12-84817ca9095b None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:59.584964 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ddea82-36b3-40b8-9b12-84817ca9095b None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:59.589471 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718b5f2-95b8-4462-b2b4-891dd36c92e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:59.590293 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718b5f2-95b8-4462-b2b4-891dd36c92e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:59.590579 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718b5f2-95b8-4462-b2b4-891dd36c92e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:59.590857 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718b5f2-95b8-4462-b2b4-891dd36c92e3 admin admin] PATH_INFO: `/v3/services` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:59.591578 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718b5f2-95b8-4462-b2b4-891dd36c92e3 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:30:59.591886 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718b5f2-95b8-4462-b2b4-891dd36c92e3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:59.593520 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718b5f2-95b8-4462-b2b4-891dd36c92e3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:59.598540 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 657/1303] 10.222.0.36 () {56 vars in 1137 bytes} [Wed Feb 9 04:30:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:30:59.603648 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327acdfc-6a4b-4ecc-855f-18f521bfbdc6 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:30:59.613400 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327acdfc-6a4b-4ecc-855f-18f521bfbdc6 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:30:59.618272 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1ce38-f1a2-4905-a5fc-7c7fc08fbffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:30:59.618881 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1ce38-f1a2-4905-a5fc-7c7fc08fbffc admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:30:59.619157 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1ce38-f1a2-4905-a5fc-7c7fc08fbffc admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:30:59.619426 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1ce38-f1a2-4905-a5fc-7c7fc08fbffc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:30:59.620167 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1ce38-f1a2-4905-a5fc-7c7fc08fbffc admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:30:59.621741 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1ce38-f1a2-4905-a5fc-7c7fc08fbffc admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:30:59.639479 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 647/1304] 10.222.0.36 () {60 vars in 1165 bytes} [Wed Feb 9 04:30:59 2022] POST /identity/v3/endpoints => generated 331 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:32:02.254488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6459c1-711d-48b1-9985-206c52cf97ad None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:02.255436 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6459c1-711d-48b1-9985-206c52cf97ad None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:02.255865 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6459c1-711d-48b1-9985-206c52cf97ad None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:02.257836 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 658/1305] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:32:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:32:02.263279 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca133a-d9ac-4bb0-b747-ca23cf47cdce None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:02.264054 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca133a-d9ac-4bb0-b747-ca23cf47cdce None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:02.264497 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca133a-d9ac-4bb0-b747-ca23cf47cdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:02.346839 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-98ca133a-d9ac-4bb0-b747-ca23cf47cdce None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:32:02.348808 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-98ca133a-d9ac-4bb0-b747-ca23cf47cdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:02.477342 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 648/1306] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:32:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:32:02.486766 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6459c1-711d-48b1-9985-206c52cf97ad None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:32:02.489100 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ea6459c1-711d-48b1-9985-206c52cf97ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:02.710151 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6459c1-711d-48b1-9985-206c52cf97ad None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:32:02.806572 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1c500-de06-468e-833c-e71190a29f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:32:02.807247 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1c500-de06-468e-833c-e71190a29f9e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:02.807532 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1c500-de06-468e-833c-e71190a29f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:02.807821 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1c500-de06-468e-833c-e71190a29f9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:02.808556 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1c500-de06-468e-833c-e71190a29f9e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:32:02.810461 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1c500-de06-468e-833c-e71190a29f9e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:32:02.832598 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 659/1307] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Feb 9 04:32:02 2022] GET /identity/v3/projects => generated 2553 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:32:05.111205 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb89aa-1953-4f26-8f49-dfc24e1f691d None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:05.111719 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb89aa-1953-4f26-8f49-dfc24e1f691d None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:05.111796 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb89aa-1953-4f26-8f49-dfc24e1f691d None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:05.114129 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 649/1308] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:32:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:32:05.119313 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1816b-fd92-4ab7-afca-1ecc69960771 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:05.119709 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1816b-fd92-4ab7-afca-1ecc69960771 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:05.119885 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1816b-fd92-4ab7-afca-1ecc69960771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:05.188037 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-9ed1816b-fd92-4ab7-afca-1ecc69960771 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:32:05.189273 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9ed1816b-fd92-4ab7-afca-1ecc69960771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:05.281169 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 660/1309] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:32:05.330926 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825c78f-84a8-4033-b63a-cad6fab30946 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:05.331282 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825c78f-84a8-4033-b63a-cad6fab30946 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:05.332076 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825c78f-84a8-4033-b63a-cad6fab30946 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:05.333865 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 650/1310] 10.222.0.36 () {54 vars in 964 bytes} [Wed Feb 9 04:32:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:32:05.340193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144b3e4-af1a-4029-a7ee-af2c3f229918 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:05.340569 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144b3e4-af1a-4029-a7ee-af2c3f229918 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:05.340856 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144b3e4-af1a-4029-a7ee-af2c3f229918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:05.420247 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-5144b3e4-af1a-4029-a7ee-af2c3f229918 None None] MFA Rules not processed for user `80015d086ec24caf9414d2ef5f660f08`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:32:05.421589 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5144b3e4-af1a-4029-a7ee-af2c3f229918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:05.502853 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 661/1311] 10.222.0.36 () {58 vars in 1061 bytes} [Wed Feb 9 04:32:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:32:05.515067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825c78f-84a8-4033-b63a-cad6fab30946 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:32:05.516620 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-3825c78f-84a8-4033-b63a-cad6fab30946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:05.618375 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825c78f-84a8-4033-b63a-cad6fab30946 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:32:05.688206 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a4dc3-fe0d-4075-9a28-8d86d3816270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:32:05.688840 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a4dc3-fe0d-4075-9a28-8d86d3816270 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:05.689155 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a4dc3-fe0d-4075-9a28-8d86d3816270 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:05.689425 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a4dc3-fe0d-4075-9a28-8d86d3816270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:05.691677 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-ce9a4dc3-fe0d-4075-9a28-8d86d3816270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:05.793151 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a4dc3-fe0d-4075-9a28-8d86d3816270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:32:05.794484 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a4dc3-fe0d-4075-9a28-8d86d3816270 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:32:05.812174 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 651/1312] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:32:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:32:08.289117 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c422d-244f-42b1-8274-22d3bd4f258b None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:08.289653 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c422d-244f-42b1-8274-22d3bd4f258b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:08.289768 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c422d-244f-42b1-8274-22d3bd4f258b None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:08.291477 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 662/1313] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:32:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:32:08.296689 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b81c41-39f7-4990-b306-7e231da2e8a7 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:08.297139 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b81c41-39f7-4990-b306-7e231da2e8a7 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:08.297280 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b81c41-39f7-4990-b306-7e231da2e8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:08.362811 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-b1b81c41-39f7-4990-b306-7e231da2e8a7 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:32:08.364002 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-b1b81c41-39f7-4990-b306-7e231da2e8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:08.455977 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 652/1314] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:32:08.494037 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c422d-244f-42b1-8274-22d3bd4f258b None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:32:08.495639 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-610c422d-244f-42b1-8274-22d3bd4f258b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:08.602398 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c422d-244f-42b1-8274-22d3bd4f258b None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:32:08.679614 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29025a9d-89ac-4762-86dd-628dd48ca097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:32:08.680278 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29025a9d-89ac-4762-86dd-628dd48ca097 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:08.680558 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29025a9d-89ac-4762-86dd-628dd48ca097 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:08.680833 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29025a9d-89ac-4762-86dd-628dd48ca097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:08.682606 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-29025a9d-89ac-4762-86dd-628dd48ca097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:08.790868 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29025a9d-89ac-4762-86dd-628dd48ca097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:32:08.792317 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29025a9d-89ac-4762-86dd-628dd48ca097 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:32:08.810619 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 663/1315] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:32:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:32:11.339669 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b5790-2488-4e46-b670-28a8ab598a06 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:11.340197 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b5790-2488-4e46-b670-28a8ab598a06 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:11.340197 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b5790-2488-4e46-b670-28a8ab598a06 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:11.342040 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 653/1316] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:32:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:32:11.347453 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01eba2-aab9-4aff-89bd-55b83fd070eb None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:11.347860 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01eba2-aab9-4aff-89bd-55b83fd070eb None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:11.348010 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01eba2-aab9-4aff-89bd-55b83fd070eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:11.409925 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-3b01eba2-aab9-4aff-89bd-55b83fd070eb None None] MFA Rules not processed for user `635fa93bb3a84f3faefdeefe04d60128`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:32:11.411100 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3b01eba2-aab9-4aff-89bd-55b83fd070eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:11.501246 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 664/1317] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:32:11 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:32:11.541269 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b5790-2488-4e46-b670-28a8ab598a06 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:32:11.542753 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-e25b5790-2488-4e46-b670-28a8ab598a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:11.641895 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b5790-2488-4e46-b670-28a8ab598a06 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:32:11.710654 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ddf18-a9db-497e-94a1-9840c7ad44b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:32:11.711276 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ddf18-a9db-497e-94a1-9840c7ad44b6 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:11.711554 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ddf18-a9db-497e-94a1-9840c7ad44b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:11.711826 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ddf18-a9db-497e-94a1-9840c7ad44b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:11.713444 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-3d1ddf18-a9db-497e-94a1-9840c7ad44b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:11.816555 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ddf18-a9db-497e-94a1-9840c7ad44b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:32:11.818019 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ddf18-a9db-497e-94a1-9840c7ad44b6 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:32:11.835537 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 654/1318] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:32:11 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:32:14.584761 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962b333-ba16-4504-98d1-031fb9b96b7f None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:14.585289 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962b333-ba16-4504-98d1-031fb9b96b7f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:14.585453 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962b333-ba16-4504-98d1-031fb9b96b7f None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:14.587251 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 665/1319] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:32:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:32:14.592590 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9c3f1-78ef-4eb7-97c6-54b9dc4bb94e None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:14.592985 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9c3f1-78ef-4eb7-97c6-54b9dc4bb94e None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:14.593172 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9c3f1-78ef-4eb7-97c6-54b9dc4bb94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:14.655618 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-beb9c3f1-78ef-4eb7-97c6-54b9dc4bb94e None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:32:14.656826 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-beb9c3f1-78ef-4eb7-97c6-54b9dc4bb94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:14.746497 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 655/1320] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:32:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:32:14.785653 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962b333-ba16-4504-98d1-031fb9b96b7f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:32:14.787162 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9962b333-ba16-4504-98d1-031fb9b96b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:14.885076 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962b333-ba16-4504-98d1-031fb9b96b7f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:32:14.953868 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084ccc7-ac08-4e43-a170-13af8861b170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:32:14.954503 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084ccc7-ac08-4e43-a170-13af8861b170 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:14.954781 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084ccc7-ac08-4e43-a170-13af8861b170 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:14.955054 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084ccc7-ac08-4e43-a170-13af8861b170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:14.956710 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5084ccc7-ac08-4e43-a170-13af8861b170 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:15.058856 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084ccc7-ac08-4e43-a170-13af8861b170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:32:15.060279 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084ccc7-ac08-4e43-a170-13af8861b170 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:32:15.076952 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 666/1321] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:32:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:32:17.965582 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3b605-0fe8-450f-8117-83d9379d32e9 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:17.966075 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3b605-0fe8-450f-8117-83d9379d32e9 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:17.966168 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3b605-0fe8-450f-8117-83d9379d32e9 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:17.968240 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 656/1322] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:32:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:32:17.973483 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8bafd-b69e-446b-aa54-1f07b07da57f None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:17.973905 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8bafd-b69e-446b-aa54-1f07b07da57f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:17.974046 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8bafd-b69e-446b-aa54-1f07b07da57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:18.036480 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-e5a8bafd-b69e-446b-aa54-1f07b07da57f None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:32:18.037953 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e5a8bafd-b69e-446b-aa54-1f07b07da57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:18.131258 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 667/1323] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:32:18.184736 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e3271-6447-4cc2-a859-ed93af12a92a None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:18.184935 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e3271-6447-4cc2-a859-ed93af12a92a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:18.185235 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2e3271-6447-4cc2-a859-ed93af12a92a None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:18.187029 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 657/1324] 10.222.0.36 () {54 vars in 964 bytes} [Wed Feb 9 04:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:32:18.193753 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28d822-2e59-4cde-82ed-80d44d4dd157 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:18.194046 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28d822-2e59-4cde-82ed-80d44d4dd157 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:18.194348 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28d822-2e59-4cde-82ed-80d44d4dd157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:18.267365 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2a28d822-2e59-4cde-82ed-80d44d4dd157 None None] MFA Rules not processed for user `80015d086ec24caf9414d2ef5f660f08`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:32:18.268589 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2a28d822-2e59-4cde-82ed-80d44d4dd157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:18.340407 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 668/1325] 10.222.0.36 () {58 vars in 1061 bytes} [Wed Feb 9 04:32:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:32:18.349583 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e3271-6447-4cc2-a859-ed93af12a92a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:32:18.351098 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-0e2e3271-6447-4cc2-a859-ed93af12a92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:18.454222 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2e3271-6447-4cc2-a859-ed93af12a92a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:32:18.526396 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4d589-de25-4654-b5fe-7121f05e97c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:32:18.527030 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4d589-de25-4654-b5fe-7121f05e97c8 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:18.527307 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4d589-de25-4654-b5fe-7121f05e97c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:18.527578 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4d589-de25-4654-b5fe-7121f05e97c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:18.529208 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-dde4d589-de25-4654-b5fe-7121f05e97c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:18.637196 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4d589-de25-4654-b5fe-7121f05e97c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:32:18.638668 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4d589-de25-4654-b5fe-7121f05e97c8 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:32:18.656922 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 658/1326] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:32:21.173646 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d3a5e-22ca-4721-81c6-9897a6611f48 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:21.174204 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d3a5e-22ca-4721-81c6-9897a6611f48 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:21.174204 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d3a5e-22ca-4721-81c6-9897a6611f48 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:21.176015 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 669/1327] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:32:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:32:21.181755 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b0b2c-1974-4bfb-9157-e26f8fa62cdc None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:21.182169 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b0b2c-1974-4bfb-9157-e26f8fa62cdc None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:21.182332 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b0b2c-1974-4bfb-9157-e26f8fa62cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:21.245761 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-e19b0b2c-1974-4bfb-9157-e26f8fa62cdc None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:32:21.246958 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-e19b0b2c-1974-4bfb-9157-e26f8fa62cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:21.339054 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 659/1328] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:32:21.374987 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d3a5e-22ca-4721-81c6-9897a6611f48 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:32:21.376579 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-589d3a5e-22ca-4721-81c6-9897a6611f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:21.479002 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d3a5e-22ca-4721-81c6-9897a6611f48 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:32:21.550689 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3f08a-ad3b-4e2e-932c-12aba661787b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:32:21.551348 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3f08a-ad3b-4e2e-932c-12aba661787b service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:21.551634 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3f08a-ad3b-4e2e-932c-12aba661787b service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:21.551911 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3f08a-ad3b-4e2e-932c-12aba661787b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:21.553580 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1ba3f08a-ad3b-4e2e-932c-12aba661787b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:21.659749 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3f08a-ad3b-4e2e-932c-12aba661787b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:32:21.661220 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3f08a-ad3b-4e2e-932c-12aba661787b service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:32:21.679118 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 670/1329] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:32:23.982577 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9ac89-d23d-46ef-bc65-1c9346306dc9 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:23.983073 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9ac89-d23d-46ef-bc65-1c9346306dc9 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:23.983164 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9ac89-d23d-46ef-bc65-1c9346306dc9 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:23.984913 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 660/1330] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:32:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:32:23.990721 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f0b33-1b02-4974-8ab0-19486c6cce92 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:23.991127 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f0b33-1b02-4974-8ab0-19486c6cce92 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:23.991284 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f0b33-1b02-4974-8ab0-19486c6cce92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:24.053407 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-281f0b33-1b02-4974-8ab0-19486c6cce92 None None] MFA Rules not processed for user `635fa93bb3a84f3faefdeefe04d60128`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:32:24.054585 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-281f0b33-1b02-4974-8ab0-19486c6cce92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:24.146506 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 671/1331] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:32:23 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:32:24.183783 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9ac89-d23d-46ef-bc65-1c9346306dc9 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:32:24.185375 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-1fe9ac89-d23d-46ef-bc65-1c9346306dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:24.282677 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9ac89-d23d-46ef-bc65-1c9346306dc9 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:32:24.352421 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653dd5fa-2efe-4f1d-a24b-9abba23bfc15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:32:24.353117 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dd5fa-2efe-4f1d-a24b-9abba23bfc15 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:24.353395 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dd5fa-2efe-4f1d-a24b-9abba23bfc15 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:24.353667 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dd5fa-2efe-4f1d-a24b-9abba23bfc15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:24.355305 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-653dd5fa-2efe-4f1d-a24b-9abba23bfc15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:24.461720 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653dd5fa-2efe-4f1d-a24b-9abba23bfc15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:32:24.463073 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653dd5fa-2efe-4f1d-a24b-9abba23bfc15 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:32:24.482634 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 661/1332] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:32:24 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:32:27.100869 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca36ff-f56d-41f9-953a-571a4de5e9eb None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:27.101426 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca36ff-f56d-41f9-953a-571a4de5e9eb None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:27.101426 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca36ff-f56d-41f9-953a-571a4de5e9eb None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:27.103218 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 672/1333] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:32:27.108717 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0dd3b-beb6-43af-95bb-628fa50ef69d None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:27.109141 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0dd3b-beb6-43af-95bb-628fa50ef69d None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:27.109396 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0dd3b-beb6-43af-95bb-628fa50ef69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:27.176740 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-0fa0dd3b-beb6-43af-95bb-628fa50ef69d None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:32:27.178048 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-0fa0dd3b-beb6-43af-95bb-628fa50ef69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:27.270929 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 662/1334] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:32:27.306958 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca36ff-f56d-41f9-953a-571a4de5e9eb None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:32:27.308543 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b3ca36ff-f56d-41f9-953a-571a4de5e9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:27.406818 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca36ff-f56d-41f9-953a-571a4de5e9eb None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:32:27.478038 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b05dd-0e69-455f-a85c-5b5af4f696b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:32:27.478687 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b05dd-0e69-455f-a85c-5b5af4f696b4 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:27.478968 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b05dd-0e69-455f-a85c-5b5af4f696b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:27.479245 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b05dd-0e69-455f-a85c-5b5af4f696b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:27.480871 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-062b05dd-0e69-455f-a85c-5b5af4f696b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:27.586236 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b05dd-0e69-455f-a85c-5b5af4f696b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:32:27.587676 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b05dd-0e69-455f-a85c-5b5af4f696b4 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:32:27.605447 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 673/1335] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:32:29.874658 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21bfad-0bf5-4ea1-9750-97a52a602fed None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:29.875250 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21bfad-0bf5-4ea1-9750-97a52a602fed None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:29.875250 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21bfad-0bf5-4ea1-9750-97a52a602fed None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:29.877442 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 663/1336] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:32:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:32:29.883098 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84058af5-ed61-40d2-a359-b6bc8f96ba2e None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:29.883498 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84058af5-ed61-40d2-a359-b6bc8f96ba2e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:29.883658 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84058af5-ed61-40d2-a359-b6bc8f96ba2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:29.949439 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-84058af5-ed61-40d2-a359-b6bc8f96ba2e None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:32:29.950932 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-84058af5-ed61-40d2-a359-b6bc8f96ba2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:30.062005 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 674/1337] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:32:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:32:30.104334 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21bfad-0bf5-4ea1-9750-97a52a602fed None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:32:30.106502 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-5a21bfad-0bf5-4ea1-9750-97a52a602fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:30.210906 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21bfad-0bf5-4ea1-9750-97a52a602fed None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:32:30.282018 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359c962-705b-49e2-beba-685af90ca330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:32:30.282655 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359c962-705b-49e2-beba-685af90ca330 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:30.282937 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359c962-705b-49e2-beba-685af90ca330 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:30.283278 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359c962-705b-49e2-beba-685af90ca330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:30.284930 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7359c962-705b-49e2-beba-685af90ca330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:30.389971 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359c962-705b-49e2-beba-685af90ca330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:32:30.391396 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359c962-705b-49e2-beba-685af90ca330 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:32:30.409344 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 664/1338] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:32:33.093568 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4a4a4-6d22-44d3-921e-b2af56b88ab7 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:33.094162 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4a4a4-6d22-44d3-921e-b2af56b88ab7 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:33.094162 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4a4a4-6d22-44d3-921e-b2af56b88ab7 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:33.095912 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 675/1339] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:32:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:32:33.100969 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a00f5c-7d53-4b38-82f7-4437d046adcc None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:33.101454 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a00f5c-7d53-4b38-82f7-4437d046adcc None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:33.101555 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a00f5c-7d53-4b38-82f7-4437d046adcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:33.169860 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-d5a00f5c-7d53-4b38-82f7-4437d046adcc None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:32:33.171061 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-d5a00f5c-7d53-4b38-82f7-4437d046adcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:33.269406 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 665/1340] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:32:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:32:33.305722 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4a4a4-6d22-44d3-921e-b2af56b88ab7 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:32:33.307814 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-cea4a4a4-6d22-44d3-921e-b2af56b88ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:33.398738 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4a4a4-6d22-44d3-921e-b2af56b88ab7 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:32:33.402199 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aeb0f5-fc83-430d-82cb-f7113ebf74a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:32:33.402838 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeb0f5-fc83-430d-82cb-f7113ebf74a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:33.403123 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeb0f5-fc83-430d-82cb-f7113ebf74a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:33.403402 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aeb0f5-fc83-430d-82cb-f7113ebf74a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:33.412307 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aeb0f5-fc83-430d-82cb-f7113ebf74a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:32:33.413769 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aeb0f5-fc83-430d-82cb-f7113ebf74a1 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:32:33.422812 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 676/1341] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:32:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:32:37.720888 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217d240-4cfa-4d9b-9981-c880199e64d1 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:37.721452 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217d240-4cfa-4d9b-9981-c880199e64d1 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:37.721452 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217d240-4cfa-4d9b-9981-c880199e64d1 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:37.723183 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 666/1342] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:32:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:32:37.728500 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075da2b2-89c4-494e-a078-eeb89b57aca9 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:37.728920 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075da2b2-89c4-494e-a078-eeb89b57aca9 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:37.729091 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075da2b2-89c4-494e-a078-eeb89b57aca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:37.757450 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-075da2b2-89c4-494e-a078-eeb89b57aca9 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:32:37.758640 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-075da2b2-89c4-494e-a078-eeb89b57aca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:37.833236 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 677/1343] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:32:37.872601 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217d240-4cfa-4d9b-9981-c880199e64d1 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:32:37.874321 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-6217d240-4cfa-4d9b-9981-c880199e64d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:37.887234 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217d240-4cfa-4d9b-9981-c880199e64d1 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:32:37.890801 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e3b9b-4fe6-4182-ab7a-27494dd2e491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:32:37.891429 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e3b9b-4fe6-4182-ab7a-27494dd2e491 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:37.891711 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e3b9b-4fe6-4182-ab7a-27494dd2e491 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:37.892525 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e3b9b-4fe6-4182-ab7a-27494dd2e491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:37.901513 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e3b9b-4fe6-4182-ab7a-27494dd2e491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:32:37.902988 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13e3b9b-4fe6-4182-ab7a-27494dd2e491 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:32:37.913316 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 667/1344] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:32:40.721607 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a4032-f190-4443-b6c8-89123faa6ddd None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:40.722144 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a4032-f190-4443-b6c8-89123faa6ddd None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:40.722144 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a4032-f190-4443-b6c8-89123faa6ddd None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:40.723829 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 678/1345] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:32:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:32:40.728988 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f690300-ba8b-4271-bbac-f3c56e3695cf None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:40.729453 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f690300-ba8b-4271-bbac-f3c56e3695cf None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:40.729618 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f690300-ba8b-4271-bbac-f3c56e3695cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:40.747617 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-1f690300-ba8b-4271-bbac-f3c56e3695cf None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:32:40.748794 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-1f690300-ba8b-4271-bbac-f3c56e3695cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:40.756558 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 668/1346] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:32:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:32:40.794856 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a4032-f190-4443-b6c8-89123faa6ddd None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:32:40.805654 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a4032-f190-4443-b6c8-89123faa6ddd None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:32:40.809131 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420dfc21-c25e-4f4c-840f-2bcc36427bb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:32:40.809766 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dfc21-c25e-4f4c-840f-2bcc36427bb9 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:40.810051 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dfc21-c25e-4f4c-840f-2bcc36427bb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:40.810325 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dfc21-c25e-4f4c-840f-2bcc36427bb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:40.819494 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420dfc21-c25e-4f4c-840f-2bcc36427bb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:32:40.820924 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420dfc21-c25e-4f4c-840f-2bcc36427bb9 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:32:40.830269 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 679/1347] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:32:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:32:45.022570 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb28a5-8c2a-413b-a991-8a8644345f4d None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:45.023092 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb28a5-8c2a-413b-a991-8a8644345f4d None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:45.023196 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb28a5-8c2a-413b-a991-8a8644345f4d None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:45.024912 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 669/1348] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:32:45.030335 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a63c9-9c40-4d21-95a8-a181a655102e None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:45.030766 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a63c9-9c40-4d21-95a8-a181a655102e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:45.031030 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a63c9-9c40-4d21-95a8-a181a655102e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:45.048602 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-df5a63c9-9c40-4d21-95a8-a181a655102e None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:32:45.049816 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-df5a63c9-9c40-4d21-95a8-a181a655102e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:45.057464 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 680/1349] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:32:45.096521 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb28a5-8c2a-413b-a991-8a8644345f4d None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:32:45.107059 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb28a5-8c2a-413b-a991-8a8644345f4d None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:32:45.110566 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef911f-84c0-494c-a98a-165be5955a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:32:45.111210 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef911f-84c0-494c-a98a-165be5955a9d service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:45.111490 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef911f-84c0-494c-a98a-165be5955a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:45.111763 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef911f-84c0-494c-a98a-165be5955a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:45.120763 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef911f-84c0-494c-a98a-165be5955a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:32:45.122217 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef911f-84c0-494c-a98a-165be5955a9d service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:32:45.135260 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 670/1350] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:32:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:32:50.291309 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bc210-97ad-439a-b15d-759acea5913f None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:50.292158 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bc210-97ad-439a-b15d-759acea5913f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:50.292158 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bc210-97ad-439a-b15d-759acea5913f None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:50.294215 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 681/1351] 10.222.0.36 () {54 vars in 921 bytes} [Wed Feb 9 04:32:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:32:50.299987 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa71f5-e3ac-4e54-b212-96cd2673ce2a None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:50.300774 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa71f5-e3ac-4e54-b212-96cd2673ce2a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:50.301096 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa71f5-e3ac-4e54-b212-96cd2673ce2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:50.424673 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-83fa71f5-e3ac-4e54-b212-96cd2673ce2a None None] MFA Rules not processed for user `add56fc0cfd8403b86c5ef23fd374a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:32:50.426159 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-83fa71f5-e3ac-4e54-b212-96cd2673ce2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:50.508756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 671/1352] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Feb 9 04:32:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:32:54.610485 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c974387-be43-44e6-9617-e99bbed4c44f None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:54.611010 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c974387-be43-44e6-9617-e99bbed4c44f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:54.611010 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c974387-be43-44e6-9617-e99bbed4c44f None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:54.612789 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 682/1353] 10.222.0.36 () {54 vars in 921 bytes} [Wed Feb 9 04:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:32:54.617970 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e07d16-39fe-4af6-9068-0c75a337f656 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:54.618376 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e07d16-39fe-4af6-9068-0c75a337f656 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:54.618519 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e07d16-39fe-4af6-9068-0c75a337f656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:54.637093 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-90e07d16-39fe-4af6-9068-0c75a337f656 None None] MFA Rules not processed for user `add56fc0cfd8403b86c5ef23fd374a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:32:54.638285 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-90e07d16-39fe-4af6-9068-0c75a337f656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:54.647635 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 672/1354] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Feb 9 04:32:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:32:56.471144 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6e16c-6f0a-4977-a492-09308beae415 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:56.471661 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6e16c-6f0a-4977-a492-09308beae415 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:56.471661 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6e16c-6f0a-4977-a492-09308beae415 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:56.473686 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 683/1355] 10.222.0.36 () {54 vars in 921 bytes} [Wed Feb 9 04:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:32:56.478576 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d2437-a74f-409d-ac3d-815b37688fe3 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:32:56.479005 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d2437-a74f-409d-ac3d-815b37688fe3 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:32:56.479257 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d2437-a74f-409d-ac3d-815b37688fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:32:56.497755 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-449d2437-a74f-409d-ac3d-815b37688fe3 None None] MFA Rules not processed for user `add56fc0cfd8403b86c5ef23fd374a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:32:56.499039 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-449d2437-a74f-409d-ac3d-815b37688fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:32:56.508331 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 673/1356] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Feb 9 04:32:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:00.305489 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da967b-4c6d-429a-846b-9876979d4d9c None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:00.306044 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da967b-4c6d-429a-846b-9876979d4d9c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:00.306044 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da967b-4c6d-429a-846b-9876979d4d9c None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:00.308109 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 684/1357] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:33:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:00.313554 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03672bce-c9b4-4963-8d54-b92133d2026c None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:00.313966 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03672bce-c9b4-4963-8d54-b92133d2026c None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:00.314103 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03672bce-c9b4-4963-8d54-b92133d2026c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:00.332311 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-03672bce-c9b4-4963-8d54-b92133d2026c None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:00.333526 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-03672bce-c9b4-4963-8d54-b92133d2026c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:00.341450 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 674/1358] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:00.387918 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a245135-879a-47c0-8183-b637564f065d None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:00.388414 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a245135-879a-47c0-8183-b637564f065d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:00.388876 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a245135-879a-47c0-8183-b637564f065d None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:00.391335 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 685/1359] 10.222.0.36 () {54 vars in 961 bytes} [Wed Feb 9 04:33:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:00.396558 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1d543-5da2-4cb9-9f20-ad65733811bc None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:00.396843 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1d543-5da2-4cb9-9f20-ad65733811bc None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:00.397306 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1d543-5da2-4cb9-9f20-ad65733811bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:00.443734 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-9be1d543-5da2-4cb9-9f20-ad65733811bc None None] MFA Rules not processed for user `63fe98c10e974c019e05a2f68d012ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:00.445148 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-9be1d543-5da2-4cb9-9f20-ad65733811bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:00.525397 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 675/1360] 10.222.0.36 () {58 vars in 1058 bytes} [Wed Feb 9 04:33:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:00.533296 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a245135-879a-47c0-8183-b637564f065d None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:33:00.548631 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a245135-879a-47c0-8183-b637564f065d None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:33:00.554909 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df14b3a-4e1d-4b21-89cc-cc10fde25c72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:33:00.555608 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df14b3a-4e1d-4b21-89cc-cc10fde25c72 service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:00.555839 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df14b3a-4e1d-4b21-89cc-cc10fde25c72 service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:00.556117 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df14b3a-4e1d-4b21-89cc-cc10fde25c72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:00.565043 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df14b3a-4e1d-4b21-89cc-cc10fde25c72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:33:00.566657 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df14b3a-4e1d-4b21-89cc-cc10fde25c72 service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:33:00.578667 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 686/1361] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:33:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:33:03.052235 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e9dd4-0eea-44d4-be6e-c095270d085b None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:03.052793 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e9dd4-0eea-44d4-be6e-c095270d085b None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:03.052793 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e9dd4-0eea-44d4-be6e-c095270d085b None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:03.054768 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 676/1362] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:03.059872 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c35c9-4c63-4943-b685-dc2e34867fd8 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:03.060300 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c35c9-4c63-4943-b685-dc2e34867fd8 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:03.060429 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c35c9-4c63-4943-b685-dc2e34867fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:03.079077 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2b1c35c9-4c63-4943-b685-dc2e34867fd8 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:03.080273 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2b1c35c9-4c63-4943-b685-dc2e34867fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:03.089064 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 687/1363] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:03.134335 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e9dd4-0eea-44d4-be6e-c095270d085b None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:33:03.150854 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e9dd4-0eea-44d4-be6e-c095270d085b None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:33:03.156714 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba54774-fba1-4717-b29e-77c6353a9a4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:33:03.157531 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba54774-fba1-4717-b29e-77c6353a9a4f service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:03.157826 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba54774-fba1-4717-b29e-77c6353a9a4f service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:03.158246 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba54774-fba1-4717-b29e-77c6353a9a4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:03.167463 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba54774-fba1-4717-b29e-77c6353a9a4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:33:03.169399 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba54774-fba1-4717-b29e-77c6353a9a4f service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:33:03.180174 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 677/1364] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:33:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:33:05.730020 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b47a78-d180-4a1c-852d-5714f745dc3d None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:05.730515 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b47a78-d180-4a1c-852d-5714f745dc3d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:05.730631 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b47a78-d180-4a1c-852d-5714f745dc3d None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:05.732390 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 688/1365] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:33:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:05.738628 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52af00b-9754-457b-b2d1-98b4e1215701 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:05.739604 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52af00b-9754-457b-b2d1-98b4e1215701 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:05.739916 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52af00b-9754-457b-b2d1-98b4e1215701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:05.759845 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-c52af00b-9754-457b-b2d1-98b4e1215701 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:05.761070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-c52af00b-9754-457b-b2d1-98b4e1215701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:05.768761 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 678/1366] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:05.814283 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cdeb1-e53b-459a-aaea-cdbe456b75a9 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:05.814567 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cdeb1-e53b-459a-aaea-cdbe456b75a9 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:05.814843 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cdeb1-e53b-459a-aaea-cdbe456b75a9 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:05.816594 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 689/1367] 10.222.0.36 () {54 vars in 961 bytes} [Wed Feb 9 04:33:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:05.821894 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7fa49-706b-4b1d-8da0-e47d09f19a12 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:05.822180 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7fa49-706b-4b1d-8da0-e47d09f19a12 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:05.822450 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7fa49-706b-4b1d-8da0-e47d09f19a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:05.839972 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-11d7fa49-706b-4b1d-8da0-e47d09f19a12 None None] MFA Rules not processed for user `63fe98c10e974c019e05a2f68d012ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:05.841173 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-11d7fa49-706b-4b1d-8da0-e47d09f19a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:05.850864 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 679/1368] 10.222.0.36 () {58 vars in 1058 bytes} [Wed Feb 9 04:33:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:05.858488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cdeb1-e53b-459a-aaea-cdbe456b75a9 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:33:05.872909 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cdeb1-e53b-459a-aaea-cdbe456b75a9 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:33:05.878143 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bf1fb-db10-4544-a6fd-501b702180bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:33:05.878771 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bf1fb-db10-4544-a6fd-501b702180bf service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:05.879053 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bf1fb-db10-4544-a6fd-501b702180bf service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:05.879328 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bf1fb-db10-4544-a6fd-501b702180bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:05.887089 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bf1fb-db10-4544-a6fd-501b702180bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:33:05.888668 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bf1fb-db10-4544-a6fd-501b702180bf service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:33:05.897690 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 690/1369] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:33:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:33:08.197106 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2331d9a-f1c9-4dd0-99b3-1d1122c7bba6 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:08.197964 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2331d9a-f1c9-4dd0-99b3-1d1122c7bba6 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:08.198242 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2331d9a-f1c9-4dd0-99b3-1d1122c7bba6 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:08.200487 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 680/1370] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:33:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:08.206071 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e86953-6daa-44b8-9f4a-ee223fa9b32a None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:08.206552 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e86953-6daa-44b8-9f4a-ee223fa9b32a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:08.206653 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e86953-6daa-44b8-9f4a-ee223fa9b32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:08.226166 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-77e86953-6daa-44b8-9f4a-ee223fa9b32a None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:08.227487 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-77e86953-6daa-44b8-9f4a-ee223fa9b32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:08.237343 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 691/1371] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:08.283072 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2331d9a-f1c9-4dd0-99b3-1d1122c7bba6 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:33:08.297990 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2331d9a-f1c9-4dd0-99b3-1d1122c7bba6 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:33:08.303687 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe594154-787a-4007-ac19-ba08ea9ddb83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:33:08.304338 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe594154-787a-4007-ac19-ba08ea9ddb83 service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:08.304619 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe594154-787a-4007-ac19-ba08ea9ddb83 service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:08.304894 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe594154-787a-4007-ac19-ba08ea9ddb83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:08.314123 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe594154-787a-4007-ac19-ba08ea9ddb83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:33:08.315713 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe594154-787a-4007-ac19-ba08ea9ddb83 service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:33:08.325277 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 681/1372] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:33:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:33:08.455851 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f34565-b9e2-4710-acd2-3adcb8cb1583 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:08.456058 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f34565-b9e2-4710-acd2-3adcb8cb1583 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:08.456316 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f34565-b9e2-4710-acd2-3adcb8cb1583 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:08.458736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 692/1373] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:33:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:08.465299 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03fcd6-7d04-4768-9675-61321a5500b3 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:08.465603 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03fcd6-7d04-4768-9675-61321a5500b3 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:08.465881 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb03fcd6-7d04-4768-9675-61321a5500b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:08.486444 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-eb03fcd6-7d04-4768-9675-61321a5500b3 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:08.487680 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-eb03fcd6-7d04-4768-9675-61321a5500b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:08.496084 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 682/1374] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:08.755914 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26610f19-cf78-4836-9efc-b01650b0db50 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:08.756293 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26610f19-cf78-4836-9efc-b01650b0db50 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:08.756595 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26610f19-cf78-4836-9efc-b01650b0db50 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:08.758450 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 693/1375] 10.222.0.36 () {54 vars in 963 bytes} [Wed Feb 9 04:33:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:08.763904 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf867bed-a490-4f20-b41b-fff0f49e066b None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:08.764192 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf867bed-a490-4f20-b41b-fff0f49e066b None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:08.764469 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf867bed-a490-4f20-b41b-fff0f49e066b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:08.814926 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-cf867bed-a490-4f20-b41b-fff0f49e066b None None] MFA Rules not processed for user `c2856d2356604d8192c8772e33c85d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:08.816137 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-cf867bed-a490-4f20-b41b-fff0f49e066b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:08.874750 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 683/1376] 10.222.0.36 () {58 vars in 1060 bytes} [Wed Feb 9 04:33:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:08.882171 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26610f19-cf78-4836-9efc-b01650b0db50 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:33:08.893720 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26610f19-cf78-4836-9efc-b01650b0db50 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:33:08.897116 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db0857-b531-481d-839c-0ad9aec44182 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:33:08.897805 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db0857-b531-481d-839c-0ad9aec44182 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:08.898081 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db0857-b531-481d-839c-0ad9aec44182 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:08.898355 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db0857-b531-481d-839c-0ad9aec44182 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:08.908429 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db0857-b531-481d-839c-0ad9aec44182 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:33:08.909954 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db0857-b531-481d-839c-0ad9aec44182 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:33:08.920403 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 694/1377] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:33:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:33:10.632793 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00668163-b63d-4f25-976d-1a87d9aa712a None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:10.633328 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00668163-b63d-4f25-976d-1a87d9aa712a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:10.633440 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00668163-b63d-4f25-976d-1a87d9aa712a None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:10.635136 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 684/1378] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:10.640427 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270764a9-c268-417c-a955-18c4c39876ac None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:10.640843 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270764a9-c268-417c-a955-18c4c39876ac None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:10.640978 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270764a9-c268-417c-a955-18c4c39876ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:10.659972 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-270764a9-c268-417c-a955-18c4c39876ac None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:10.661183 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-270764a9-c268-417c-a955-18c4c39876ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:10.669726 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 695/1379] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:10.714456 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00668163-b63d-4f25-976d-1a87d9aa712a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:33:10.731274 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00668163-b63d-4f25-976d-1a87d9aa712a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:33:10.737821 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d32f4-69a6-4dd2-bee3-b56cfeb4fba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:33:10.738632 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d32f4-69a6-4dd2-bee3-b56cfeb4fba6 service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:10.738632 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d32f4-69a6-4dd2-bee3-b56cfeb4fba6 service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:10.738800 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d32f4-69a6-4dd2-bee3-b56cfeb4fba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:10.747341 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d32f4-69a6-4dd2-bee3-b56cfeb4fba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:33:10.748925 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d32f4-69a6-4dd2-bee3-b56cfeb4fba6 service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:33:10.758643 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 685/1380] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:33:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:33:13.054366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f3ea1-b933-4f10-863d-34a1cf0e0260 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:13.054935 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f3ea1-b933-4f10-863d-34a1cf0e0260 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:13.055204 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f3ea1-b933-4f10-863d-34a1cf0e0260 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:13.057248 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 696/1381] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:33:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:13.062390 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea2a7c-d90d-4545-a092-ed42e66af5c7 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:13.062803 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea2a7c-d90d-4545-a092-ed42e66af5c7 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:13.062938 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cea2a7c-d90d-4545-a092-ed42e66af5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:13.081183 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-0cea2a7c-d90d-4545-a092-ed42e66af5c7 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:13.082348 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-0cea2a7c-d90d-4545-a092-ed42e66af5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:13.090324 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 686/1382] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:13.134045 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f3ea1-b933-4f10-863d-34a1cf0e0260 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:33:13.149438 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f3ea1-b933-4f10-863d-34a1cf0e0260 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:33:13.155197 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f6745-5b9c-440a-b5e9-c13406def808 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:33:13.156689 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f6745-5b9c-440a-b5e9-c13406def808 service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:13.157195 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f6745-5b9c-440a-b5e9-c13406def808 service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:13.157571 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f6745-5b9c-440a-b5e9-c13406def808 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:13.166138 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f6745-5b9c-440a-b5e9-c13406def808 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:33:13.167901 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f6745-5b9c-440a-b5e9-c13406def808 service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:33:13.178158 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 697/1383] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:33:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:33:15.506157 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483bfbc-e29d-4d32-9878-89d1f7ee4c3f None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:15.507016 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483bfbc-e29d-4d32-9878-89d1f7ee4c3f None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:15.507297 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483bfbc-e29d-4d32-9878-89d1f7ee4c3f None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:15.509073 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 687/1384] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:33:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:15.514179 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e478b-7181-4088-8678-aa95837a7dad None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:15.514589 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e478b-7181-4088-8678-aa95837a7dad None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:15.514711 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e478b-7181-4088-8678-aa95837a7dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:15.534398 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-943e478b-7181-4088-8678-aa95837a7dad None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:15.535731 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-943e478b-7181-4088-8678-aa95837a7dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:15.544583 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 698/1385] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:15.590243 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483bfbc-e29d-4d32-9878-89d1f7ee4c3f None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:33:15.605510 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483bfbc-e29d-4d32-9878-89d1f7ee4c3f None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:33:15.611084 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a93af-0d18-46ab-b4ae-5e51d9dcabca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:33:15.611724 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a93af-0d18-46ab-b4ae-5e51d9dcabca service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:15.612001 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a93af-0d18-46ab-b4ae-5e51d9dcabca service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:15.612274 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a93af-0d18-46ab-b4ae-5e51d9dcabca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:15.620755 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a93af-0d18-46ab-b4ae-5e51d9dcabca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:33:15.622351 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a93af-0d18-46ab-b4ae-5e51d9dcabca service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:33:15.632220 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 688/1386] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:33:17.882262 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971c6eb-a934-4f37-918e-8589a3005174 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:17.882775 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971c6eb-a934-4f37-918e-8589a3005174 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:17.882775 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971c6eb-a934-4f37-918e-8589a3005174 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:17.884530 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 699/1387] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:33:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:17.892029 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9df32d-a4fb-4dbe-9264-f33fca3fb0ae None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:17.892545 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9df32d-a4fb-4dbe-9264-f33fca3fb0ae None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:17.893070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9df32d-a4fb-4dbe-9264-f33fca3fb0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:17.916674 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-5c9df32d-a4fb-4dbe-9264-f33fca3fb0ae None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:17.918414 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-5c9df32d-a4fb-4dbe-9264-f33fca3fb0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:17.927471 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 689/1388] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:17.972948 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971c6eb-a934-4f37-918e-8589a3005174 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:33:17.986895 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971c6eb-a934-4f37-918e-8589a3005174 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:33:17.992271 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542161e-c7e2-4aa2-afb4-b3b93f212ab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:33:17.992909 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542161e-c7e2-4aa2-afb4-b3b93f212ab7 service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:17.993224 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542161e-c7e2-4aa2-afb4-b3b93f212ab7 service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:17.993501 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542161e-c7e2-4aa2-afb4-b3b93f212ab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:18.002239 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542161e-c7e2-4aa2-afb4-b3b93f212ab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:33:18.003828 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542161e-c7e2-4aa2-afb4-b3b93f212ab7 service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:33:18.013084 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 700/1389] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:33:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:33:20.577679 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8aec5-d5c3-4275-bed0-9ec4f375503a None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:20.578202 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8aec5-d5c3-4275-bed0-9ec4f375503a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:20.578295 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8aec5-d5c3-4275-bed0-9ec4f375503a None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:20.580086 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 690/1390] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:33:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:20.586288 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7e66a-6ad4-4893-808c-3540dcd3ee8b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:20.586807 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7e66a-6ad4-4893-808c-3540dcd3ee8b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:20.586982 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7e66a-6ad4-4893-808c-3540dcd3ee8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:20.604831 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a9d7e66a-6ad4-4893-808c-3540dcd3ee8b None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:20.606070 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a9d7e66a-6ad4-4893-808c-3540dcd3ee8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:20.614560 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 701/1391] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:20.667092 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8aec5-d5c3-4275-bed0-9ec4f375503a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:33:20.681626 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8aec5-d5c3-4275-bed0-9ec4f375503a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:33:20.687752 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419b7f6-dbb1-4af2-94ce-20786ca45a54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:33:20.688377 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419b7f6-dbb1-4af2-94ce-20786ca45a54 service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:20.688654 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419b7f6-dbb1-4af2-94ce-20786ca45a54 service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:20.688922 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419b7f6-dbb1-4af2-94ce-20786ca45a54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:20.698161 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419b7f6-dbb1-4af2-94ce-20786ca45a54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:33:20.700229 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419b7f6-dbb1-4af2-94ce-20786ca45a54 service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:33:20.711284 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 691/1392] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:33:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:33:22.972888 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6c273-f1d1-4671-b68b-26d5b2de99ac None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:22.973489 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6c273-f1d1-4671-b68b-26d5b2de99ac None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:22.973489 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6c273-f1d1-4671-b68b-26d5b2de99ac None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:22.975185 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 702/1393] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:33:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:22.980668 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30c32f-3224-40d7-885d-d69c955179f9 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:22.981169 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30c32f-3224-40d7-885d-d69c955179f9 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:22.981278 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30c32f-3224-40d7-885d-d69c955179f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:23.000206 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-6a30c32f-3224-40d7-885d-d69c955179f9 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:23.001446 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-6a30c32f-3224-40d7-885d-d69c955179f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:23.009418 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 692/1394] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:23.053194 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6c273-f1d1-4671-b68b-26d5b2de99ac None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:33:23.068272 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6c273-f1d1-4671-b68b-26d5b2de99ac None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:33:23.073832 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24533ff3-ff92-43a0-8953-32403e6e13ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:33:23.074469 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24533ff3-ff92-43a0-8953-32403e6e13ec service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:23.074753 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24533ff3-ff92-43a0-8953-32403e6e13ec service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:23.075031 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24533ff3-ff92-43a0-8953-32403e6e13ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:23.083140 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24533ff3-ff92-43a0-8953-32403e6e13ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:33:23.084719 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24533ff3-ff92-43a0-8953-32403e6e13ec service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:33:23.094338 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 703/1395] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:33:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:33:24.029830 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdb44f-9cde-45c7-92a4-b53fe747145f None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:24.030425 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdb44f-9cde-45c7-92a4-b53fe747145f None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:24.030425 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdb44f-9cde-45c7-92a4-b53fe747145f None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:24.032244 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 693/1396] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:33:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:24.037589 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84c382-a68c-468c-aaa8-6c597873a377 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:24.038014 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84c382-a68c-468c-aaa8-6c597873a377 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:24.038149 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84c382-a68c-468c-aaa8-6c597873a377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:24.055381 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-9b84c382-a68c-468c-aaa8-6c597873a377 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:24.056559 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9b84c382-a68c-468c-aaa8-6c597873a377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:24.064949 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 704/1397] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:24.120160 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d3a3b-084b-4858-902a-5f73a4df0afb None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:24.120450 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d3a3b-084b-4858-902a-5f73a4df0afb None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:24.120731 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d3a3b-084b-4858-902a-5f73a4df0afb None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:24.122533 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 694/1398] 10.222.0.36 () {54 vars in 962 bytes} [Wed Feb 9 04:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:24.128385 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16061726-9796-496a-b7f0-d25ee253b72e None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:24.128733 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16061726-9796-496a-b7f0-d25ee253b72e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:24.129041 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16061726-9796-496a-b7f0-d25ee253b72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:24.178463 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-16061726-9796-496a-b7f0-d25ee253b72e None None] MFA Rules not processed for user `6940472eb8e544c8aa3409328c804282`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:24.179643 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-16061726-9796-496a-b7f0-d25ee253b72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:24.239176 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 705/1399] 10.222.0.36 () {58 vars in 1059 bytes} [Wed Feb 9 04:33:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:24.246653 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d3a3b-084b-4858-902a-5f73a4df0afb None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:33:24.257566 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d3a3b-084b-4858-902a-5f73a4df0afb None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:33:24.261136 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025527e8-381d-47d1-a7f0-40b01e2a2c9f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6940472eb8e544c8aa3409328c804282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:33:24.261791 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025527e8-381d-47d1-a7f0-40b01e2a2c9f service glance] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:24.262075 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025527e8-381d-47d1-a7f0-40b01e2a2c9f service glance] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:24.262379 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025527e8-381d-47d1-a7f0-40b01e2a2c9f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:24.272239 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025527e8-381d-47d1-a7f0-40b01e2a2c9f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:33:24.273716 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025527e8-381d-47d1-a7f0-40b01e2a2c9f service glance] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:33:24.284665 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 695/1400] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:33:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:33:24.704468 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170cb80-f950-409b-bd92-03c10d722dba None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:24.704758 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170cb80-f950-409b-bd92-03c10d722dba None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:24.705069 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170cb80-f950-409b-bd92-03c10d722dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:24.752470 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-4170cb80-f950-409b-bd92-03c10d722dba None None] MFA Rules not processed for user `98a27dbe620c4aff967363a7d48c46e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:24.753719 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-4170cb80-f950-409b-bd92-03c10d722dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:24.815762 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 706/1401] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Feb 9 04:33:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:24.857922 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10812fb2-00e9-4bb8-9132-9a56b6407ee1 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:24.858860 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10812fb2-00e9-4bb8-9132-9a56b6407ee1 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:24.859205 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10812fb2-00e9-4bb8-9132-9a56b6407ee1 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:24.861070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 696/1402] 10.222.0.36 () {54 vars in 942 bytes} [Wed Feb 9 04:33:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:24.867512 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4021c6-bc4a-42ca-adfe-ac9b52b54125 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:24.867905 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4021c6-bc4a-42ca-adfe-ac9b52b54125 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:24.868189 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4021c6-bc4a-42ca-adfe-ac9b52b54125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:24.928724 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-db4021c6-bc4a-42ca-adfe-ac9b52b54125 None None] MFA Rules not processed for user `66fd482451f743cdb692677e57508764`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:24.930214 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-db4021c6-bc4a-42ca-adfe-ac9b52b54125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:25.012915 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 707/1403] 10.222.0.36 () {58 vars in 1039 bytes} [Wed Feb 9 04:33:24 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:25.022366 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10812fb2-00e9-4bb8-9132-9a56b6407ee1 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:33:25.036811 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10812fb2-00e9-4bb8-9132-9a56b6407ee1 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:33:25.041924 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fe6f8-a81c-4931-95ba-ddf2c06c472b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66fd482451f743cdb692677e57508764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:33:25.042563 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fe6f8-a81c-4931-95ba-ddf2c06c472b service swift] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:25.042849 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fe6f8-a81c-4931-95ba-ddf2c06c472b service swift] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:25.043129 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fe6f8-a81c-4931-95ba-ddf2c06c472b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:25.052044 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fe6f8-a81c-4931-95ba-ddf2c06c472b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:33:25.053682 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fe6f8-a81c-4931-95ba-ddf2c06c472b service swift] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:33:25.062232 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 697/1404] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Feb 9 04:33:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 09 04:33:25.377235 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bfee9-936c-4fbc-a143-e1dd5fbcaba5 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:25.377760 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bfee9-936c-4fbc-a143-e1dd5fbcaba5 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:25.377760 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bfee9-936c-4fbc-a143-e1dd5fbcaba5 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:25.379723 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 708/1405] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:33:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:25.385309 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b858b-b00a-4be4-a0d2-756819e5e506 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:25.385748 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b858b-b00a-4be4-a0d2-756819e5e506 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:25.386122 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b858b-b00a-4be4-a0d2-756819e5e506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:25.408468 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-ce1b858b-b00a-4be4-a0d2-756819e5e506 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:25.409791 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-ce1b858b-b00a-4be4-a0d2-756819e5e506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:25.425496 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 698/1406] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:25.463929 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bfee9-936c-4fbc-a143-e1dd5fbcaba5 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:33:25.478838 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bfee9-936c-4fbc-a143-e1dd5fbcaba5 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:33:25.484306 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa413b-bb62-470c-9e84-2f0b8ac62e55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:33:25.488930 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa413b-bb62-470c-9e84-2f0b8ac62e55 service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:25.489305 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa413b-bb62-470c-9e84-2f0b8ac62e55 service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:25.489645 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa413b-bb62-470c-9e84-2f0b8ac62e55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:25.499715 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa413b-bb62-470c-9e84-2f0b8ac62e55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:33:25.501417 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa413b-bb62-470c-9e84-2f0b8ac62e55 service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:33:25.510753 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 709/1407] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:33:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:33:27.957285 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187b41f-0a27-40e7-9894-3839b9df605a None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:27.957803 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187b41f-0a27-40e7-9894-3839b9df605a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:27.957803 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187b41f-0a27-40e7-9894-3839b9df605a None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:27.959948 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 699/1408] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:33:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:27.964929 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dade8-1b0b-4e95-a97f-25d9c36f5368 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:27.965366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dade8-1b0b-4e95-a97f-25d9c36f5368 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:27.965505 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977dade8-1b0b-4e95-a97f-25d9c36f5368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:27.986734 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-977dade8-1b0b-4e95-a97f-25d9c36f5368 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:27.986734 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-977dade8-1b0b-4e95-a97f-25d9c36f5368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:27.999398 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 710/1409] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:28.037829 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187b41f-0a27-40e7-9894-3839b9df605a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:33:28.052967 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187b41f-0a27-40e7-9894-3839b9df605a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:33:28.058336 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5a4a8-e191-4551-a0ab-33d1bf8eead0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:33:28.058920 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5a4a8-e191-4551-a0ab-33d1bf8eead0 service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:28.059217 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5a4a8-e191-4551-a0ab-33d1bf8eead0 service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:28.059473 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5a4a8-e191-4551-a0ab-33d1bf8eead0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:28.068274 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5a4a8-e191-4551-a0ab-33d1bf8eead0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:33:28.069943 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5a4a8-e191-4551-a0ab-33d1bf8eead0 service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:33:28.079482 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 700/1410] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:33:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:33:48.168667 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca72787-be52-44ad-b4d0-0c1bd3b69098 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:48.169323 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca72787-be52-44ad-b4d0-0c1bd3b69098 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:48.169323 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca72787-be52-44ad-b4d0-0c1bd3b69098 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:48.171070 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 711/1411] 10.222.0.36 () {54 vars in 918 bytes} [Wed Feb 9 04:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:48.176202 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad688c7-b494-45b5-806f-53e2d486c5ef None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:48.176710 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad688c7-b494-45b5-806f-53e2d486c5ef None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:48.176825 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad688c7-b494-45b5-806f-53e2d486c5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:48.194731 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-3ad688c7-b494-45b5-806f-53e2d486c5ef None None] MFA Rules not processed for user `add56fc0cfd8403b86c5ef23fd374a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:48.195935 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-3ad688c7-b494-45b5-806f-53e2d486c5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:48.204905 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 701/1412] 10.222.0.36 () {58 vars in 1015 bytes} [Wed Feb 9 04:33:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:48.219581 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733316b5-4adc-43fc-bb6e-b9227b29753e None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:48.219883 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733316b5-4adc-43fc-bb6e-b9227b29753e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:48.220142 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733316b5-4adc-43fc-bb6e-b9227b29753e None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:48.221969 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 712/1413] 10.222.0.36 () {54 vars in 918 bytes} [Wed Feb 9 04:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:48.226487 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de758d-0c5f-48bd-9af8-27baf308d19a None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:48.226772 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de758d-0c5f-48bd-9af8-27baf308d19a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:48.227065 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de758d-0c5f-48bd-9af8-27baf308d19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:48.246117 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-d4de758d-0c5f-48bd-9af8-27baf308d19a None None] MFA Rules not processed for user `63fe98c10e974c019e05a2f68d012ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:48.247276 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-d4de758d-0c5f-48bd-9af8-27baf308d19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:48.256228 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 702/1414] 10.222.0.36 () {58 vars in 1015 bytes} [Wed Feb 9 04:33:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:33:50.907193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe45e00-2f57-4104-bd49-6f01ad8d6d82 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:50.907727 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe45e00-2f57-4104-bd49-6f01ad8d6d82 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:50.907727 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe45e00-2f57-4104-bd49-6f01ad8d6d82 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:50.909442 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 713/1415] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 9 04:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:50.914801 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a759f-df51-409d-aa3d-3b7820674dc0 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:50.915240 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a759f-df51-409d-aa3d-3b7820674dc0 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:50.915402 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a759f-df51-409d-aa3d-3b7820674dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:50.933429 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-e57a759f-df51-409d-aa3d-3b7820674dc0 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:50.934621 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-e57a759f-df51-409d-aa3d-3b7820674dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:50.942335 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 703/1416] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 9 04:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:50.984400 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe45e00-2f57-4104-bd49-6f01ad8d6d82 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:33:50.998443 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe45e00-2f57-4104-bd49-6f01ad8d6d82 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:33:51.003778 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fff002-fd40-4197-86ac-30db3530209b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:33:51.004404 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fff002-fd40-4197-86ac-30db3530209b service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:51.004686 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fff002-fd40-4197-86ac-30db3530209b service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:51.004962 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fff002-fd40-4197-86ac-30db3530209b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:51.012767 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fff002-fd40-4197-86ac-30db3530209b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:33:51.014380 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fff002-fd40-4197-86ac-30db3530209b service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:33:51.023390 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 714/1417] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:33:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:33:52.394823 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2412681-7bfe-4118-adb4-100c6ac99070 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:52.395340 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2412681-7bfe-4118-adb4-100c6ac99070 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:52.395340 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2412681-7bfe-4118-adb4-100c6ac99070 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:52.397074 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 704/1418] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 9 04:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:52.402209 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6fac8-cb41-441e-a55a-2790f53a67c8 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:52.402615 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6fac8-cb41-441e-a55a-2790f53a67c8 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:52.402751 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6fac8-cb41-441e-a55a-2790f53a67c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:52.420204 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-8cc6fac8-cb41-441e-a55a-2790f53a67c8 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:52.421442 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8cc6fac8-cb41-441e-a55a-2790f53a67c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:52.428949 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 715/1419] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 9 04:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:52.602336 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2412681-7bfe-4118-adb4-100c6ac99070 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:33:52.616121 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2412681-7bfe-4118-adb4-100c6ac99070 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:33:52.621405 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c3522-2c98-4708-83e0-ec640a9579d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:33:52.622022 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c3522-2c98-4708-83e0-ec640a9579d8 service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:52.622833 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c3522-2c98-4708-83e0-ec640a9579d8 service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:52.623102 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c3522-2c98-4708-83e0-ec640a9579d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:52.631007 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c3522-2c98-4708-83e0-ec640a9579d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:33:52.632606 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c3522-2c98-4708-83e0-ec640a9579d8 service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:33:52.642357 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 705/1420] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:33:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:33:53.977248 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8c627-c517-408c-9ad7-604cfe599659 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:53.977698 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8c627-c517-408c-9ad7-604cfe599659 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:53.977793 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade8c627-c517-408c-9ad7-604cfe599659 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:53.979556 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 716/1421] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 9 04:33:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:33:53.984475 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198bd6e-78fe-425c-abc2-786ca590fd05 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:53.984881 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198bd6e-78fe-425c-abc2-786ca590fd05 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:53.985039 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d198bd6e-78fe-425c-abc2-786ca590fd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:54.003388 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-d198bd6e-78fe-425c-abc2-786ca590fd05 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:54.004585 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-d198bd6e-78fe-425c-abc2-786ca590fd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:54.012323 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 706/1422] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 9 04:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:54.164354 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8c627-c517-408c-9ad7-604cfe599659 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:33:54.178126 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade8c627-c517-408c-9ad7-604cfe599659 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:33:54.183524 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aec335-e52d-40f7-a157-d71e75ce355d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:33:54.184150 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aec335-e52d-40f7-a157-d71e75ce355d service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:54.184429 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aec335-e52d-40f7-a157-d71e75ce355d service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:54.185388 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aec335-e52d-40f7-a157-d71e75ce355d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:54.193356 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aec335-e52d-40f7-a157-d71e75ce355d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:33:54.194919 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aec335-e52d-40f7-a157-d71e75ce355d service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:33:54.204655 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 717/1423] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:33:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:33:55.495460 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78b599-e028-4227-a98b-3492be7965f8 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:55.496044 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78b599-e028-4227-a98b-3492be7965f8 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:55.496044 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78b599-e028-4227-a98b-3492be7965f8 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:55.498346 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 707/1424] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 9 04:33:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:55.503426 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196806e-ee94-41f7-b766-3a6deae4a454 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:55.503850 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196806e-ee94-41f7-b766-3a6deae4a454 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:55.504045 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196806e-ee94-41f7-b766-3a6deae4a454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:55.522100 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-8196806e-ee94-41f7-b766-3a6deae4a454 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:55.523283 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8196806e-ee94-41f7-b766-3a6deae4a454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:55.534191 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 718/1425] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 9 04:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:55.683068 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78b599-e028-4227-a98b-3492be7965f8 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:33:55.697435 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78b599-e028-4227-a98b-3492be7965f8 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:33:55.703281 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e1667-ffd3-4cf0-858b-6347cf95f9fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:33:55.703903 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e1667-ffd3-4cf0-858b-6347cf95f9fa service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:55.704185 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e1667-ffd3-4cf0-858b-6347cf95f9fa service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:55.704458 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e1667-ffd3-4cf0-858b-6347cf95f9fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:55.712237 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e1667-ffd3-4cf0-858b-6347cf95f9fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:33:55.713841 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e1667-ffd3-4cf0-858b-6347cf95f9fa service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:33:55.722924 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 708/1426] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:33:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:33:57.029821 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2572eb-47ae-4f42-96c7-a5dbdb8127ac None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:57.030357 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2572eb-47ae-4f42-96c7-a5dbdb8127ac None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:57.030357 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2572eb-47ae-4f42-96c7-a5dbdb8127ac None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:57.032146 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 719/1427] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 9 04:33:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:57.037259 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71481ba1-06d8-4516-a907-c29eb8e29465 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:57.037700 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71481ba1-06d8-4516-a907-c29eb8e29465 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:57.037796 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71481ba1-06d8-4516-a907-c29eb8e29465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:57.055625 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-71481ba1-06d8-4516-a907-c29eb8e29465 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:57.056794 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-71481ba1-06d8-4516-a907-c29eb8e29465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:57.064330 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 709/1428] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 9 04:33:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:57.213747 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2572eb-47ae-4f42-96c7-a5dbdb8127ac None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:33:57.229550 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2572eb-47ae-4f42-96c7-a5dbdb8127ac None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:33:57.235407 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85054d2b-4fb7-40a8-9980-19bef966e228 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:33:57.236031 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85054d2b-4fb7-40a8-9980-19bef966e228 service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:57.236310 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85054d2b-4fb7-40a8-9980-19bef966e228 service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:57.236593 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85054d2b-4fb7-40a8-9980-19bef966e228 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:57.244573 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85054d2b-4fb7-40a8-9980-19bef966e228 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:33:57.246174 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85054d2b-4fb7-40a8-9980-19bef966e228 service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:33:57.255197 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 720/1429] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:33:58.489739 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bba5d-d413-4a89-8608-5b231617e3e9 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:58.490305 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bba5d-d413-4a89-8608-5b231617e3e9 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:58.490305 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bba5d-d413-4a89-8608-5b231617e3e9 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:58.492087 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 710/1430] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 9 04:33:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:58.497648 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd98b6e-600d-406a-aae7-d56665be76ec None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:58.498079 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd98b6e-600d-406a-aae7-d56665be76ec None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:58.498195 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd98b6e-600d-406a-aae7-d56665be76ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:58.516124 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-8bd98b6e-600d-406a-aae7-d56665be76ec None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:33:58.517336 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8bd98b6e-600d-406a-aae7-d56665be76ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:33:58.524772 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 721/1431] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 9 04:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:33:58.674149 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bba5d-d413-4a89-8608-5b231617e3e9 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:33:58.688666 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bba5d-d413-4a89-8608-5b231617e3e9 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:33:58.693991 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91e24d-b9ff-4f10-8be5-ade9dea65715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:33:58.694611 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91e24d-b9ff-4f10-8be5-ade9dea65715 service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:58.694896 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91e24d-b9ff-4f10-8be5-ade9dea65715 service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:58.695170 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91e24d-b9ff-4f10-8be5-ade9dea65715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:58.703668 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91e24d-b9ff-4f10-8be5-ade9dea65715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:33:58.705283 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91e24d-b9ff-4f10-8be5-ade9dea65715 service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:33:58.714586 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 711/1432] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:33:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:33:59.986076 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124defe-46bd-4a3c-b9d4-3f70e33b103a None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:59.986480 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124defe-46bd-4a3c-b9d4-3f70e33b103a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:59.986627 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124defe-46bd-4a3c-b9d4-3f70e33b103a None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:33:59.988400 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 722/1433] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 9 04:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:33:59.993730 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670c82d-e794-4cb1-a102-0b0f97654109 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:33:59.994148 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670c82d-e794-4cb1-a102-0b0f97654109 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:33:59.994287 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670c82d-e794-4cb1-a102-0b0f97654109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:00.011989 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-1670c82d-e794-4cb1-a102-0b0f97654109 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:34:00.013322 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-1670c82d-e794-4cb1-a102-0b0f97654109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:34:00.020898 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 712/1434] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 9 04:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:34:00.172155 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124defe-46bd-4a3c-b9d4-3f70e33b103a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:34:00.186169 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124defe-46bd-4a3c-b9d4-3f70e33b103a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:34:00.191472 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a69c4-80b8-4108-9ad2-b823892f156a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:34:00.192103 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a69c4-80b8-4108-9ad2-b823892f156a service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:00.192384 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a69c4-80b8-4108-9ad2-b823892f156a service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:00.192659 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a69c4-80b8-4108-9ad2-b823892f156a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:00.200561 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a69c4-80b8-4108-9ad2-b823892f156a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:34:00.202210 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a69c4-80b8-4108-9ad2-b823892f156a service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:34:00.211240 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 723/1435] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:34:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:34:01.461598 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bac12-fd77-4508-8295-397c69b61321 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:01.462131 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bac12-fd77-4508-8295-397c69b61321 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:01.462131 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bac12-fd77-4508-8295-397c69b61321 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:01.463954 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 713/1436] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 9 04:34:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:34:01.470556 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bf586-0fec-4f9f-97d8-d1b1ea6bd120 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:01.470986 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bf586-0fec-4f9f-97d8-d1b1ea6bd120 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:01.471097 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bf586-0fec-4f9f-97d8-d1b1ea6bd120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:01.489267 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-592bf586-0fec-4f9f-97d8-d1b1ea6bd120 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:34:01.490451 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-592bf586-0fec-4f9f-97d8-d1b1ea6bd120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:34:01.498099 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 724/1437] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 9 04:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:34:01.659230 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bac12-fd77-4508-8295-397c69b61321 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:34:01.673605 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bac12-fd77-4508-8295-397c69b61321 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:34:01.679100 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0b682-0aa1-42d1-84fb-adc860b0bc3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:34:01.679734 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0b682-0aa1-42d1-84fb-adc860b0bc3d service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:01.680025 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0b682-0aa1-42d1-84fb-adc860b0bc3d service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:01.680330 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0b682-0aa1-42d1-84fb-adc860b0bc3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:01.688610 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0b682-0aa1-42d1-84fb-adc860b0bc3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:34:01.690251 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0b682-0aa1-42d1-84fb-adc860b0bc3d service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:34:01.699512 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 714/1438] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:34:02.973551 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8fdf8-4fe2-4c0a-8f37-d920571fb450 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:02.974117 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8fdf8-4fe2-4c0a-8f37-d920571fb450 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:02.974117 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8fdf8-4fe2-4c0a-8f37-d920571fb450 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:02.975915 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 725/1439] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 9 04:34:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:34:02.980989 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763eb95f-fe55-46e9-b7a3-b6d3260a9ef4 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:02.981897 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763eb95f-fe55-46e9-b7a3-b6d3260a9ef4 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:02.982141 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763eb95f-fe55-46e9-b7a3-b6d3260a9ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:02.999491 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-763eb95f-fe55-46e9-b7a3-b6d3260a9ef4 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:34:03.000660 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-763eb95f-fe55-46e9-b7a3-b6d3260a9ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:34:03.008168 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 715/1440] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 9 04:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:34:03.157703 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8fdf8-4fe2-4c0a-8f37-d920571fb450 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:34:03.171589 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8fdf8-4fe2-4c0a-8f37-d920571fb450 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:34:03.176882 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd9e2b-a541-46d5-821a-d44bbb19af9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:34:03.177548 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd9e2b-a541-46d5-821a-d44bbb19af9b service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:03.177837 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd9e2b-a541-46d5-821a-d44bbb19af9b service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:03.178118 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd9e2b-a541-46d5-821a-d44bbb19af9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:03.186552 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd9e2b-a541-46d5-821a-d44bbb19af9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:34:03.188143 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd9e2b-a541-46d5-821a-d44bbb19af9b service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:34:03.197294 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 726/1441] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:34:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:34:05.318531 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7220eb6-6bc2-40bc-ba35-f1eff4b60b4d None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:05.319109 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7220eb6-6bc2-40bc-ba35-f1eff4b60b4d None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:05.319109 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7220eb6-6bc2-40bc-ba35-f1eff4b60b4d None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:05.320859 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 716/1442] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 9 04:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:34:05.326824 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf1a67-2abe-4802-8bfb-592bc0191188 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:05.327269 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf1a67-2abe-4802-8bfb-592bc0191188 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:05.327361 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf1a67-2abe-4802-8bfb-592bc0191188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:05.345147 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-50bf1a67-2abe-4802-8bfb-592bc0191188 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:34:05.346322 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-50bf1a67-2abe-4802-8bfb-592bc0191188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:34:05.354160 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 727/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 9 04:34:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:34:05.392964 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7220eb6-6bc2-40bc-ba35-f1eff4b60b4d None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:34:05.404107 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7220eb6-6bc2-40bc-ba35-f1eff4b60b4d None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:34:05.408491 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e9593-8f73-4a64-81b1-708b373f7246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:34:05.409157 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e9593-8f73-4a64-81b1-708b373f7246 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:05.409441 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e9593-8f73-4a64-81b1-708b373f7246 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:05.409722 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e9593-8f73-4a64-81b1-708b373f7246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:05.419475 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e9593-8f73-4a64-81b1-708b373f7246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:34:05.420904 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e9593-8f73-4a64-81b1-708b373f7246 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:34:05.431873 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 717/1444] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:34:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:34:07.808383 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4db4e2-ef58-481b-a882-2c0313605db8 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:07.808924 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4db4e2-ef58-481b-a882-2c0313605db8 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:07.808924 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4db4e2-ef58-481b-a882-2c0313605db8 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:07.810701 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 728/1445] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 9 04:34:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:34:07.815952 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35da97b-f889-4cc2-83e0-fcc2c2814664 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:07.816366 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35da97b-f889-4cc2-83e0-fcc2c2814664 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:07.816503 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35da97b-f889-4cc2-83e0-fcc2c2814664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:07.834537 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-e35da97b-f889-4cc2-83e0-fcc2c2814664 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:34:07.835704 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-e35da97b-f889-4cc2-83e0-fcc2c2814664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:34:07.843888 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 718/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 9 04:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:34:07.882004 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4db4e2-ef58-481b-a882-2c0313605db8 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:34:07.892638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4db4e2-ef58-481b-a882-2c0313605db8 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:34:07.896120 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e93a2f-b401-42f7-95d3-aec60f5fd889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:34:07.896752 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e93a2f-b401-42f7-95d3-aec60f5fd889 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:07.897063 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e93a2f-b401-42f7-95d3-aec60f5fd889 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:07.897341 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e93a2f-b401-42f7-95d3-aec60f5fd889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:07.906311 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e93a2f-b401-42f7-95d3-aec60f5fd889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:34:07.907736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e93a2f-b401-42f7-95d3-aec60f5fd889 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:34:07.916851 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 729/1447] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:34:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:34:10.564705 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a79013-cd17-4c62-8a98-e0828cc1eecb None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:10.565235 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a79013-cd17-4c62-8a98-e0828cc1eecb None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:10.565344 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a79013-cd17-4c62-8a98-e0828cc1eecb None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:10.567101 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 719/1448] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 9 04:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:34:10.572320 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aeefa-b698-45aa-a809-68deb311f5ed None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:10.572748 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aeefa-b698-45aa-a809-68deb311f5ed None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:10.572882 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aeefa-b698-45aa-a809-68deb311f5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:10.590773 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-433aeefa-b698-45aa-a809-68deb311f5ed None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:34:10.591948 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-433aeefa-b698-45aa-a809-68deb311f5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:34:10.599591 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 730/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 9 04:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:34:10.638693 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a79013-cd17-4c62-8a98-e0828cc1eecb None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:34:10.649071 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a79013-cd17-4c62-8a98-e0828cc1eecb None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:34:10.652821 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0985c-3ab9-43d5-b09b-f6baaa9d0ada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:34:10.653481 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0985c-3ab9-43d5-b09b-f6baaa9d0ada service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:10.653763 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0985c-3ab9-43d5-b09b-f6baaa9d0ada service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:10.654038 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0985c-3ab9-43d5-b09b-f6baaa9d0ada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:10.662716 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0985c-3ab9-43d5-b09b-f6baaa9d0ada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:34:10.664128 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0985c-3ab9-43d5-b09b-f6baaa9d0ada service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:34:10.673165 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 720/1450] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:34:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:34:13.038409 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fc877-0dc9-4eb3-9a06-d3bc206063e5 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:13.038964 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fc877-0dc9-4eb3-9a06-d3bc206063e5 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:13.038964 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0fc877-0dc9-4eb3-9a06-d3bc206063e5 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:13.040752 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 731/1451] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 9 04:34:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:34:13.046601 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcab8dd-170e-42e5-9055-82fa35e05aa3 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:13.047077 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcab8dd-170e-42e5-9055-82fa35e05aa3 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:13.047181 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcab8dd-170e-42e5-9055-82fa35e05aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:13.065772 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-3bcab8dd-170e-42e5-9055-82fa35e05aa3 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:34:13.066963 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-3bcab8dd-170e-42e5-9055-82fa35e05aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:34:13.075106 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 721/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 9 04:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:34:13.114414 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fc877-0dc9-4eb3-9a06-d3bc206063e5 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:34:13.125390 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0fc877-0dc9-4eb3-9a06-d3bc206063e5 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:34:13.128802 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abdba9d-6c1d-494a-8817-116e8d4c3c43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:34:13.129460 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdba9d-6c1d-494a-8817-116e8d4c3c43 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:13.129738 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdba9d-6c1d-494a-8817-116e8d4c3c43 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:13.130013 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdba9d-6c1d-494a-8817-116e8d4c3c43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:13.138549 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abdba9d-6c1d-494a-8817-116e8d4c3c43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:34:13.139991 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abdba9d-6c1d-494a-8817-116e8d4c3c43 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:34:13.148940 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 732/1453] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:34:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:34:15.482674 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ade40-101b-48a4-86a8-55438a7161dd None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:15.483228 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ade40-101b-48a4-86a8-55438a7161dd None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:15.483228 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ade40-101b-48a4-86a8-55438a7161dd None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:15.485062 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 722/1454] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 9 04:34:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:34:15.490404 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42a039-7b2e-41cd-a35c-626911db1ee6 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:15.490816 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42a039-7b2e-41cd-a35c-626911db1ee6 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:15.490989 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42a039-7b2e-41cd-a35c-626911db1ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:15.508310 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-5c42a039-7b2e-41cd-a35c-626911db1ee6 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:34:15.509533 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5c42a039-7b2e-41cd-a35c-626911db1ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:34:15.517715 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 733/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 9 04:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:34:15.555856 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ade40-101b-48a4-86a8-55438a7161dd None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:34:15.566151 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ade40-101b-48a4-86a8-55438a7161dd None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:34:15.569556 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dfab9-6fc2-4ca3-bf9a-9d7bb54133f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:34:15.570178 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dfab9-6fc2-4ca3-bf9a-9d7bb54133f0 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:15.570458 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dfab9-6fc2-4ca3-bf9a-9d7bb54133f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:15.570732 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dfab9-6fc2-4ca3-bf9a-9d7bb54133f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:15.579936 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11dfab9-6fc2-4ca3-bf9a-9d7bb54133f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:34:15.581384 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11dfab9-6fc2-4ca3-bf9a-9d7bb54133f0 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:34:15.591107 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 723/1456] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:34:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:34:17.844655 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3d3b2-d7ec-4a01-9465-bc5411ef13a8 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:17.845228 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3d3b2-d7ec-4a01-9465-bc5411ef13a8 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:17.845228 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3d3b2-d7ec-4a01-9465-bc5411ef13a8 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:17.846934 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 734/1457] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 9 04:34:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:34:17.852239 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081268e9-a314-4073-858c-e9736c9db0be None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:17.852678 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081268e9-a314-4073-858c-e9736c9db0be None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:17.852785 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081268e9-a314-4073-858c-e9736c9db0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:17.870564 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-081268e9-a314-4073-858c-e9736c9db0be None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:34:17.872242 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-081268e9-a314-4073-858c-e9736c9db0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:34:17.879712 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 724/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 9 04:34:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:34:17.917956 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3d3b2-d7ec-4a01-9465-bc5411ef13a8 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:34:17.928315 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3d3b2-d7ec-4a01-9465-bc5411ef13a8 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:34:17.931746 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1125e5-4762-41ac-b36b-0597a26f0f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:34:17.932368 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1125e5-4762-41ac-b36b-0597a26f0f18 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:17.932646 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1125e5-4762-41ac-b36b-0597a26f0f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:17.932918 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1125e5-4762-41ac-b36b-0597a26f0f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:17.942085 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1125e5-4762-41ac-b36b-0597a26f0f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:34:17.943536 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1125e5-4762-41ac-b36b-0597a26f0f18 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:34:17.953090 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 735/1459] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:34:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:34:20.194535 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226af8d0-17a9-4164-a828-dfac8d62d1d8 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:20.195074 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226af8d0-17a9-4164-a828-dfac8d62d1d8 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:20.195074 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226af8d0-17a9-4164-a828-dfac8d62d1d8 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:20.196887 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 725/1460] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 9 04:34:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:34:20.202267 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47b55d-fbfa-4827-9bfd-d52d37f76b28 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:20.202693 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47b55d-fbfa-4827-9bfd-d52d37f76b28 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:20.202840 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47b55d-fbfa-4827-9bfd-d52d37f76b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:20.220747 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-4c47b55d-fbfa-4827-9bfd-d52d37f76b28 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:34:20.222188 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-4c47b55d-fbfa-4827-9bfd-d52d37f76b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:34:20.230899 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 736/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 9 04:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:34:20.267763 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226af8d0-17a9-4164-a828-dfac8d62d1d8 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:34:20.278964 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226af8d0-17a9-4164-a828-dfac8d62d1d8 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:34:20.282437 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722724c3-a2ef-4f48-b8fb-726f81a71919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:34:20.283060 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722724c3-a2ef-4f48-b8fb-726f81a71919 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:20.283343 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722724c3-a2ef-4f48-b8fb-726f81a71919 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:20.283620 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722724c3-a2ef-4f48-b8fb-726f81a71919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:20.292212 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722724c3-a2ef-4f48-b8fb-726f81a71919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:34:20.294321 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722724c3-a2ef-4f48-b8fb-726f81a71919 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:34:20.303347 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 726/1462] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:34:22.573852 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2f92b-34bc-45fd-a20d-fea9088050cb None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:22.574388 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2f92b-34bc-45fd-a20d-fea9088050cb None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:22.574493 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2f92b-34bc-45fd-a20d-fea9088050cb None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:22.576796 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 737/1463] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 9 04:34:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:34:22.582789 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35c073-2eaf-4770-9c60-8bbb7355760b None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:22.583252 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35c073-2eaf-4770-9c60-8bbb7355760b None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:22.583520 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e35c073-2eaf-4770-9c60-8bbb7355760b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:22.601623 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-9e35c073-2eaf-4770-9c60-8bbb7355760b None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:34:22.602814 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-9e35c073-2eaf-4770-9c60-8bbb7355760b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:34:22.610482 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 727/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 9 04:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:34:22.647680 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2f92b-34bc-45fd-a20d-fea9088050cb None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:34:22.658727 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2f92b-34bc-45fd-a20d-fea9088050cb None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:34:22.662167 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85835160-4109-46f5-9ffe-c631c678dfc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:34:22.662800 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85835160-4109-46f5-9ffe-c631c678dfc6 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:22.663083 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85835160-4109-46f5-9ffe-c631c678dfc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:22.663361 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85835160-4109-46f5-9ffe-c631c678dfc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:22.672341 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85835160-4109-46f5-9ffe-c631c678dfc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:34:22.673813 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85835160-4109-46f5-9ffe-c631c678dfc6 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:34:22.683113 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 738/1465] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:34:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:34:24.975298 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc5223-6b6d-44f8-9ddc-d27d791d34b4 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:24.975925 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc5223-6b6d-44f8-9ddc-d27d791d34b4 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:24.975925 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc5223-6b6d-44f8-9ddc-d27d791d34b4 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:24.977671 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 728/1466] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 9 04:34:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:34:24.983089 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d926c-814a-4542-9f00-4e5f4102282c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:24.983511 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d926c-814a-4542-9f00-4e5f4102282c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:24.983643 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d926c-814a-4542-9f00-4e5f4102282c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:25.002222 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-024d926c-814a-4542-9f00-4e5f4102282c None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:34:25.003394 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-024d926c-814a-4542-9f00-4e5f4102282c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:34:25.010824 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 739/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 9 04:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:34:25.047649 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc5223-6b6d-44f8-9ddc-d27d791d34b4 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:34:25.058023 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc5223-6b6d-44f8-9ddc-d27d791d34b4 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:34:25.061517 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7735471-74a8-469e-ab12-76006606cfb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:34:25.062130 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7735471-74a8-469e-ab12-76006606cfb1 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:25.062414 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7735471-74a8-469e-ab12-76006606cfb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:25.062692 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7735471-74a8-469e-ab12-76006606cfb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:25.071346 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7735471-74a8-469e-ab12-76006606cfb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:34:25.072766 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7735471-74a8-469e-ab12-76006606cfb1 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:34:25.082357 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 729/1468] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:34:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:34:27.290676 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aab52a-3ccf-4cae-8068-7b5b6758a0da None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:27.291605 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aab52a-3ccf-4cae-8068-7b5b6758a0da None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:27.291892 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aab52a-3ccf-4cae-8068-7b5b6758a0da None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:27.294242 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 740/1469] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 9 04:34:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:34:27.299563 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd01fc-4011-4f2d-8bce-d70d1f9f943d None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:27.299966 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd01fc-4011-4f2d-8bce-d70d1f9f943d None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:27.300112 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd01fc-4011-4f2d-8bce-d70d1f9f943d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:27.318060 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-7ecd01fc-4011-4f2d-8bce-d70d1f9f943d None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:34:27.319232 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7ecd01fc-4011-4f2d-8bce-d70d1f9f943d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:34:27.326897 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 730/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 9 04:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:34:27.362947 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aab52a-3ccf-4cae-8068-7b5b6758a0da None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:34:27.373940 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aab52a-3ccf-4cae-8068-7b5b6758a0da None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:34:27.377382 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d5d24-0336-4637-863a-fa4c074be60f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:34:27.378009 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d5d24-0336-4637-863a-fa4c074be60f service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:27.378288 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d5d24-0336-4637-863a-fa4c074be60f service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:27.378564 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d5d24-0336-4637-863a-fa4c074be60f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:27.387089 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d5d24-0336-4637-863a-fa4c074be60f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:34:27.388551 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d5d24-0336-4637-863a-fa4c074be60f service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:34:27.397584 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 741/1471] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:34:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:34:44.433306 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad513c-e9f0-4f9b-961e-d6dfd2cef15b None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:44.433883 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad513c-e9f0-4f9b-961e-d6dfd2cef15b None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:44.433883 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad513c-e9f0-4f9b-961e-d6dfd2cef15b None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:44.435556 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 731/1472] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:34:44.440830 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058ea05-c5c2-472a-be5c-acb294ad47ee None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:44.441298 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058ea05-c5c2-472a-be5c-acb294ad47ee None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:44.441405 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058ea05-c5c2-472a-be5c-acb294ad47ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:44.460930 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2058ea05-c5c2-472a-be5c-acb294ad47ee None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:34:44.462389 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2058ea05-c5c2-472a-be5c-acb294ad47ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:34:44.470715 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 742/1473] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:34:44.516731 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7209f-ae9c-4a7c-bcda-246d515ac127 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:44.517047 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7209f-ae9c-4a7c-bcda-246d515ac127 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:44.517332 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7209f-ae9c-4a7c-bcda-246d515ac127 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:44.519123 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 732/1474] 10.222.0.36 () {54 vars in 962 bytes} [Wed Feb 9 04:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:34:44.523980 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab0aaa-afe0-4b0d-bb82-6dce70f48f34 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:44.524299 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab0aaa-afe0-4b0d-bb82-6dce70f48f34 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:44.524577 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab0aaa-afe0-4b0d-bb82-6dce70f48f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:44.543071 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-c1ab0aaa-afe0-4b0d-bb82-6dce70f48f34 None None] MFA Rules not processed for user `6940472eb8e544c8aa3409328c804282`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:34:44.544270 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c1ab0aaa-afe0-4b0d-bb82-6dce70f48f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:34:44.550782 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 743/1475] 10.222.0.36 () {58 vars in 1059 bytes} [Wed Feb 9 04:34:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:34:44.557931 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7209f-ae9c-4a7c-bcda-246d515ac127 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:34:44.568279 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7209f-ae9c-4a7c-bcda-246d515ac127 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:34:44.571813 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2927d6-c6a9-488e-9cad-d7a036454201 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6940472eb8e544c8aa3409328c804282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:34:44.572440 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2927d6-c6a9-488e-9cad-d7a036454201 service glance] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:44.572724 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2927d6-c6a9-488e-9cad-d7a036454201 service glance] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:44.573019 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2927d6-c6a9-488e-9cad-d7a036454201 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:44.582345 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2927d6-c6a9-488e-9cad-d7a036454201 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:34:44.583770 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2927d6-c6a9-488e-9cad-d7a036454201 service glance] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:34:44.593528 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 733/1476] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:34:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:34:46.912054 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4fe48-b3a3-4367-9967-84513cb67d52 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:46.912584 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4fe48-b3a3-4367-9967-84513cb67d52 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:46.912584 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4fe48-b3a3-4367-9967-84513cb67d52 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:46.914342 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 744/1477] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:34:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:34:46.919821 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3fbdc-88c5-4adb-a26a-f0b8fbbe5fb0 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:46.920246 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3fbdc-88c5-4adb-a26a-f0b8fbbe5fb0 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:46.920372 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3fbdc-88c5-4adb-a26a-f0b8fbbe5fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:46.937649 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-4ad3fbdc-88c5-4adb-a26a-f0b8fbbe5fb0 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:34:46.938816 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-4ad3fbdc-88c5-4adb-a26a-f0b8fbbe5fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:34:46.946369 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 734/1478] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:34:46.971512 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4fe48-b3a3-4367-9967-84513cb67d52 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:34:46.984141 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4fe48-b3a3-4367-9967-84513cb67d52 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:34:46.988449 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bee34-4624-4d3b-bcb6-0c760f14947e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:34:46.989121 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bee34-4624-4d3b-bcb6-0c760f14947e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:46.989407 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bee34-4624-4d3b-bcb6-0c760f14947e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:46.989688 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bee34-4624-4d3b-bcb6-0c760f14947e admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:46.990423 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bee34-4624-4d3b-bcb6-0c760f14947e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:34:46.992273 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bee34-4624-4d3b-bcb6-0c760f14947e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:34:47.005990 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 745/1479] 10.222.0.36 () {56 vars in 1108 bytes} [Wed Feb 9 04:34:46 2022] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:34:49.252479 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad3813-5130-445c-92e3-50009f4da5bf None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:49.253069 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad3813-5130-445c-92e3-50009f4da5bf None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:49.253069 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad3813-5130-445c-92e3-50009f4da5bf None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:49.254818 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 735/1480] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:34:49.260014 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb6422-6316-407a-b114-e81f8777c584 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:49.260446 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb6422-6316-407a-b114-e81f8777c584 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:49.260598 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb6422-6316-407a-b114-e81f8777c584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:49.278262 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-31fb6422-6316-407a-b114-e81f8777c584 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:34:49.279436 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-31fb6422-6316-407a-b114-e81f8777c584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:34:49.287009 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 746/1481] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:34:49.328779 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad3813-5130-445c-92e3-50009f4da5bf None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:34:49.343123 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad3813-5130-445c-92e3-50009f4da5bf None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:34:49.348359 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b3cfd1-7d62-4fee-b4a3-2a91cde27702 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:34:49.348980 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3cfd1-7d62-4fee-b4a3-2a91cde27702 service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:49.349287 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3cfd1-7d62-4fee-b4a3-2a91cde27702 service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:49.349561 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b3cfd1-7d62-4fee-b4a3-2a91cde27702 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:49.357491 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3cfd1-7d62-4fee-b4a3-2a91cde27702 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:34:49.359099 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b3cfd1-7d62-4fee-b4a3-2a91cde27702 service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:34:49.368340 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 736/1482] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:34:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:34:51.744538 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e2bc5-5d57-43de-a96b-e5f7bab727ec None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:51.745135 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e2bc5-5d57-43de-a96b-e5f7bab727ec None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:51.745135 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e2bc5-5d57-43de-a96b-e5f7bab727ec None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:51.746937 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 747/1483] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:34:51.752292 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887fda2-a550-423a-b9b2-d6662cfcbce8 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:51.752732 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887fda2-a550-423a-b9b2-d6662cfcbce8 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:51.752873 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4887fda2-a550-423a-b9b2-d6662cfcbce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:51.771013 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-4887fda2-a550-423a-b9b2-d6662cfcbce8 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:34:51.772191 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-4887fda2-a550-423a-b9b2-d6662cfcbce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:34:51.780608 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 737/1484] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:34:51.816763 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e2bc5-5d57-43de-a96b-e5f7bab727ec None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:34:51.827432 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e2bc5-5d57-43de-a96b-e5f7bab727ec None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:34:51.830935 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7912c106-dcb0-4ad6-934b-2730a03cea67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:34:51.831578 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912c106-dcb0-4ad6-934b-2730a03cea67 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:51.831867 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912c106-dcb0-4ad6-934b-2730a03cea67 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:51.832143 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7912c106-dcb0-4ad6-934b-2730a03cea67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:51.842363 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912c106-dcb0-4ad6-934b-2730a03cea67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:34:51.843483 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7912c106-dcb0-4ad6-934b-2730a03cea67 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:34:51.854191 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 748/1485] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:34:54.112248 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c131823-ecb3-45e5-b52c-7605659115a5 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:54.112797 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c131823-ecb3-45e5-b52c-7605659115a5 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:54.112797 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c131823-ecb3-45e5-b52c-7605659115a5 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:54.114631 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 738/1486] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:34:54.119969 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36699e-16a8-4495-b983-4789d7c1d435 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:54.120385 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36699e-16a8-4495-b983-4789d7c1d435 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:54.120527 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36699e-16a8-4495-b983-4789d7c1d435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:54.137915 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-7a36699e-16a8-4495-b983-4789d7c1d435 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:34:54.139133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7a36699e-16a8-4495-b983-4789d7c1d435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:34:54.149312 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 749/1487] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:34:54.197610 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c131823-ecb3-45e5-b52c-7605659115a5 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:34:54.208509 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c131823-ecb3-45e5-b52c-7605659115a5 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:34:54.211996 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca3aec-0ab4-4001-9dbb-30c2ebf0e5f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:34:54.212623 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca3aec-0ab4-4001-9dbb-30c2ebf0e5f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:54.212904 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca3aec-0ab4-4001-9dbb-30c2ebf0e5f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:54.213220 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca3aec-0ab4-4001-9dbb-30c2ebf0e5f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:54.222525 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca3aec-0ab4-4001-9dbb-30c2ebf0e5f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:34:54.224000 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca3aec-0ab4-4001-9dbb-30c2ebf0e5f2 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:34:54.233167 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 739/1488] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:34:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:34:56.600587 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588a750-cf7d-483b-83e2-08da579749e9 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:56.601138 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588a750-cf7d-483b-83e2-08da579749e9 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:56.601246 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588a750-cf7d-483b-83e2-08da579749e9 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:56.602977 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 750/1489] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:34:56.608785 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f445d0-4e78-401a-bb42-9226e6c113ce None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:56.609230 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f445d0-4e78-401a-bb42-9226e6c113ce None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:56.609366 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f445d0-4e78-401a-bb42-9226e6c113ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:56.627071 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-e7f445d0-4e78-401a-bb42-9226e6c113ce None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:34:56.628240 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-e7f445d0-4e78-401a-bb42-9226e6c113ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:34:56.635773 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 740/1490] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:34:56.676069 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588a750-cf7d-483b-83e2-08da579749e9 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:34:56.687079 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588a750-cf7d-483b-83e2-08da579749e9 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:34:56.690563 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4e6c4-b3a8-48c2-b27e-86e034231b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:34:56.691194 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4e6c4-b3a8-48c2-b27e-86e034231b32 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:56.691487 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4e6c4-b3a8-48c2-b27e-86e034231b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:56.691769 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4e6c4-b3a8-48c2-b27e-86e034231b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:56.700511 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4e6c4-b3a8-48c2-b27e-86e034231b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:34:56.701977 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4e6c4-b3a8-48c2-b27e-86e034231b32 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:34:56.711062 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 751/1491] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:34:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:34:59.164023 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0418f4-f670-4d88-a4e8-6fa55b50b7b2 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:59.164602 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0418f4-f670-4d88-a4e8-6fa55b50b7b2 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:59.164602 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0418f4-f670-4d88-a4e8-6fa55b50b7b2 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:59.166368 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 741/1492] 10.222.0.36 () {54 vars in 926 bytes} [Wed Feb 9 04:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:34:59.171670 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bab4f0-1443-4868-8021-1c0f642c6570 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:59.172097 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bab4f0-1443-4868-8021-1c0f642c6570 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:59.172213 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bab4f0-1443-4868-8021-1c0f642c6570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:59.191232 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-19bab4f0-1443-4868-8021-1c0f642c6570 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:34:59.192431 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-19bab4f0-1443-4868-8021-1c0f642c6570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:34:59.201233 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 752/1493] 10.222.0.36 () {58 vars in 1023 bytes} [Wed Feb 9 04:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:34:59.242407 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0418f4-f670-4d88-a4e8-6fa55b50b7b2 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:34:59.253892 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0418f4-f670-4d88-a4e8-6fa55b50b7b2 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:34:59.257553 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162daf9d-d753-4810-961d-3f6ad5222d0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:34:59.258195 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162daf9d-d753-4810-961d-3f6ad5222d0a service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:34:59.258474 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162daf9d-d753-4810-961d-3f6ad5222d0a service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:34:59.258745 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162daf9d-d753-4810-961d-3f6ad5222d0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:34:59.268700 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162daf9d-d753-4810-961d-3f6ad5222d0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:34:59.270814 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162daf9d-d753-4810-961d-3f6ad5222d0a service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:34:59.281518 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 742/1494] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:34:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:36:36.859992 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bea04-9e51-4141-8266-db7585101111 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:36:36.860558 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bea04-9e51-4141-8266-db7585101111 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:36:36.860558 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bea04-9e51-4141-8266-db7585101111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:36:36.878105 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-c95bea04-9e51-4141-8266-db7585101111 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:36:36.879298 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c95bea04-9e51-4141-8266-db7585101111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:36:36.887640 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 753/1495] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:36:36.896253 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1364f5d-0dbc-47ab-b16b-9d662f0b6f75 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:36:36.896750 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1364f5d-0dbc-47ab-b16b-9d662f0b6f75 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:36:36.896860 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1364f5d-0dbc-47ab-b16b-9d662f0b6f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:36:36.915266 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-c1364f5d-0dbc-47ab-b16b-9d662f0b6f75 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:36:36.916453 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-c1364f5d-0dbc-47ab-b16b-9d662f0b6f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:36:36.924130 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 743/1496] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:36:36.928392 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bea04-9e51-4141-8266-db7585101111 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:36:36.938354 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bea04-9e51-4141-8266-db7585101111 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:36:36.942845 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475ecda-78db-4845-9f11-e9be625f1393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:36:36.943496 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ecda-78db-4845-9f11-e9be625f1393 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:36:36.943782 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ecda-78db-4845-9f11-e9be625f1393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:36:36.944063 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ecda-78db-4845-9f11-e9be625f1393 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:36:36.944806 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475ecda-78db-4845-9f11-e9be625f1393 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:36:36.945157 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475ecda-78db-4845-9f11-e9be625f1393 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:36:36.946765 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475ecda-78db-4845-9f11-e9be625f1393 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:36:36.958648 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 754/1497] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:36:36.966339 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1364f5d-0dbc-47ab-b16b-9d662f0b6f75 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:36:36.975248 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1364f5d-0dbc-47ab-b16b-9d662f0b6f75 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:36:36.979784 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e52c96-71b0-469a-89b2-893d23e66884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:36:36.980414 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e52c96-71b0-469a-89b2-893d23e66884 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:36:36.980699 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e52c96-71b0-469a-89b2-893d23e66884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:36:36.980976 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e52c96-71b0-469a-89b2-893d23e66884 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:36:36.981705 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e52c96-71b0-469a-89b2-893d23e66884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:36:36.983586 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e52c96-71b0-469a-89b2-893d23e66884 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:36:37.018375 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 744/1498] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:36:36 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:36:37.022387 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475ecda-78db-4845-9f11-e9be625f1393 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:36:37.032349 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475ecda-78db-4845-9f11-e9be625f1393 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:36:37.086464 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254097e9-d4d2-4c55-b075-44de8e7d13d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:36:37.087165 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254097e9-d4d2-4c55-b075-44de8e7d13d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:36:37.087476 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254097e9-d4d2-4c55-b075-44de8e7d13d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:36:37.087754 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254097e9-d4d2-4c55-b075-44de8e7d13d8 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:36:37.088464 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254097e9-d4d2-4c55-b075-44de8e7d13d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:36:37.090434 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254097e9-d4d2-4c55-b075-44de8e7d13d8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:36:37.108952 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 755/1499] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:36:37 2022] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:36:37.113224 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e52c96-71b0-469a-89b2-893d23e66884 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:36:37.123565 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e52c96-71b0-469a-89b2-893d23e66884 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:36:37.127978 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73eaa3f-a62d-4f2f-95bc-60e297dd9c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:36:37.128624 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73eaa3f-a62d-4f2f-95bc-60e297dd9c21 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:36:37.128899 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73eaa3f-a62d-4f2f-95bc-60e297dd9c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:36:37.129206 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73eaa3f-a62d-4f2f-95bc-60e297dd9c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:36:37.129965 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73eaa3f-a62d-4f2f-95bc-60e297dd9c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:36:37.131952 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73eaa3f-a62d-4f2f-95bc-60e297dd9c21 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:36:37.149847 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 745/1500] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:36:37.154373 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254097e9-d4d2-4c55-b075-44de8e7d13d8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:36:37.164188 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254097e9-d4d2-4c55-b075-44de8e7d13d8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:36:37.168687 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ecb0b3-65a1-40c5-8999-8fac90f816bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:36:37.169377 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecb0b3-65a1-40c5-8999-8fac90f816bd admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:36:37.169664 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecb0b3-65a1-40c5-8999-8fac90f816bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:36:37.169937 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ecb0b3-65a1-40c5-8999-8fac90f816bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:36:37.170668 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecb0b3-65a1-40c5-8999-8fac90f816bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:36:37.172281 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ecb0b3-65a1-40c5-8999-8fac90f816bd admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:36:37.185780 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 756/1501] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:36:37.189982 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73eaa3f-a62d-4f2f-95bc-60e297dd9c21 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:36:37.199689 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73eaa3f-a62d-4f2f-95bc-60e297dd9c21 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:36:37.204752 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18e9b8-261a-4c65-befb-c07fb27cd07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:36:37.205659 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18e9b8-261a-4c65-befb-c07fb27cd07c admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:36:37.205941 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18e9b8-261a-4c65-befb-c07fb27cd07c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:36:37.206217 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd18e9b8-261a-4c65-befb-c07fb27cd07c admin admin] PATH_INFO: `/v3/projects/41572ab40c814b688d27cf592caf54f3/users/2b33a75f190c49afb80715cf98dd21d0/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:36:37.220101 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18e9b8-261a-4c65-befb-c07fb27cd07c admin admin] RBAC: Authorizing `identity:create_grant(project_id=41572ab40c814b688d27cf592caf54f3, user_id=2b33a75f190c49afb80715cf98dd21d0, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:36:37.222810 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd18e9b8-261a-4c65-befb-c07fb27cd07c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:36:37.236164 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 746/1502] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:36:37 2022] PUT /identity/v3/projects/41572ab40c814b688d27cf592caf54f3/users/2b33a75f190c49afb80715cf98dd21d0/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:36:37.249786 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6597c30-e886-4eb7-839c-801c4fca10d6 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:36:37.250078 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6597c30-e886-4eb7-839c-801c4fca10d6 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:36:37.250385 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6597c30-e886-4eb7-839c-801c4fca10d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:36:37.276361 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-e6597c30-e886-4eb7-839c-801c4fca10d6 None None] MFA Rules not processed for user `2b33a75f190c49afb80715cf98dd21d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:36:37.277839 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e6597c30-e886-4eb7-839c-801c4fca10d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:36:37.337622 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 757/1503] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:36:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:36:37.348459 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18e9b8-261a-4c65-befb-c07fb27cd07c admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:36:37.413972 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd18e9b8-261a-4c65-befb-c07fb27cd07c admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:36:37.419160 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c68a1-6e19-4035-9174-053a5a1df3d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:36:37.420351 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c68a1-6e19-4035-9174-053a5a1df3d5 service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:36:37.420627 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c68a1-6e19-4035-9174-053a5a1df3d5 service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:36:37.420896 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c68a1-6e19-4035-9174-053a5a1df3d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:36:37.429702 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c68a1-6e19-4035-9174-053a5a1df3d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:36:37.431262 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c68a1-6e19-4035-9174-053a5a1df3d5 service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:36:37.440341 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 747/1504] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:36:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:36:37.506218 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08ad97-f076-4a58-8f9f-94af8c5204ec None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:36:37.506512 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08ad97-f076-4a58-8f9f-94af8c5204ec None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:36:37.506797 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08ad97-f076-4a58-8f9f-94af8c5204ec None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:36:37.508495 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 758/1505] 10.222.0.36 () {52 vars in 829 bytes} [Wed Feb 9 04:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:36:37.512105 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c68a1-6e19-4035-9174-053a5a1df3d5 service nova] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:36:37.570312 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c68a1-6e19-4035-9174-053a5a1df3d5 service nova] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:36:37.574839 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f144ad6-dfbb-4831-931b-06e5b6063784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:36:37.575710 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f144ad6-dfbb-4831-931b-06e5b6063784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:36:37.575989 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f144ad6-dfbb-4831-931b-06e5b6063784 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:36:37.576259 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f144ad6-dfbb-4831-931b-06e5b6063784 admin admin] PATH_INFO: `/v3/users/2b33a75f190c49afb80715cf98dd21d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:36:37.577467 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f144ad6-dfbb-4831-931b-06e5b6063784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b33a75f190c49afb80715cf98dd21d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:36:37.578468 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING py.warnings [None req-0f144ad6-dfbb-4831-931b-06e5b6063784 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:36:37.578468 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: warnings.warn(msg) Feb 09 04:36:37.578468 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: Feb 09 04:36:37.579680 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f144ad6-dfbb-4831-931b-06e5b6063784 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:36:37.640313 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0f144ad6-dfbb-4831-931b-06e5b6063784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b33a75f190c49afb80715cf98dd21d0'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:36:37.652580 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0f144ad6-dfbb-4831-931b-06e5b6063784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b33a75f190c49afb80715cf98dd21d0'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:36:37.653346 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0f144ad6-dfbb-4831-931b-06e5b6063784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b33a75f190c49afb80715cf98dd21d0'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:36:37.671540 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0f144ad6-dfbb-4831-931b-06e5b6063784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b33a75f190c49afb80715cf98dd21d0'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:36:37.680458 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0f144ad6-dfbb-4831-931b-06e5b6063784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b33a75f190c49afb80715cf98dd21d0'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:36:37.687179 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 748/1506] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:36:37 2022] DELETE /identity/v3/users/2b33a75f190c49afb80715cf98dd21d0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:36:37.691796 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aee507-2246-421d-a890-a353aee1b565 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:36:37.692113 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aee507-2246-421d-a890-a353aee1b565 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:36:37.692396 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aee507-2246-421d-a890-a353aee1b565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:36:37.709596 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-05aee507-2246-421d-a890-a353aee1b565 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:36:37.710771 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-05aee507-2246-421d-a890-a353aee1b565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:36:37.767217 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 759/1507] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:36:37.776506 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f144ad6-dfbb-4831-931b-06e5b6063784 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:36:37.778197 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-0f144ad6-dfbb-4831-931b-06e5b6063784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:36:37.834421 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f144ad6-dfbb-4831-931b-06e5b6063784 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:36:37.837989 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf9680-4783-4c28-aa39-2391e01e9a44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:36:37.838618 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf9680-4783-4c28-aa39-2391e01e9a44 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:36:37.838899 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf9680-4783-4c28-aa39-2391e01e9a44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:36:37.839171 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf9680-4783-4c28-aa39-2391e01e9a44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:36:37.848368 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf9680-4783-4c28-aa39-2391e01e9a44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:36:37.849821 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf9680-4783-4c28-aa39-2391e01e9a44 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:36:37.859480 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 749/1508] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:36:38.170073 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aee507-2246-421d-a890-a353aee1b565 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:36:38.171484 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-05aee507-2246-421d-a890-a353aee1b565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:36:38.182985 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aee507-2246-421d-a890-a353aee1b565 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:36:38.188356 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f58b5-2425-42fa-a006-7f7c0aefd6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:36:38.189249 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f58b5-2425-42fa-a006-7f7c0aefd6d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:36:38.189528 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f58b5-2425-42fa-a006-7f7c0aefd6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:36:38.189828 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f58b5-2425-42fa-a006-7f7c0aefd6d6 admin admin] PATH_INFO: `/v3/projects/41572ab40c814b688d27cf592caf54f3` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:36:38.190983 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f58b5-2425-42fa-a006-7f7c0aefd6d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41572ab40c814b688d27cf592caf54f3)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:36:38.192018 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-844f58b5-2425-42fa-a006-7f7c0aefd6d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:36:38.192018 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 09 04:36:38.192018 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: Feb 09 04:36:38.199439 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f58b5-2425-42fa-a006-7f7c0aefd6d6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:36:38.258088 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-844f58b5-2425-42fa-a006-7f7c0aefd6d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41572ab40c814b688d27cf592caf54f3', 'request_id': 'req-844f58b5-2425-42fa-a006-7f7c0aefd6d6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:36:38.271608 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-844f58b5-2425-42fa-a006-7f7c0aefd6d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41572ab40c814b688d27cf592caf54f3', 'request_id': 'req-844f58b5-2425-42fa-a006-7f7c0aefd6d6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:36:38.281655 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-844f58b5-2425-42fa-a006-7f7c0aefd6d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41572ab40c814b688d27cf592caf54f3', 'request_id': 'req-844f58b5-2425-42fa-a006-7f7c0aefd6d6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:36:38.292099 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-844f58b5-2425-42fa-a006-7f7c0aefd6d6 admin admin] The token cache is being invalidate because project 41572ab40c814b688d27cf592caf54f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:36:38.292383 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-844f58b5-2425-42fa-a006-7f7c0aefd6d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:36:38.293111 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-844f58b5-2425-42fa-a006-7f7c0aefd6d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:36:38.294710 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 760/1509] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:36:38 2022] DELETE /identity/v3/projects/41572ab40c814b688d27cf592caf54f3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:38:04.693430 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526ec77-3e88-476d-b211-fe26c8b18d6a None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:04.694020 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526ec77-3e88-476d-b211-fe26c8b18d6a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:04.694020 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526ec77-3e88-476d-b211-fe26c8b18d6a None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:04.695743 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 750/1510] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 9 04:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:38:04.700622 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659afebc-d983-4d37-b7c9-6f07135f3077 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:04.701090 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659afebc-d983-4d37-b7c9-6f07135f3077 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:04.701208 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659afebc-d983-4d37-b7c9-6f07135f3077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:04.720140 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-659afebc-d983-4d37-b7c9-6f07135f3077 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:38:04.721350 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-659afebc-d983-4d37-b7c9-6f07135f3077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:38:04.775723 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 761/1511] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 9 04:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:38:04.929637 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526ec77-3e88-476d-b211-fe26c8b18d6a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:38:04.931281 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-a526ec77-3e88-476d-b211-fe26c8b18d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:38:05.005398 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526ec77-3e88-476d-b211-fe26c8b18d6a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:38:05.010758 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be6701-55e1-4447-9e91-5c0f66b84a49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:38:05.011406 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be6701-55e1-4447-9e91-5c0f66b84a49 service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:05.011725 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be6701-55e1-4447-9e91-5c0f66b84a49 service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:05.012002 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be6701-55e1-4447-9e91-5c0f66b84a49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:05.020984 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be6701-55e1-4447-9e91-5c0f66b84a49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:38:05.022619 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be6701-55e1-4447-9e91-5c0f66b84a49 service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:38:05.034147 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 751/1512] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:38:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:38:06.002354 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978b122-6415-476a-89cd-205a2f2f275b None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:06.002977 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978b122-6415-476a-89cd-205a2f2f275b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:06.003368 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978b122-6415-476a-89cd-205a2f2f275b None None] PATH_INFO: `/v3` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:06.005421 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 762/1513] 10.222.0.47 () {54 vars in 925 bytes} [Wed Feb 9 04:38:06 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:38:06.012121 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3955f-9591-41ce-8f93-ac7fc931b88c None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:06.012616 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3955f-9591-41ce-8f93-ac7fc931b88c None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:06.012712 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce3955f-9591-41ce-8f93-ac7fc931b88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:06.031710 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-5ce3955f-9591-41ce-8f93-ac7fc931b88c None None] MFA Rules not processed for user `add56fc0cfd8403b86c5ef23fd374a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:38:06.033314 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-5ce3955f-9591-41ce-8f93-ac7fc931b88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:38:06.106939 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 752/1514] 10.222.0.47 () {58 vars in 1015 bytes} [Wed Feb 9 04:38:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:38:06.339283 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eccd2e-9176-42d7-9a5f-a2d2c5c534d0 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:06.339496 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eccd2e-9176-42d7-9a5f-a2d2c5c534d0 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:06.339750 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eccd2e-9176-42d7-9a5f-a2d2c5c534d0 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:06.341598 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 763/1515] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 9 04:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:38:06.347071 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fee5ab-cbbb-4e6e-a9c9-d17e235131c5 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:06.347364 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fee5ab-cbbb-4e6e-a9c9-d17e235131c5 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:06.347643 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fee5ab-cbbb-4e6e-a9c9-d17e235131c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:06.365656 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-35fee5ab-cbbb-4e6e-a9c9-d17e235131c5 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:38:06.366822 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-35fee5ab-cbbb-4e6e-a9c9-d17e235131c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:38:06.374603 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 753/1516] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 9 04:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:38:06.525131 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eccd2e-9176-42d7-9a5f-a2d2c5c534d0 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:38:06.539478 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eccd2e-9176-42d7-9a5f-a2d2c5c534d0 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:38:06.544916 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196f2c5-2366-475f-9a3e-8e781a112c4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:38:06.545578 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196f2c5-2366-475f-9a3e-8e781a112c4a service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:06.545862 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196f2c5-2366-475f-9a3e-8e781a112c4a service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:06.546138 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196f2c5-2366-475f-9a3e-8e781a112c4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:06.554316 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196f2c5-2366-475f-9a3e-8e781a112c4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:38:06.555913 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196f2c5-2366-475f-9a3e-8e781a112c4a service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:38:06.565631 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 764/1517] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:38:10.015476 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df30d88-e23f-4e7c-8232-8d037ce93f82 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:10.016062 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df30d88-e23f-4e7c-8232-8d037ce93f82 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:10.016062 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df30d88-e23f-4e7c-8232-8d037ce93f82 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:10.017839 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 754/1518] 10.222.0.36 () {54 vars in 960 bytes} [Wed Feb 9 04:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:38:10.022795 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c114e-c5ca-43f8-a421-b6e46c99f9ca None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:10.023222 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c114e-c5ca-43f8-a421-b6e46c99f9ca None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:10.023386 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c114e-c5ca-43f8-a421-b6e46c99f9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:10.041479 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-581c114e-c5ca-43f8-a421-b6e46c99f9ca None None] MFA Rules not processed for user `add56fc0cfd8403b86c5ef23fd374a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:38:10.042684 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-581c114e-c5ca-43f8-a421-b6e46c99f9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:38:10.052026 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 765/1519] 10.222.0.36 () {58 vars in 1057 bytes} [Wed Feb 9 04:38:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:38:10.059170 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df30d88-e23f-4e7c-8232-8d037ce93f82 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:38:10.072689 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df30d88-e23f-4e7c-8232-8d037ce93f82 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:38:10.077575 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33924950-b478-4161-84d4-34469f4e341a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add56fc0cfd8403b86c5ef23fd374a5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:38:10.078202 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33924950-b478-4161-84d4-34469f4e341a service placement] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:10.078486 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33924950-b478-4161-84d4-34469f4e341a service placement] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:10.078763 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33924950-b478-4161-84d4-34469f4e341a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:10.086969 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33924950-b478-4161-84d4-34469f4e341a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:38:10.088540 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33924950-b478-4161-84d4-34469f4e341a service placement] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:38:10.098467 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 755/1520] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:38:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:38:18.261013 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bf59c-8023-4633-a336-2b9e7f1d70f5 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:18.261549 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bf59c-8023-4633-a336-2b9e7f1d70f5 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:18.261671 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43bf59c-8023-4633-a336-2b9e7f1d70f5 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:18.263344 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 766/1521] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 9 04:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:38:18.268382 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48595c-c1e1-46f2-bae9-3149f36a086c None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:18.268817 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48595c-c1e1-46f2-bae9-3149f36a086c None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:18.268966 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48595c-c1e1-46f2-bae9-3149f36a086c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:18.286737 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-0a48595c-c1e1-46f2-bae9-3149f36a086c None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:38:18.287916 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-0a48595c-c1e1-46f2-bae9-3149f36a086c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:38:18.295567 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 756/1522] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 9 04:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:38:18.448968 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bf59c-8023-4633-a336-2b9e7f1d70f5 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:38:18.462964 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43bf59c-8023-4633-a336-2b9e7f1d70f5 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:38:18.468255 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09a75e-c112-4f5d-83a4-eff86e9a0056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:38:18.468890 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09a75e-c112-4f5d-83a4-eff86e9a0056 service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:18.469209 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09a75e-c112-4f5d-83a4-eff86e9a0056 service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:18.469491 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09a75e-c112-4f5d-83a4-eff86e9a0056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:18.477409 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09a75e-c112-4f5d-83a4-eff86e9a0056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:38:18.478994 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09a75e-c112-4f5d-83a4-eff86e9a0056 service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:38:18.488806 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 767/1523] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:38:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:38:19.809905 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4e48c-e71b-4472-901c-329253777b95 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:19.810429 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4e48c-e71b-4472-901c-329253777b95 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:19.810526 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4e48c-e71b-4472-901c-329253777b95 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:19.812265 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 757/1524] 127.0.0.1 () {54 vars in 901 bytes} [Wed Feb 9 04:38:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:38:19.817124 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3c642-c578-466a-bc4b-5c326beb2e8c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:19.817565 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3c642-c578-466a-bc4b-5c326beb2e8c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:19.817672 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3c642-c578-466a-bc4b-5c326beb2e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:19.835802 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-b1c3c642-c578-466a-bc4b-5c326beb2e8c None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:38:19.837466 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b1c3c642-c578-466a-bc4b-5c326beb2e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:38:19.850105 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 768/1525] 127.0.0.1 () {58 vars in 998 bytes} [Wed Feb 9 04:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:38:20.002343 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4e48c-e71b-4472-901c-329253777b95 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:38:20.016873 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4e48c-e71b-4472-901c-329253777b95 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:38:20.022169 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09cd71-a9e2-48ad-9f36-dabe48adeba7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:38:20.022798 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09cd71-a9e2-48ad-9f36-dabe48adeba7 service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:20.023081 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09cd71-a9e2-48ad-9f36-dabe48adeba7 service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:20.023358 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09cd71-a9e2-48ad-9f36-dabe48adeba7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:20.031427 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09cd71-a9e2-48ad-9f36-dabe48adeba7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:38:20.032993 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09cd71-a9e2-48ad-9f36-dabe48adeba7 service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:38:20.042129 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 758/1526] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:38:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:38:24.225583 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fea6ae-77d1-4f58-a7fd-ad6367fc00ea None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:24.226098 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fea6ae-77d1-4f58-a7fd-ad6367fc00ea None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:24.226231 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fea6ae-77d1-4f58-a7fd-ad6367fc00ea None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:24.227892 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 769/1527] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 9 04:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:38:24.232971 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60b545-b7db-4cc3-beb6-50faa2984db2 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:24.233419 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60b545-b7db-4cc3-beb6-50faa2984db2 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:24.233567 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60b545-b7db-4cc3-beb6-50faa2984db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:24.252627 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-fd60b545-b7db-4cc3-beb6-50faa2984db2 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:38:24.253870 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-fd60b545-b7db-4cc3-beb6-50faa2984db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:38:24.261611 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 759/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 9 04:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:38:24.298509 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fea6ae-77d1-4f58-a7fd-ad6367fc00ea None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:38:24.300154 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c5fea6ae-77d1-4f58-a7fd-ad6367fc00ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:38:24.354399 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fea6ae-77d1-4f58-a7fd-ad6367fc00ea None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:38:24.358012 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb09a42-da93-4531-8e2b-b58fc7d39a32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:38:24.358653 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb09a42-da93-4531-8e2b-b58fc7d39a32 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:24.358936 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb09a42-da93-4531-8e2b-b58fc7d39a32 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:24.359213 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb09a42-da93-4531-8e2b-b58fc7d39a32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:24.367989 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb09a42-da93-4531-8e2b-b58fc7d39a32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:38:24.369456 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb09a42-da93-4531-8e2b-b58fc7d39a32 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:38:24.378588 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 770/1529] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:38:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:38:26.567187 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e76e1-f6f1-42ca-a644-c25556cea472 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:26.567661 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e76e1-f6f1-42ca-a644-c25556cea472 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:26.567768 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e76e1-f6f1-42ca-a644-c25556cea472 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:26.569664 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 760/1530] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 9 04:38:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:38:26.574944 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714d75c-06d2-46bf-8bb4-56355d89abc2 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:26.575399 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714d75c-06d2-46bf-8bb4-56355d89abc2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:26.575570 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e714d75c-06d2-46bf-8bb4-56355d89abc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:26.593538 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-e714d75c-06d2-46bf-8bb4-56355d89abc2 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:38:26.595298 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e714d75c-06d2-46bf-8bb4-56355d89abc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:38:26.602859 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 771/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 9 04:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:38:26.637601 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e76e1-f6f1-42ca-a644-c25556cea472 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:38:26.648954 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e76e1-f6f1-42ca-a644-c25556cea472 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:38:26.652748 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1eda0-fc09-471a-8974-0ca495cfb023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:38:26.653413 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1eda0-fc09-471a-8974-0ca495cfb023 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:26.653693 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1eda0-fc09-471a-8974-0ca495cfb023 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:26.653970 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1eda0-fc09-471a-8974-0ca495cfb023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:26.663661 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1eda0-fc09-471a-8974-0ca495cfb023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:38:26.665099 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1eda0-fc09-471a-8974-0ca495cfb023 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:38:26.674144 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 761/1532] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:38:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:38:30.446125 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4e112-3cec-4fd3-af19-5dfedf42c0a0 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:30.446656 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4e112-3cec-4fd3-af19-5dfedf42c0a0 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:30.446656 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4e112-3cec-4fd3-af19-5dfedf42c0a0 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:30.448390 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 772/1533] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 9 04:38:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:38:30.453790 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8ce67-b1d3-45cc-af25-9fb56d15759c None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:30.454718 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8ce67-b1d3-45cc-af25-9fb56d15759c None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:30.454824 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8ce67-b1d3-45cc-af25-9fb56d15759c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:30.472786 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-97f8ce67-b1d3-45cc-af25-9fb56d15759c None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:38:30.474064 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-97f8ce67-b1d3-45cc-af25-9fb56d15759c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:38:30.481895 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 762/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 9 04:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:38:30.736721 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4e112-3cec-4fd3-af19-5dfedf42c0a0 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:38:30.738418 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b6b4e112-3cec-4fd3-af19-5dfedf42c0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:38:30.793024 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4e112-3cec-4fd3-af19-5dfedf42c0a0 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:38:30.796464 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244d42c-7622-4710-9940-70bd2e0e2d10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:38:30.797126 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244d42c-7622-4710-9940-70bd2e0e2d10 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:30.797905 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244d42c-7622-4710-9940-70bd2e0e2d10 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:30.798178 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244d42c-7622-4710-9940-70bd2e0e2d10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:30.806680 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244d42c-7622-4710-9940-70bd2e0e2d10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:38:30.808087 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244d42c-7622-4710-9940-70bd2e0e2d10 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:38:30.817669 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 773/1535] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:38:33.128375 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e3039-dbb2-4e24-ab7d-8537641f9917 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:33.128946 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e3039-dbb2-4e24-ab7d-8537641f9917 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:33.128946 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e3039-dbb2-4e24-ab7d-8537641f9917 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:33.130735 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 763/1536] 127.0.0.1 () {54 vars in 916 bytes} [Wed Feb 9 04:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:38:33.136052 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f8908-81ff-47b4-ab57-de5562221e04 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:33.136478 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f8908-81ff-47b4-ab57-de5562221e04 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:33.136606 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f8908-81ff-47b4-ab57-de5562221e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:33.154801 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-108f8908-81ff-47b4-ab57-de5562221e04 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:38:33.156005 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-108f8908-81ff-47b4-ab57-de5562221e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:38:33.163756 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 774/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Feb 9 04:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:38:33.417313 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ecb24-0089-426e-9de6-91a90834379a None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:33.417606 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ecb24-0089-426e-9de6-91a90834379a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:33.417840 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ecb24-0089-426e-9de6-91a90834379a None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:33.419603 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 764/1538] 10.222.0.36 () {54 vars in 963 bytes} [Wed Feb 9 04:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:38:33.424522 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e5d6a-b4b3-4fea-87f8-4e670051c803 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:33.424817 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e5d6a-b4b3-4fea-87f8-4e670051c803 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:33.425139 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e5d6a-b4b3-4fea-87f8-4e670051c803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:33.444594 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-6a3e5d6a-b4b3-4fea-87f8-4e670051c803 None None] MFA Rules not processed for user `c2856d2356604d8192c8772e33c85d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:38:33.445817 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6a3e5d6a-b4b3-4fea-87f8-4e670051c803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:38:33.452147 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 775/1539] 10.222.0.36 () {58 vars in 1060 bytes} [Wed Feb 9 04:38:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:38:33.460291 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ecb24-0089-426e-9de6-91a90834379a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:38:33.470652 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ecb24-0089-426e-9de6-91a90834379a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:38:33.474116 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f22be1-49d4-4c2c-aabf-02806e710496 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:38:33.474741 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f22be1-49d4-4c2c-aabf-02806e710496 service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:38:33.475024 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f22be1-49d4-4c2c-aabf-02806e710496 service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:38:33.475301 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f22be1-49d4-4c2c-aabf-02806e710496 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:38:33.483902 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f22be1-49d4-4c2c-aabf-02806e710496 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:38:33.485340 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f22be1-49d4-4c2c-aabf-02806e710496 service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:38:33.494460 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 765/1540] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:39:54.894885 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0c4e7-2080-4ecb-a2d9-1fadcdc948b6 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:54.896178 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0c4e7-2080-4ecb-a2d9-1fadcdc948b6 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:54.896178 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0c4e7-2080-4ecb-a2d9-1fadcdc948b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:54.917274 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-fec0c4e7-2080-4ecb-a2d9-1fadcdc948b6 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:54.918674 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fec0c4e7-2080-4ecb-a2d9-1fadcdc948b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:54.933022 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 776/1541] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:54.944550 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86d8a1-4650-4336-9fce-41d32e5ee65d None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:54.945468 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86d8a1-4650-4336-9fce-41d32e5ee65d None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:54.945917 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86d8a1-4650-4336-9fce-41d32e5ee65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:54.975940 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-fd86d8a1-4650-4336-9fce-41d32e5ee65d None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:54.977431 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-fd86d8a1-4650-4336-9fce-41d32e5ee65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:54.990930 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 766/1542] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:39:54.995707 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0c4e7-2080-4ecb-a2d9-1fadcdc948b6 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:55.009671 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0c4e7-2080-4ecb-a2d9-1fadcdc948b6 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:55.018079 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cf7b8-9a43-4972-8342-0e7d8a91839d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:55.018760 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cf7b8-9a43-4972-8342-0e7d8a91839d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:55.019046 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cf7b8-9a43-4972-8342-0e7d8a91839d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:55.019352 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cf7b8-9a43-4972-8342-0e7d8a91839d admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:55.020101 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cf7b8-9a43-4972-8342-0e7d8a91839d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:39:55.020604 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cf7b8-9a43-4972-8342-0e7d8a91839d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:55.022264 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cf7b8-9a43-4972-8342-0e7d8a91839d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:55.044745 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 777/1543] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:39:55.053547 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86d8a1-4650-4336-9fce-41d32e5ee65d None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:55.063134 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86d8a1-4650-4336-9fce-41d32e5ee65d None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:55.073463 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25c156-6822-4fff-ba4a-50585d6cbab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:55.074376 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25c156-6822-4fff-ba4a-50585d6cbab8 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:55.074862 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25c156-6822-4fff-ba4a-50585d6cbab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:55.075327 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e25c156-6822-4fff-ba4a-50585d6cbab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:55.076244 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25c156-6822-4fff-ba4a-50585d6cbab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:55.078376 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e25c156-6822-4fff-ba4a-50585d6cbab8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:55.115782 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 767/1544] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:39:55 2022] POST /identity/v3/projects => generated 393 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:39:55.120475 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cf7b8-9a43-4972-8342-0e7d8a91839d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:55.134363 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cf7b8-9a43-4972-8342-0e7d8a91839d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:55.219219 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0a555-dcf2-4c02-8cb4-ed65a39fcfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:55.219799 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0a555-dcf2-4c02-8cb4-ed65a39fcfb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:55.220087 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0a555-dcf2-4c02-8cb4-ed65a39fcfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:55.220366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0a555-dcf2-4c02-8cb4-ed65a39fcfb3 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:55.221096 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0a555-dcf2-4c02-8cb4-ed65a39fcfb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:55.223083 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0a555-dcf2-4c02-8cb4-ed65a39fcfb3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:55.254781 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 778/1545] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:39:55 2022] POST /identity/v3/users => generated 297 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:39:55.259674 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25c156-6822-4fff-ba4a-50585d6cbab8 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:55.281607 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e25c156-6822-4fff-ba4a-50585d6cbab8 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:55.291783 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec007ad-94ae-4422-8fb6-039501e9260c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:55.292451 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec007ad-94ae-4422-8fb6-039501e9260c admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:55.292730 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec007ad-94ae-4422-8fb6-039501e9260c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:55.293018 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec007ad-94ae-4422-8fb6-039501e9260c admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:55.293946 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec007ad-94ae-4422-8fb6-039501e9260c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:55.295568 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec007ad-94ae-4422-8fb6-039501e9260c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:55.312710 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 768/1546] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:39:55.317933 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0a555-dcf2-4c02-8cb4-ed65a39fcfb3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:55.336101 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0a555-dcf2-4c02-8cb4-ed65a39fcfb3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:55.344989 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e35266-2108-48bd-8d0e-8b2efa158c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:55.345698 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e35266-2108-48bd-8d0e-8b2efa158c15 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:55.346094 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e35266-2108-48bd-8d0e-8b2efa158c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:55.346378 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e35266-2108-48bd-8d0e-8b2efa158c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:55.347124 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e35266-2108-48bd-8d0e-8b2efa158c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:55.349177 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e35266-2108-48bd-8d0e-8b2efa158c15 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:55.363413 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 779/1547] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:39:55.368449 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec007ad-94ae-4422-8fb6-039501e9260c admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:55.387294 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec007ad-94ae-4422-8fb6-039501e9260c admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:55.393287 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c640a-99a4-4f53-b099-13a055f6fd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:55.394182 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c640a-99a4-4f53-b099-13a055f6fd31 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:55.395088 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c640a-99a4-4f53-b099-13a055f6fd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:55.395367 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c640a-99a4-4f53-b099-13a055f6fd31 admin admin] PATH_INFO: `/v3/projects/fe0573397e33469080b13d72e5da7438/users/b46db588a5ee4272a0ebdc24c4f5dab7/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:55.423477 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c640a-99a4-4f53-b099-13a055f6fd31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe0573397e33469080b13d72e5da7438, user_id=b46db588a5ee4272a0ebdc24c4f5dab7, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:55.426957 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c640a-99a4-4f53-b099-13a055f6fd31 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:55.449999 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 769/1548] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:39:55 2022] PUT /identity/v3/projects/fe0573397e33469080b13d72e5da7438/users/b46db588a5ee4272a0ebdc24c4f5dab7/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:39:55.455839 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3845c7-a999-4d29-8023-67733e566b74 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:55.456431 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3845c7-a999-4d29-8023-67733e566b74 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:55.456979 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3845c7-a999-4d29-8023-67733e566b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:55.482477 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2d3845c7-a999-4d29-8023-67733e566b74 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:55.484173 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2d3845c7-a999-4d29-8023-67733e566b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:55.559934 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 780/1549] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:39:55.572637 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c640a-99a4-4f53-b099-13a055f6fd31 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:55.626010 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d59df-d4e9-41f2-aebf-41dab6336fa5 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:55.626671 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d59df-d4e9-41f2-aebf-41dab6336fa5 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:55.626954 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d59df-d4e9-41f2-aebf-41dab6336fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:55.655519 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-366d59df-d4e9-41f2-aebf-41dab6336fa5 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:55.656859 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-366d59df-d4e9-41f2-aebf-41dab6336fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:55.669613 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c640a-99a4-4f53-b099-13a055f6fd31 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:55.670772 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 781/1550] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:55.678923 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e500cb7-4ef6-476e-ba8e-15b6bfd87bc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:55.679588 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e500cb7-4ef6-476e-ba8e-15b6bfd87bc8 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:55.679871 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e500cb7-4ef6-476e-ba8e-15b6bfd87bc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:55.680151 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e500cb7-4ef6-476e-ba8e-15b6bfd87bc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:55.682514 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15791780-3d02-4e04-9c86-20e18f36658b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:55.682920 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15791780-3d02-4e04-9c86-20e18f36658b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:55.683201 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15791780-3d02-4e04-9c86-20e18f36658b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:55.700803 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e500cb7-4ef6-476e-ba8e-15b6bfd87bc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:55.702627 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e500cb7-4ef6-476e-ba8e-15b6bfd87bc8 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:55.705169 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-15791780-3d02-4e04-9c86-20e18f36658b None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:55.706362 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-15791780-3d02-4e04-9c86-20e18f36658b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:55.724750 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 782/1551] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:39:55.724972 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 770/1552] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:39:55.729715 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e500cb7-4ef6-476e-ba8e-15b6bfd87bc8 service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:55.741122 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5cdb7-0c4a-434c-9866-e0da3076ad7d None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:55.741122 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5cdb7-0c4a-434c-9866-e0da3076ad7d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:55.741122 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5cdb7-0c4a-434c-9866-e0da3076ad7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:55.756326 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e500cb7-4ef6-476e-ba8e-15b6bfd87bc8 service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:55.771459 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-55d5cdb7-0c4a-434c-9866-e0da3076ad7d None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:55.772752 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-55d5cdb7-0c4a-434c-9866-e0da3076ad7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:55.774781 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229bd2c-9993-4c9a-a21e-80882caa3aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:55.775743 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229bd2c-9993-4c9a-a21e-80882caa3aab admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:55.776078 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229bd2c-9993-4c9a-a21e-80882caa3aab admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:55.776363 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229bd2c-9993-4c9a-a21e-80882caa3aab admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:55.781041 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229bd2c-9993-4c9a-a21e-80882caa3aab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:39:55.781041 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229bd2c-9993-4c9a-a21e-80882caa3aab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:55.781041 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229bd2c-9993-4c9a-a21e-80882caa3aab admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:55.793179 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 783/1553] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:55.804979 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcbec6-91fe-4760-8a6a-996b82b152c3 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:55.804979 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcbec6-91fe-4760-8a6a-996b82b152c3 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:55.804979 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcbec6-91fe-4760-8a6a-996b82b152c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:55.808529 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 771/1554] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:39:55.829384 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229bd2c-9993-4c9a-a21e-80882caa3aab admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:55.840494 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d7dcbec6-91fe-4760-8a6a-996b82b152c3 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:55.841745 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d7dcbec6-91fe-4760-8a6a-996b82b152c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:55.852937 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229bd2c-9993-4c9a-a21e-80882caa3aab admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:55.865566 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb5a47-10fb-4c36-aef5-e54250cceac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:55.866158 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb5a47-10fb-4c36-aef5-e54250cceac7 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:55.866446 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb5a47-10fb-4c36-aef5-e54250cceac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:55.866725 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cb5a47-10fb-4c36-aef5-e54250cceac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:55.867494 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb5a47-10fb-4c36-aef5-e54250cceac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:55.877035 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cb5a47-10fb-4c36-aef5-e54250cceac7 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:55.891973 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 784/1555] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:39:55.898026 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcbec6-91fe-4760-8a6a-996b82b152c3 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:55.928502 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcbec6-91fe-4760-8a6a-996b82b152c3 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:55.947223 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15324248-df52-46af-b392-b8607f9fabc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:55.947223 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15324248-df52-46af-b392-b8607f9fabc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:55.947223 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15324248-df52-46af-b392-b8607f9fabc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:55.947223 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15324248-df52-46af-b392-b8607f9fabc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:55.947632 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15324248-df52-46af-b392-b8607f9fabc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:39:55.947632 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15324248-df52-46af-b392-b8607f9fabc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:55.948671 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15324248-df52-46af-b392-b8607f9fabc2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:55.961966 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 772/1556] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:39:55 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:39:55.973089 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb5a47-10fb-4c36-aef5-e54250cceac7 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:55.976520 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 785/1557] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:39:55.985432 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15324248-df52-46af-b392-b8607f9fabc2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:56.022351 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15324248-df52-46af-b392-b8607f9fabc2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:56.140933 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20667174-62e0-414d-a27c-b42ce5cb534f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:56.141673 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20667174-62e0-414d-a27c-b42ce5cb534f admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.141932 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20667174-62e0-414d-a27c-b42ce5cb534f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.142209 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20667174-62e0-414d-a27c-b42ce5cb534f admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.142914 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20667174-62e0-414d-a27c-b42ce5cb534f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:56.144887 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20667174-62e0-414d-a27c-b42ce5cb534f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:56.163092 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cb5a47-10fb-4c36-aef5-e54250cceac7 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:56.179711 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dfc45-4d17-4272-a46a-ccc15a849a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:56.180592 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dfc45-4d17-4272-a46a-ccc15a849a5c admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.181494 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dfc45-4d17-4272-a46a-ccc15a849a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.181783 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dfc45-4d17-4272-a46a-ccc15a849a5c admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.182510 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21dfc45-4d17-4272-a46a-ccc15a849a5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:56.184873 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21dfc45-4d17-4272-a46a-ccc15a849a5c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:56.204433 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 786/1558] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:39:55 2022] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:39:56.204433 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b8503-5ec2-499c-bc04-10d184ac5694 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.204433 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b8503-5ec2-499c-bc04-10d184ac5694 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.204433 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b8503-5ec2-499c-bc04-10d184ac5694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.210705 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 773/1559] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:39:55 2022] POST /identity/v3/users => generated 293 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:39:56.212241 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36d5e4-cd34-4cdc-828d-756d7b4f75a3 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.212630 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36d5e4-cd34-4cdc-828d-756d7b4f75a3 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.213022 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36d5e4-cd34-4cdc-828d-756d7b4f75a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.225920 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ef5b8503-5ec2-499c-bc04-10d184ac5694 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:56.227640 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ef5b8503-5ec2-499c-bc04-10d184ac5694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:56.237293 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-6e36d5e4-cd34-4cdc-828d-756d7b4f75a3 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:56.239462 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-6e36d5e4-cd34-4cdc-828d-756d7b4f75a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:56.307963 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 787/1560] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:56.309338 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bbbb4-b94b-4639-a80c-cc08cda3515b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.309626 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bbbb4-b94b-4639-a80c-cc08cda3515b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.309902 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bbbb4-b94b-4639-a80c-cc08cda3515b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.319011 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 774/1561] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:56.325288 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f86467-40e6-4c02-b9f2-15ec661bcb7a None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.325288 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f86467-40e6-4c02-b9f2-15ec661bcb7a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.325288 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f86467-40e6-4c02-b9f2-15ec661bcb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.334382 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-df7bbbb4-b94b-4639-a80c-cc08cda3515b None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:56.335660 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-df7bbbb4-b94b-4639-a80c-cc08cda3515b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:56.343276 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-19f86467-40e6-4c02-b9f2-15ec661bcb7a None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:56.344377 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-19f86467-40e6-4c02-b9f2-15ec661bcb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:56.349193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 788/1562] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:56.349193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974a38c-77fe-4a4e-9336-6d00726f2661 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.349193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974a38c-77fe-4a4e-9336-6d00726f2661 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.349193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974a38c-77fe-4a4e-9336-6d00726f2661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.357942 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 775/1563] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:56.367329 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f86467-40e6-4c02-b9f2-15ec661bcb7a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:56.374301 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-7974a38c-77fe-4a4e-9336-6d00726f2661 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:56.375881 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7974a38c-77fe-4a4e-9336-6d00726f2661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:56.376942 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f86467-40e6-4c02-b9f2-15ec661bcb7a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:56.381522 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfa782-757a-4db5-a665-1a0fbbccbec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:56.382532 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfa782-757a-4db5-a665-1a0fbbccbec5 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.382532 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfa782-757a-4db5-a665-1a0fbbccbec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.382756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfa782-757a-4db5-a665-1a0fbbccbec5 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.383389 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfa782-757a-4db5-a665-1a0fbbccbec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:56.385326 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 789/1564] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:56.385484 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfa782-757a-4db5-a665-1a0fbbccbec5 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:56.394758 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974a38c-77fe-4a4e-9336-6d00726f2661 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:56.405360 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974a38c-77fe-4a4e-9336-6d00726f2661 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:56.411004 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660a21f-c060-4e22-9d81-2412774a30df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:56.411780 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660a21f-c060-4e22-9d81-2412774a30df admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.412175 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660a21f-c060-4e22-9d81-2412774a30df admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.412521 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660a21f-c060-4e22-9d81-2412774a30df admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.413393 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660a21f-c060-4e22-9d81-2412774a30df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:56.415100 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660a21f-c060-4e22-9d81-2412774a30df admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:56.417416 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 776/1565] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:39:56 2022] POST /identity/v3/users => generated 292 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:39:56.418737 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09dea9-a33a-4664-aa3b-1b066c4c538b None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.419120 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09dea9-a33a-4664-aa3b-1b066c4c538b None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.419494 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09dea9-a33a-4664-aa3b-1b066c4c538b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.430975 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 790/1566] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:39:56.430975 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a05b3-3432-49b0-86a4-a29b63dbd6f2 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.430975 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a05b3-3432-49b0-86a4-a29b63dbd6f2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.430975 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a05b3-3432-49b0-86a4-a29b63dbd6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.438563 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-ec09dea9-a33a-4664-aa3b-1b066c4c538b None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:56.439864 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-ec09dea9-a33a-4664-aa3b-1b066c4c538b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:56.449273 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-cb0a05b3-3432-49b0-86a4-a29b63dbd6f2 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:56.449751 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 777/1567] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:56.451089 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800531a-0be1-43e2-92ec-470aae78ed42 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.451387 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800531a-0be1-43e2-92ec-470aae78ed42 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.451662 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800531a-0be1-43e2-92ec-470aae78ed42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.454176 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-cb0a05b3-3432-49b0-86a4-a29b63dbd6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:56.463016 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 791/1568] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:56.467241 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007a390-7618-47a2-a327-c8adda60ebaf None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.467726 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007a390-7618-47a2-a327-c8adda60ebaf None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.468078 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007a390-7618-47a2-a327-c8adda60ebaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.470123 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-b800531a-0be1-43e2-92ec-470aae78ed42 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:56.471416 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-b800531a-0be1-43e2-92ec-470aae78ed42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:56.480403 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 778/1569] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:56.481504 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64584342-5bf8-41fc-b9f4-050c6501a8ab None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.481788 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64584342-5bf8-41fc-b9f4-050c6501a8ab None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.482060 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64584342-5bf8-41fc-b9f4-050c6501a8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.487252 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-6007a390-7618-47a2-a327-c8adda60ebaf None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:56.488486 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6007a390-7618-47a2-a327-c8adda60ebaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:56.497415 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 792/1570] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:56.498004 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007a390-7618-47a2-a327-c8adda60ebaf None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:56.499512 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-64584342-5bf8-41fc-b9f4-050c6501a8ab None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:56.500674 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-64584342-5bf8-41fc-b9f4-050c6501a8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:56.516309 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007a390-7618-47a2-a327-c8adda60ebaf None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:56.518075 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 779/1571] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:56.522316 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64584342-5bf8-41fc-b9f4-050c6501a8ab None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:56.524600 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523be8b-ca9b-420b-abf1-ff867256c78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:56.525320 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523be8b-ca9b-420b-abf1-ff867256c78e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.525858 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523be8b-ca9b-420b-abf1-ff867256c78e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.526130 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523be8b-ca9b-420b-abf1-ff867256c78e admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.526861 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523be8b-ca9b-420b-abf1-ff867256c78e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:56.528468 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523be8b-ca9b-420b-abf1-ff867256c78e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:56.533606 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64584342-5bf8-41fc-b9f4-050c6501a8ab None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:56.539333 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544dca90-2a54-43b2-88b1-06a1fa2508a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:56.539911 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 793/1572] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:39:56.540121 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dca90-2a54-43b2-88b1-06a1fa2508a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.540541 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dca90-2a54-43b2-88b1-06a1fa2508a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.540819 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544dca90-2a54-43b2-88b1-06a1fa2508a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.540920 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523be8b-ca9b-420b-abf1-ff867256c78e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:56.541610 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544dca90-2a54-43b2-88b1-06a1fa2508a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:56.543375 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544dca90-2a54-43b2-88b1-06a1fa2508a9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:56.558379 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 780/1573] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:39:56.559000 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544dca90-2a54-43b2-88b1-06a1fa2508a9 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:56.560728 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523be8b-ca9b-420b-abf1-ff867256c78e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:56.567133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07e8a8-b4cb-4af8-ad38-14ef6b0d0dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:56.570571 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07e8a8-b4cb-4af8-ad38-14ef6b0d0dbe admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.571291 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07e8a8-b4cb-4af8-ad38-14ef6b0d0dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.571724 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07e8a8-b4cb-4af8-ad38-14ef6b0d0dbe admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.571970 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544dca90-2a54-43b2-88b1-06a1fa2508a9 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:56.573326 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b07e8a8-b4cb-4af8-ad38-14ef6b0d0dbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:39:56.573974 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b07e8a8-b4cb-4af8-ad38-14ef6b0d0dbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:56.576274 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b07e8a8-b4cb-4af8-ad38-14ef6b0d0dbe admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:56.577373 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705f549-39b6-43c9-9bd4-3c9a060c3954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:56.578728 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705f549-39b6-43c9-9bd4-3c9a060c3954 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.578728 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705f549-39b6-43c9-9bd4-3c9a060c3954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.578728 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705f549-39b6-43c9-9bd4-3c9a060c3954 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.580671 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705f549-39b6-43c9-9bd4-3c9a060c3954 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:39:56.581081 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705f549-39b6-43c9-9bd4-3c9a060c3954 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:56.585044 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705f549-39b6-43c9-9bd4-3c9a060c3954 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:56.595406 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 794/1574] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:39:56.597255 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07e8a8-b4cb-4af8-ad38-14ef6b0d0dbe admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:56.600327 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 781/1575] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:39:56.606211 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705f549-39b6-43c9-9bd4-3c9a060c3954 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:56.619547 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b07e8a8-b4cb-4af8-ad38-14ef6b0d0dbe admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:56.624817 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705f549-39b6-43c9-9bd4-3c9a060c3954 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:56.626075 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f00ad2-0229-4f68-8cc8-253f30457125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:56.627184 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f00ad2-0229-4f68-8cc8-253f30457125 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.627779 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f00ad2-0229-4f68-8cc8-253f30457125 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.628360 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f00ad2-0229-4f68-8cc8-253f30457125 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.629924 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f00ad2-0229-4f68-8cc8-253f30457125 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:39:56.630628 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f00ad2-0229-4f68-8cc8-253f30457125 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:56.630860 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b978f-7278-4153-a51f-82dbb8436f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:56.631783 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b978f-7278-4153-a51f-82dbb8436f11 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.632219 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b978f-7278-4153-a51f-82dbb8436f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.632597 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b978f-7278-4153-a51f-82dbb8436f11 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.633633 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b978f-7278-4153-a51f-82dbb8436f11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:39:56.633917 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f00ad2-0229-4f68-8cc8-253f30457125 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:56.634154 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b978f-7278-4153-a51f-82dbb8436f11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:56.635850 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b978f-7278-4153-a51f-82dbb8436f11 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:56.653072 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 795/1576] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:39:56.653072 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f00ad2-0229-4f68-8cc8-253f30457125 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:56.661549 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 782/1577] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:39:56.662860 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b978f-7278-4153-a51f-82dbb8436f11 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:56.667860 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f00ad2-0229-4f68-8cc8-253f30457125 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:56.673819 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b978f-7278-4153-a51f-82dbb8436f11 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:56.673961 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeee060-cb53-4764-8817-609e96523add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:56.674630 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeee060-cb53-4764-8817-609e96523add admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.674922 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeee060-cb53-4764-8817-609e96523add admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.675200 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeee060-cb53-4764-8817-609e96523add admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.675987 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeee060-cb53-4764-8817-609e96523add admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:39:56.676298 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeee060-cb53-4764-8817-609e96523add admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:56.678208 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeee060-cb53-4764-8817-609e96523add admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:56.680210 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b2a67-3ec6-491f-bb49-d903a0bc9093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:56.682174 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b2a67-3ec6-491f-bb49-d903a0bc9093 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.682548 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b2a67-3ec6-491f-bb49-d903a0bc9093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.682868 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b2a67-3ec6-491f-bb49-d903a0bc9093 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.683730 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b2a67-3ec6-491f-bb49-d903a0bc9093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:56.685875 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b2a67-3ec6-491f-bb49-d903a0bc9093 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:56.695854 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 796/1578] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:39:56.697332 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeee060-cb53-4764-8817-609e96523add admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:56.702677 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 783/1579] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:39:56.703562 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b2a67-3ec6-491f-bb49-d903a0bc9093 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:56.716268 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b2a67-3ec6-491f-bb49-d903a0bc9093 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:56.717973 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeee060-cb53-4764-8817-609e96523add admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:56.723714 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7f5f9-9ce5-4818-999d-6e11da8d3766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:56.724133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7f5f9-9ce5-4818-999d-6e11da8d3766 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.724382 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7f5f9-9ce5-4818-999d-6e11da8d3766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.725341 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7f5f9-9ce5-4818-999d-6e11da8d3766 admin admin] PATH_INFO: `/v3/projects/0c50afe9853e428f82ee884dc82b5cfe/users/a7d55c38bc5e4545aa175151a75e9bfc/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.728446 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0a3cc-b459-41b6-ab27-95c4481e8a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:56.729553 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0a3cc-b459-41b6-ab27-95c4481e8a37 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.729836 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0a3cc-b459-41b6-ab27-95c4481e8a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.730113 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0a3cc-b459-41b6-ab27-95c4481e8a37 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.730828 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0a3cc-b459-41b6-ab27-95c4481e8a37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:56.732770 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb0a3cc-b459-41b6-ab27-95c4481e8a37 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:56.748613 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7f5f9-9ce5-4818-999d-6e11da8d3766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c50afe9853e428f82ee884dc82b5cfe, user_id=a7d55c38bc5e4545aa175151a75e9bfc, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:56.751401 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7f5f9-9ce5-4818-999d-6e11da8d3766 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:56.769083 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 797/1581] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:39:56 2022] PUT /identity/v3/projects/0c50afe9853e428f82ee884dc82b5cfe/users/a7d55c38bc5e4545aa175151a75e9bfc/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:39:56.770538 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7f5f9-9ce5-4818-999d-6e11da8d3766 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:56.773087 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 784/1581] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:39:56 2022] POST /identity/v3/projects => generated 357 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:39:56.773978 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0a3cc-b459-41b6-ab27-95c4481e8a37 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:56.852528 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7f5f9-9ce5-4818-999d-6e11da8d3766 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:56.858977 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeeb9f-b528-4c89-a84b-a58fc3982d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:56.859178 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb0a3cc-b459-41b6-ab27-95c4481e8a37 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:56.859646 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeeb9f-b528-4c89-a84b-a58fc3982d7c admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.859927 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeeb9f-b528-4c89-a84b-a58fc3982d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.860203 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeeb9f-b528-4c89-a84b-a58fc3982d7c admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.860921 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eeeb9f-b528-4c89-a84b-a58fc3982d7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:56.862920 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eeeb9f-b528-4c89-a84b-a58fc3982d7c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:56.864159 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a559b7-b4d2-4101-8e64-57152c4d0b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:56.864881 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a559b7-b4d2-4101-8e64-57152c4d0b0b admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.865200 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a559b7-b4d2-4101-8e64-57152c4d0b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.865475 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a559b7-b4d2-4101-8e64-57152c4d0b0b admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.866216 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a559b7-b4d2-4101-8e64-57152c4d0b0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:56.868116 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a559b7-b4d2-4101-8e64-57152c4d0b0b admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:56.894133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 798/1582] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:39:56 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:39:56.894133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeeb9f-b528-4c89-a84b-a58fc3982d7c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:56.899085 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 785/1583] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:39:56 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:39:56.901343 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a559b7-b4d2-4101-8e64-57152c4d0b0b admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:56.964307 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a559b7-b4d2-4101-8e64-57152c4d0b0b admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:56.965381 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeeb9f-b528-4c89-a84b-a58fc3982d7c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:56.969105 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb74626-2cbb-4dc8-87b9-3f14ccab226d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:56.969773 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb74626-2cbb-4dc8-87b9-3f14ccab226d admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.970060 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb74626-2cbb-4dc8-87b9-3f14ccab226d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.970240 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62015e7-83b6-45d1-85f5-cb6d521b0088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:56.970358 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb74626-2cbb-4dc8-87b9-3f14ccab226d admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.971004 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62015e7-83b6-45d1-85f5-cb6d521b0088 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:56.971115 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb74626-2cbb-4dc8-87b9-3f14ccab226d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:56.971406 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62015e7-83b6-45d1-85f5-cb6d521b0088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:56.971865 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62015e7-83b6-45d1-85f5-cb6d521b0088 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:56.972674 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62015e7-83b6-45d1-85f5-cb6d521b0088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:56.973035 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb74626-2cbb-4dc8-87b9-3f14ccab226d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:56.974775 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62015e7-83b6-45d1-85f5-cb6d521b0088 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:57.002661 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 799/1584] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:39:56 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:39:57.003640 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62015e7-83b6-45d1-85f5-cb6d521b0088 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:57.005361 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 786/1585] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:39:56 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:39:57.006385 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb74626-2cbb-4dc8-87b9-3f14ccab226d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:57.073671 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62015e7-83b6-45d1-85f5-cb6d521b0088 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:57.078324 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f434a4-4d0b-4a39-8ca3-05d0a4c8a1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:57.078669 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb74626-2cbb-4dc8-87b9-3f14ccab226d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:57.079223 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f434a4-4d0b-4a39-8ca3-05d0a4c8a1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.079533 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f434a4-4d0b-4a39-8ca3-05d0a4c8a1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.079816 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f434a4-4d0b-4a39-8ca3-05d0a4c8a1a9 admin admin] PATH_INFO: `/v3/projects/91eecc080e2a48aa8b82e2c7be8a801f/users/dd710243719e45e5b48870d61044083d/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.083698 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef4abc-e23a-4d40-b037-bff907c5daa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:57.084446 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef4abc-e23a-4d40-b037-bff907c5daa4 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.084799 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef4abc-e23a-4d40-b037-bff907c5daa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.085166 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef4abc-e23a-4d40-b037-bff907c5daa4 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.085932 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef4abc-e23a-4d40-b037-bff907c5daa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:57.087926 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef4abc-e23a-4d40-b037-bff907c5daa4 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:57.099229 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f434a4-4d0b-4a39-8ca3-05d0a4c8a1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91eecc080e2a48aa8b82e2c7be8a801f, user_id=dd710243719e45e5b48870d61044083d, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:57.103666 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f434a4-4d0b-4a39-8ca3-05d0a4c8a1a9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:57.108760 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 787/1586] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:39:57 2022] POST /identity/v3/users => generated 279 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:39:57.110122 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff8b0a-49f1-47c6-82a7-7400d0f4fe0a None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.110408 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff8b0a-49f1-47c6-82a7-7400d0f4fe0a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.110685 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff8b0a-49f1-47c6-82a7-7400d0f4fe0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.123363 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 800/1587] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:39:57 2022] PUT /identity/v3/projects/91eecc080e2a48aa8b82e2c7be8a801f/users/dd710243719e45e5b48870d61044083d/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:39:57.130428 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f434a4-4d0b-4a39-8ca3-05d0a4c8a1a9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:57.137149 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-3bff8b0a-49f1-47c6-82a7-7400d0f4fe0a None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:57.139709 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-3bff8b0a-49f1-47c6-82a7-7400d0f4fe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:57.207219 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f434a4-4d0b-4a39-8ca3-05d0a4c8a1a9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:57.212794 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5187c-b512-4846-8325-e2090abfc973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:57.213752 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5187c-b512-4846-8325-e2090abfc973 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.213868 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 788/1588] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:57.213971 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5187c-b512-4846-8325-e2090abfc973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.214204 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5187c-b512-4846-8325-e2090abfc973 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.214390 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff8b0a-49f1-47c6-82a7-7400d0f4fe0a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:57.214972 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5187c-b512-4846-8325-e2090abfc973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:57.217370 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5187c-b512-4846-8325-e2090abfc973 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:57.224051 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff8b0a-49f1-47c6-82a7-7400d0f4fe0a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:57.231053 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8c2f6-b04c-42e7-892b-c219f6985ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:57.231874 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8c2f6-b04c-42e7-892b-c219f6985ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.232002 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8c2f6-b04c-42e7-892b-c219f6985ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.232239 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8c2f6-b04c-42e7-892b-c219f6985ba5 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.233133 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8c2f6-b04c-42e7-892b-c219f6985ba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:57.235062 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8c2f6-b04c-42e7-892b-c219f6985ba5 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:57.239637 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 801/1589] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:39:57 2022] POST /identity/v3/users => generated 283 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:39:57.243719 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5187c-b512-4846-8325-e2090abfc973 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:57.256525 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5187c-b512-4846-8325-e2090abfc973 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:57.261153 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 789/1590] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:39:57 2022] POST /identity/v3/users => generated 287 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:39:57.261153 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8c2f6-b04c-42e7-892b-c219f6985ba5 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:57.267448 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ac461-1fcd-4d1a-b32d-fd78910de4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:57.268153 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ac461-1fcd-4d1a-b32d-fd78910de4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.268440 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ac461-1fcd-4d1a-b32d-fd78910de4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.268719 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ac461-1fcd-4d1a-b32d-fd78910de4b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.269522 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ac461-1fcd-4d1a-b32d-fd78910de4b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:57.269929 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8c2f6-b04c-42e7-892b-c219f6985ba5 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:57.271456 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ac461-1fcd-4d1a-b32d-fd78910de4b6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:57.274463 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd798a-91f8-47cb-bdc6-560464edb302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:57.275193 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd798a-91f8-47cb-bdc6-560464edb302 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.275740 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd798a-91f8-47cb-bdc6-560464edb302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.276091 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd798a-91f8-47cb-bdc6-560464edb302 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.276883 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd798a-91f8-47cb-bdc6-560464edb302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:57.278889 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd798a-91f8-47cb-bdc6-560464edb302 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:57.293886 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 802/1591] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:39:57 2022] POST /identity/v3/users => generated 290 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:39:57.294979 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ac461-1fcd-4d1a-b32d-fd78910de4b6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:57.304126 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 790/1592] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:39:57 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:39:57.305628 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5495e-158b-463a-86c9-a01a8b0ae759 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.305973 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5495e-158b-463a-86c9-a01a8b0ae759 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.306261 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5495e-158b-463a-86c9-a01a8b0ae759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.307703 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ac461-1fcd-4d1a-b32d-fd78910de4b6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:57.313261 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e6e61-1f23-47ba-9825-eb99a6b24e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:57.313597 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e6e61-1f23-47ba-9825-eb99a6b24e37 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.318006 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e6e61-1f23-47ba-9825-eb99a6b24e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.318434 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e6e61-1f23-47ba-9825-eb99a6b24e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.319308 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e6e61-1f23-47ba-9825-eb99a6b24e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:57.321127 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e6e61-1f23-47ba-9825-eb99a6b24e37 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:57.332056 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 803/1593] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:39:57.332942 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e6e61-1f23-47ba-9825-eb99a6b24e37 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:57.335197 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-dc2e6e61-1f23-47ba-9825-eb99a6b24e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:57.337931 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-97e5495e-158b-463a-86c9-a01a8b0ae759 None None] MFA Rules not processed for user `dd710243719e45e5b48870d61044083d`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:57.339177 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-97e5495e-158b-463a-86c9-a01a8b0ae759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:57.399250 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e6e61-1f23-47ba-9825-eb99a6b24e37 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:57.403487 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cbfcc-4b8e-45c3-9f7f-925417daa677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:57.404618 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cbfcc-4b8e-45c3-9f7f-925417daa677 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.405183 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cbfcc-4b8e-45c3-9f7f-925417daa677 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.405671 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cbfcc-4b8e-45c3-9f7f-925417daa677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.420361 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 791/1594] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:57.422065 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5495e-158b-463a-86c9-a01a8b0ae759 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:57.424255 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72cbfcc-4b8e-45c3-9f7f-925417daa677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:57.428013 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72cbfcc-4b8e-45c3-9f7f-925417daa677 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:57.435269 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5495e-158b-463a-86c9-a01a8b0ae759 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:57.439436 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c6428-8eda-4f14-a0e8-5ec3dd4ca5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:57.440215 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 804/1595] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:39:57.440589 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c6428-8eda-4f14-a0e8-5ec3dd4ca5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.440976 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c6428-8eda-4f14-a0e8-5ec3dd4ca5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.441683 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cbfcc-4b8e-45c3-9f7f-925417daa677 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:57.442005 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c6428-8eda-4f14-a0e8-5ec3dd4ca5b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.442852 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c6428-8eda-4f14-a0e8-5ec3dd4ca5b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:57.444626 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c6428-8eda-4f14-a0e8-5ec3dd4ca5b2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:57.457643 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 792/1596] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:39:57.458708 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c6428-8eda-4f14-a0e8-5ec3dd4ca5b2 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:57.461395 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cbfcc-4b8e-45c3-9f7f-925417daa677 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:57.467873 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ef354-c4dc-42d0-841a-11b096a1c83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:57.468634 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ef354-c4dc-42d0-841a-11b096a1c83b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.468951 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ef354-c4dc-42d0-841a-11b096a1c83b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.469435 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ef354-c4dc-42d0-841a-11b096a1c83b admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.469970 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c6428-8eda-4f14-a0e8-5ec3dd4ca5b2 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:57.470466 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ef354-c4dc-42d0-841a-11b096a1c83b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:57.472388 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ef354-c4dc-42d0-841a-11b096a1c83b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:57.476287 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54ce95-22ef-49b6-8f50-ffb34b8a1f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:57.477106 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54ce95-22ef-49b6-8f50-ffb34b8a1f94 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.477288 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54ce95-22ef-49b6-8f50-ffb34b8a1f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.477549 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54ce95-22ef-49b6-8f50-ffb34b8a1f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.478290 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54ce95-22ef-49b6-8f50-ffb34b8a1f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:57.480202 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54ce95-22ef-49b6-8f50-ffb34b8a1f94 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:57.484251 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 805/1597] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:39:57.485403 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ef354-c4dc-42d0-841a-11b096a1c83b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:57.497237 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 793/1598] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:39:57.497237 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54ce95-22ef-49b6-8f50-ffb34b8a1f94 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:57.497499 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ef354-c4dc-42d0-841a-11b096a1c83b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:57.502346 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dd91f-24fb-4a57-bd96-a3e8c04827ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:57.503023 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dd91f-24fb-4a57-bd96-a3e8c04827ba admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.504098 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dd91f-24fb-4a57-bd96-a3e8c04827ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.504098 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dd91f-24fb-4a57-bd96-a3e8c04827ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.504851 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dd91f-24fb-4a57-bd96-a3e8c04827ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:57.506503 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dd91f-24fb-4a57-bd96-a3e8c04827ba admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:57.506652 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54ce95-22ef-49b6-8f50-ffb34b8a1f94 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:57.512020 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839738b4-d485-47b2-ab8a-7cba0c94f890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:57.512686 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839738b4-d485-47b2-ab8a-7cba0c94f890 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.512972 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839738b4-d485-47b2-ab8a-7cba0c94f890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.513458 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839738b4-d485-47b2-ab8a-7cba0c94f890 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.514012 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839738b4-d485-47b2-ab8a-7cba0c94f890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:57.516583 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839738b4-d485-47b2-ab8a-7cba0c94f890 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:57.520952 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 806/1599] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:39:57.520952 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dd91f-24fb-4a57-bd96-a3e8c04827ba admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:57.528944 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 794/1600] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:39:57.529925 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839738b4-d485-47b2-ab8a-7cba0c94f890 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:57.536490 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dd91f-24fb-4a57-bd96-a3e8c04827ba admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:57.546065 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839738b4-d485-47b2-ab8a-7cba0c94f890 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:57.549300 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070ed12-3103-442b-9c4d-352d75d373bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:57.549885 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070ed12-3103-442b-9c4d-352d75d373bb admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.550697 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070ed12-3103-442b-9c4d-352d75d373bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.551071 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2070ed12-3103-442b-9c4d-352d75d373bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.552211 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070ed12-3103-442b-9c4d-352d75d373bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:57.554250 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2070ed12-3103-442b-9c4d-352d75d373bb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:57.554834 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112126a9-89a0-49a3-911d-461e8cdc2157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:57.555887 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112126a9-89a0-49a3-911d-461e8cdc2157 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.556487 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112126a9-89a0-49a3-911d-461e8cdc2157 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.557115 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112126a9-89a0-49a3-911d-461e8cdc2157 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.558195 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112126a9-89a0-49a3-911d-461e8cdc2157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:57.561146 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112126a9-89a0-49a3-911d-461e8cdc2157 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:57.576652 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 795/1601] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:39:57.582709 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112126a9-89a0-49a3-911d-461e8cdc2157 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:57.593767 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112126a9-89a0-49a3-911d-461e8cdc2157 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:57.597527 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 807/1602] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:39:57 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:39:57.598726 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070ed12-3103-442b-9c4d-352d75d373bb admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:57.662145 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d8312-c9ed-489d-8c5a-34a6b4513d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:57.662966 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d8312-c9ed-489d-8c5a-34a6b4513d0c admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.663355 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d8312-c9ed-489d-8c5a-34a6b4513d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.663731 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d8312-c9ed-489d-8c5a-34a6b4513d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.664708 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d8312-c9ed-489d-8c5a-34a6b4513d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:57.666883 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d8312-c9ed-489d-8c5a-34a6b4513d0c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:57.682372 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 796/1603] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:39:57.682372 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d8312-c9ed-489d-8c5a-34a6b4513d0c admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:57.694476 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d8312-c9ed-489d-8c5a-34a6b4513d0c admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:57.699538 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2070ed12-3103-442b-9c4d-352d75d373bb admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:57.702951 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa89a0-8793-4b30-be7e-56f60abb962c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:57.703751 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa89a0-8793-4b30-be7e-56f60abb962c admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.704056 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab81fe-6320-4bcd-9c7f-d6d27357050f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:57.704460 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa89a0-8793-4b30-be7e-56f60abb962c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.704589 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa89a0-8793-4b30-be7e-56f60abb962c admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.704712 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab81fe-6320-4bcd-9c7f-d6d27357050f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.704987 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab81fe-6320-4bcd-9c7f-d6d27357050f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.705653 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab81fe-6320-4bcd-9c7f-d6d27357050f admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.705769 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa89a0-8793-4b30-be7e-56f60abb962c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:57.706095 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab81fe-6320-4bcd-9c7f-d6d27357050f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:57.707858 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ab81fe-6320-4bcd-9c7f-d6d27357050f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:57.709488 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa89a0-8793-4b30-be7e-56f60abb962c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:57.724914 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 808/1604] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:39:57.725969 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab81fe-6320-4bcd-9c7f-d6d27357050f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:57.735255 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 797/1605] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:39:57.739743 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab81fe-6320-4bcd-9c7f-d6d27357050f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:57.741459 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa89a0-8793-4b30-be7e-56f60abb962c admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:57.747477 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467d60d-af72-4f00-95c8-5418c2d906a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:57.748977 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467d60d-af72-4f00-95c8-5418c2d906a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.749767 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467d60d-af72-4f00-95c8-5418c2d906a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.750400 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467d60d-af72-4f00-95c8-5418c2d906a8 admin admin] PATH_INFO: `/v3/projects/5b5bbf7218fd4a73a5dc6d1ab682c07f/users/d2517076ac50486480fb6fb271a8dae1/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.752602 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa89a0-8793-4b30-be7e-56f60abb962c admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:57.758540 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5784a-4a3e-49dd-9006-eb309a9d0382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:57.759429 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5784a-4a3e-49dd-9006-eb309a9d0382 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.759708 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5784a-4a3e-49dd-9006-eb309a9d0382 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.760032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5784a-4a3e-49dd-9006-eb309a9d0382 admin admin] PATH_INFO: `/v3/projects/25e113c098564c28972f0418b73b4f71/users/161b6a4262a44ca499d802dfe16b5ae5/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.770569 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467d60d-af72-4f00-95c8-5418c2d906a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b5bbf7218fd4a73a5dc6d1ab682c07f, user_id=d2517076ac50486480fb6fb271a8dae1, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:57.774753 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467d60d-af72-4f00-95c8-5418c2d906a8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:57.777031 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5784a-4a3e-49dd-9006-eb309a9d0382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e113c098564c28972f0418b73b4f71, user_id=161b6a4262a44ca499d802dfe16b5ae5, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:57.779756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5784a-4a3e-49dd-9006-eb309a9d0382 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:57.809037 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 809/1606] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:39:57 2022] PUT /identity/v3/projects/5b5bbf7218fd4a73a5dc6d1ab682c07f/users/d2517076ac50486480fb6fb271a8dae1/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:39:57.809037 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467d60d-af72-4f00-95c8-5418c2d906a8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:57.809358 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 798/1607] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:39:57 2022] PUT /identity/v3/projects/25e113c098564c28972f0418b73b4f71/users/161b6a4262a44ca499d802dfe16b5ae5/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:39:57.809358 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5784a-4a3e-49dd-9006-eb309a9d0382 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:57.923319 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5784a-4a3e-49dd-9006-eb309a9d0382 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:57.929916 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936c14d-b76e-4c79-ab45-9ef1a1acd3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:57.930817 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936c14d-b76e-4c79-ab45-9ef1a1acd3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.931126 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936c14d-b76e-4c79-ab45-9ef1a1acd3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.932787 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936c14d-b76e-4c79-ab45-9ef1a1acd3f0 admin admin] PATH_INFO: `/v3/projects/77c37e9cf5e3494f8cba1437f22a7a72/users/874dc6da6298415ba99a027a72fa09cd/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.940789 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467d60d-af72-4f00-95c8-5418c2d906a8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:57.952897 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936c14d-b76e-4c79-ab45-9ef1a1acd3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77c37e9cf5e3494f8cba1437f22a7a72, user_id=874dc6da6298415ba99a027a72fa09cd, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:57.954621 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79043da0-a50f-4649-9588-32c186bda1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:57.955570 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79043da0-a50f-4649-9588-32c186bda1d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:57.955717 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936c14d-b76e-4c79-ab45-9ef1a1acd3f0 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:57.956979 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79043da0-a50f-4649-9588-32c186bda1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:57.958013 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79043da0-a50f-4649-9588-32c186bda1d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:57.958907 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79043da0-a50f-4649-9588-32c186bda1d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:57.961947 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79043da0-a50f-4649-9588-32c186bda1d4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:57.989038 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 799/1608] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:39:57 2022] PUT /identity/v3/projects/77c37e9cf5e3494f8cba1437f22a7a72/users/874dc6da6298415ba99a027a72fa09cd/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:39:57.989038 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936c14d-b76e-4c79-ab45-9ef1a1acd3f0 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:58.000857 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 810/1609] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:39:57 2022] POST /identity/v3/users => generated 298 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:39:58.000857 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79043da0-a50f-4649-9588-32c186bda1d4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:58.021243 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79043da0-a50f-4649-9588-32c186bda1d4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:58.092082 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936c14d-b76e-4c79-ab45-9ef1a1acd3f0 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:58.094636 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a962886-f211-4917-801a-a6aa21efc087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:58.095533 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a962886-f211-4917-801a-a6aa21efc087 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:58.095813 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a962886-f211-4917-801a-a6aa21efc087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:58.096086 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a962886-f211-4917-801a-a6aa21efc087 admin admin] PATH_INFO: `/v3/projects/89d762f8f89e44b9bf0b09c9e9dc5404/users/dc69e7f932e346bd89284ef286605175/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:58.100700 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c175044-2ec5-4917-923f-d1017198a664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:58.102422 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c175044-2ec5-4917-923f-d1017198a664 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:58.102718 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c175044-2ec5-4917-923f-d1017198a664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:58.102996 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c175044-2ec5-4917-923f-d1017198a664 admin admin] PATH_INFO: `/v3/projects/a86692805365495ab64b0aae70ab80fb/users/c43b2e2082b543828b9955ebdf3aaeab/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:58.115439 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a962886-f211-4917-801a-a6aa21efc087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d762f8f89e44b9bf0b09c9e9dc5404, user_id=dc69e7f932e346bd89284ef286605175, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:58.119216 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a962886-f211-4917-801a-a6aa21efc087 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:58.124469 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c175044-2ec5-4917-923f-d1017198a664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86692805365495ab64b0aae70ab80fb, user_id=c43b2e2082b543828b9955ebdf3aaeab, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:58.128568 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c175044-2ec5-4917-923f-d1017198a664 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:58.138236 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 811/1610] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:39:57 2022] PUT /identity/v3/projects/89d762f8f89e44b9bf0b09c9e9dc5404/users/dc69e7f932e346bd89284ef286605175/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:39:58.139831 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed24ae-3b28-418e-8c00-2d1c50d0d9be None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:58.140335 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed24ae-3b28-418e-8c00-2d1c50d0d9be None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:58.140813 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ed24ae-3b28-418e-8c00-2d1c50d0d9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:58.150792 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 800/1611] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:39:57 2022] PUT /identity/v3/projects/a86692805365495ab64b0aae70ab80fb/users/c43b2e2082b543828b9955ebdf3aaeab/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:39:58.150792 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6eeb7-58f5-44c9-a3a1-578368508c76 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:58.150792 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6eeb7-58f5-44c9-a3a1-578368508c76 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:58.150792 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6eeb7-58f5-44c9-a3a1-578368508c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:58.193166 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-87ed24ae-3b28-418e-8c00-2d1c50d0d9be None None] MFA Rules not processed for user `d2517076ac50486480fb6fb271a8dae1`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:58.194991 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-87ed24ae-3b28-418e-8c00-2d1c50d0d9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:58.203482 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-81c6eeb7-58f5-44c9-a3a1-578368508c76 None None] MFA Rules not processed for user `161b6a4262a44ca499d802dfe16b5ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:58.205018 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-81c6eeb7-58f5-44c9-a3a1-578368508c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:58.287022 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 812/1612] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:58 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:58.288598 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed24ae-3b28-418e-8c00-2d1c50d0d9be None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:58.296560 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 801/1613] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:58.308327 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223294bc-463b-4bb2-baef-6254928abc89 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:58.308622 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223294bc-463b-4bb2-baef-6254928abc89 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:58.308965 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223294bc-463b-4bb2-baef-6254928abc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:58.339855 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-223294bc-463b-4bb2-baef-6254928abc89 None None] MFA Rules not processed for user `874dc6da6298415ba99a027a72fa09cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:58.341764 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-223294bc-463b-4bb2-baef-6254928abc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:58.415695 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ed24ae-3b28-418e-8c00-2d1c50d0d9be None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:58.420703 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a5b8ae-6ae8-4eca-b51b-e2e3ab8d23b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:58.421632 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5b8ae-6ae8-4eca-b51b-e2e3ab8d23b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:58.421919 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5b8ae-6ae8-4eca-b51b-e2e3ab8d23b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:58.422201 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a5b8ae-6ae8-4eca-b51b-e2e3ab8d23b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:58.423249 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5b8ae-6ae8-4eca-b51b-e2e3ab8d23b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:58.424906 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a5b8ae-6ae8-4eca-b51b-e2e3ab8d23b7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:58.438536 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 813/1614] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:39:58.439965 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8ce99-949e-4b10-a265-d5337d68fec6 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:58.440297 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8ce99-949e-4b10-a265-d5337d68fec6 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:58.440544 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8ce99-949e-4b10-a265-d5337d68fec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:58.464964 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 802/1615] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:58.466939 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433275f-011b-40e3-a185-16f955ec76f7 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:58.468007 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433275f-011b-40e3-a185-16f955ec76f7 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:58.468504 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433275f-011b-40e3-a185-16f955ec76f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:58.468729 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a6d8ce99-949e-4b10-a265-d5337d68fec6 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:58.470570 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a6d8ce99-949e-4b10-a265-d5337d68fec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:58.480855 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 814/1616] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:58.481768 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8ce99-949e-4b10-a265-d5337d68fec6 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:58.493932 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8ce99-949e-4b10-a265-d5337d68fec6 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:58.498802 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73216e20-4f55-46ce-baff-adabf7c6db8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:58.503320 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73216e20-4f55-46ce-baff-adabf7c6db8e admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:58.503670 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73216e20-4f55-46ce-baff-adabf7c6db8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:58.504597 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73216e20-4f55-46ce-baff-adabf7c6db8e admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:58.505366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73216e20-4f55-46ce-baff-adabf7c6db8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:58.507423 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-3433275f-011b-40e3-a185-16f955ec76f7 None None] MFA Rules not processed for user `dc69e7f932e346bd89284ef286605175`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:58.507546 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73216e20-4f55-46ce-baff-adabf7c6db8e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:58.509182 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-3433275f-011b-40e3-a185-16f955ec76f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:58.553719 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 815/1617] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:39:58 2022] POST /identity/v3/projects => generated 355 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:39:58.554978 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73216e20-4f55-46ce-baff-adabf7c6db8e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:58.623822 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 803/1618] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:58.623822 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c55dc-6acd-4e60-9a5b-00cdcf52f08b None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:58.623822 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c55dc-6acd-4e60-9a5b-00cdcf52f08b None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:58.623822 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c55dc-6acd-4e60-9a5b-00cdcf52f08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:58.656208 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73216e20-4f55-46ce-baff-adabf7c6db8e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:58.656771 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-fa5c55dc-6acd-4e60-9a5b-00cdcf52f08b None None] MFA Rules not processed for user `a7d55c38bc5e4545aa175151a75e9bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:58.658580 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-fa5c55dc-6acd-4e60-9a5b-00cdcf52f08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:58.661446 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2d77f-5852-49ce-9191-6d89af16624a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:58.662174 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2d77f-5852-49ce-9191-6d89af16624a service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:58.662456 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2d77f-5852-49ce-9191-6d89af16624a service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:58.662739 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2d77f-5852-49ce-9191-6d89af16624a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:58.743385 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2d77f-5852-49ce-9191-6d89af16624a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:58.744974 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2d77f-5852-49ce-9191-6d89af16624a service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:58.751343 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 804/1619] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:58.752711 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c55dc-6acd-4e60-9a5b-00cdcf52f08b None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:58.756617 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 816/1620] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:39:58 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:39:58.766335 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2d77f-5852-49ce-9191-6d89af16624a service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:58.842153 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c55dc-6acd-4e60-9a5b-00cdcf52f08b None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:58.855103 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a3101-a3db-4f09-afb6-9596cd1bf7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:58.859207 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a3101-a3db-4f09-afb6-9596cd1bf7b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:58.859499 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a3101-a3db-4f09-afb6-9596cd1bf7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:58.859787 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a3101-a3db-4f09-afb6-9596cd1bf7b2 admin admin] PATH_INFO: `/v3/projects/4cbf6f0e15b54da9b382f4ab2fc622cf/users/8db037914c6c4b6f9ae111c09d243540/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:58.880832 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a3101-a3db-4f09-afb6-9596cd1bf7b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cbf6f0e15b54da9b382f4ab2fc622cf, user_id=8db037914c6c4b6f9ae111c09d243540, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:58.884162 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a3101-a3db-4f09-afb6-9596cd1bf7b2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:58.896347 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2d77f-5852-49ce-9191-6d89af16624a service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:58.904500 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 805/1621] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:39:58 2022] PUT /identity/v3/projects/4cbf6f0e15b54da9b382f4ab2fc622cf/users/8db037914c6c4b6f9ae111c09d243540/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:39:58.906653 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a3101-a3db-4f09-afb6-9596cd1bf7b2 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:58.988856 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4b7d5-500b-42e9-8541-8da7d1f80824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:58.989752 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4b7d5-500b-42e9-8541-8da7d1f80824 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:58.989880 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4b7d5-500b-42e9-8541-8da7d1f80824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:58.990114 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4b7d5-500b-42e9-8541-8da7d1f80824 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:58.990821 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4b7d5-500b-42e9-8541-8da7d1f80824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:58.992746 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4b7d5-500b-42e9-8541-8da7d1f80824 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:59.022952 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a3101-a3db-4f09-afb6-9596cd1bf7b2 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:59.031175 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 817/1622] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:39:58 2022] POST /identity/v3/projects => generated 371 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:39:59.032080 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4b7d5-500b-42e9-8541-8da7d1f80824 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:59.032409 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0278f7-574a-4ae4-a85b-3cadb39773f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:59.033159 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0278f7-574a-4ae4-a85b-3cadb39773f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:59.033451 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0278f7-574a-4ae4-a85b-3cadb39773f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:59.033748 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0278f7-574a-4ae4-a85b-3cadb39773f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:59.059756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0278f7-574a-4ae4-a85b-3cadb39773f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:59.061241 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0278f7-574a-4ae4-a85b-3cadb39773f8 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:59.080917 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 806/1623] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:39:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:39:59.090972 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e149944-8323-4d57-b4ce-a7f6a76802ed None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:59.091268 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e149944-8323-4d57-b4ce-a7f6a76802ed None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:59.091549 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e149944-8323-4d57-b4ce-a7f6a76802ed None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:59.103047 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 807/1624] 10.222.0.36 () {54 vars in 961 bytes} [Wed Feb 9 04:39:59 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:39:59.106486 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831c662-3ced-41dc-9870-7c9795747f0e None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:59.106801 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831c662-3ced-41dc-9870-7c9795747f0e None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:59.107061 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831c662-3ced-41dc-9870-7c9795747f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:59.129261 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4b7d5-500b-42e9-8541-8da7d1f80824 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:59.136077 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0321b7-9ce7-4a5a-bcda-57b7fdc60496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:59.137556 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0321b7-9ce7-4a5a-bcda-57b7fdc60496 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:59.138175 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0321b7-9ce7-4a5a-bcda-57b7fdc60496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:59.138933 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0321b7-9ce7-4a5a-bcda-57b7fdc60496 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:59.140163 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0321b7-9ce7-4a5a-bcda-57b7fdc60496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:59.142521 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0321b7-9ce7-4a5a-bcda-57b7fdc60496 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:59.144312 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-7831c662-3ced-41dc-9870-7c9795747f0e None None] MFA Rules not processed for user `a7d55c38bc5e4545aa175151a75e9bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:59.145596 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7831c662-3ced-41dc-9870-7c9795747f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:59.170371 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 818/1625] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:39:59 2022] POST /identity/v3/users => generated 284 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:39:59.171949 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0321b7-9ce7-4a5a-bcda-57b7fdc60496 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:59.184129 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0321b7-9ce7-4a5a-bcda-57b7fdc60496 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:59.190322 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef6556-b8b1-4b43-a7e5-35fd08fe459f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:59.191435 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef6556-b8b1-4b43-a7e5-35fd08fe459f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:59.192120 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef6556-b8b1-4b43-a7e5-35fd08fe459f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:59.192621 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef6556-b8b1-4b43-a7e5-35fd08fe459f admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:59.193708 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef6556-b8b1-4b43-a7e5-35fd08fe459f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:59.195788 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef6556-b8b1-4b43-a7e5-35fd08fe459f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:59.209333 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 819/1626] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:39:59.210804 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef6556-b8b1-4b43-a7e5-35fd08fe459f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:59.230207 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef6556-b8b1-4b43-a7e5-35fd08fe459f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:59.242909 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e234bdb-77e2-45e7-b4b4-32492fc0795a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:59.243622 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e234bdb-77e2-45e7-b4b4-32492fc0795a admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:59.243913 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e234bdb-77e2-45e7-b4b4-32492fc0795a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:59.246052 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e234bdb-77e2-45e7-b4b4-32492fc0795a admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:59.248015 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e234bdb-77e2-45e7-b4b4-32492fc0795a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:59.255462 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e234bdb-77e2-45e7-b4b4-32492fc0795a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:59.277671 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 808/1627] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:59.279484 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c844d7-28d1-4875-a364-53dacef51e2d None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:59.280138 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c844d7-28d1-4875-a364-53dacef51e2d None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:59.280630 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c844d7-28d1-4875-a364-53dacef51e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:59.309519 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 820/1628] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:39:59 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:39:59.310788 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e234bdb-77e2-45e7-b4b4-32492fc0795a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:59.325889 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-59c844d7-28d1-4875-a364-53dacef51e2d None None] MFA Rules not processed for user `63fe98c10e974c019e05a2f68d012ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:59.327657 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-59c844d7-28d1-4875-a364-53dacef51e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:59.343171 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e234bdb-77e2-45e7-b4b4-32492fc0795a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:59.359084 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f8a2e-8e94-4426-9e85-1259dd7348cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:59.361213 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f8a2e-8e94-4426-9e85-1259dd7348cb admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:59.361693 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f8a2e-8e94-4426-9e85-1259dd7348cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:59.362133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f8a2e-8e94-4426-9e85-1259dd7348cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:59.363514 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f8a2e-8e94-4426-9e85-1259dd7348cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:59.365641 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f8a2e-8e94-4426-9e85-1259dd7348cb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:59.382328 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 821/1629] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:39:59.383788 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f8a2e-8e94-4426-9e85-1259dd7348cb admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:59.397315 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f8a2e-8e94-4426-9e85-1259dd7348cb admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:59.418952 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ae7237-ab45-4798-b9c2-dc28f21a31f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:59.421528 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae7237-ab45-4798-b9c2-dc28f21a31f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:59.422007 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae7237-ab45-4798-b9c2-dc28f21a31f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:59.422586 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae7237-ab45-4798-b9c2-dc28f21a31f7 admin admin] PATH_INFO: `/v3/projects/4cbf6f0e15b54da9b382f4ab2fc622cf/users/8db037914c6c4b6f9ae111c09d243540/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:59.425507 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae7237-ab45-4798-b9c2-dc28f21a31f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cbf6f0e15b54da9b382f4ab2fc622cf, user_id=8db037914c6c4b6f9ae111c09d243540, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:59.429874 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ae7237-ab45-4798-b9c2-dc28f21a31f7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:59.470227 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 822/1630] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:39:59 2022] PUT /identity/v3/projects/4cbf6f0e15b54da9b382f4ab2fc622cf/users/8db037914c6c4b6f9ae111c09d243540/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:39:59.473781 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a69c2a-ca3e-491b-bb53-0b56497004be None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:59.474230 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a69c2a-ca3e-491b-bb53-0b56497004be None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:59.474554 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a69c2a-ca3e-491b-bb53-0b56497004be None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:59.476723 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 823/1631] 10.222.0.36 () {54 vars in 961 bytes} [Wed Feb 9 04:39:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:39:59.478227 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a69c2a-ca3e-491b-bb53-0b56497004be None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:59.487004 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 809/1632] 10.222.0.36 () {58 vars in 1058 bytes} [Wed Feb 9 04:39:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:59.497754 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c844d7-28d1-4875-a364-53dacef51e2d None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:59.537356 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c844d7-28d1-4875-a364-53dacef51e2d None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:59.565617 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a69c2a-ca3e-491b-bb53-0b56497004be None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:59.579450 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345aad6-c235-4cd1-bd00-ff8f6aad4381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:59.580183 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345aad6-c235-4cd1-bd00-ff8f6aad4381 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:59.580486 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345aad6-c235-4cd1-bd00-ff8f6aad4381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:59.580747 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345aad6-c235-4cd1-bd00-ff8f6aad4381 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:59.581620 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345aad6-c235-4cd1-bd00-ff8f6aad4381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:59.584567 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345aad6-c235-4cd1-bd00-ff8f6aad4381 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:59.601562 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 824/1633] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:39:59.603167 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f63eb2-98ef-42d4-a928-7b15e7575652 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:59.603465 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f63eb2-98ef-42d4-a928-7b15e7575652 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:59.603742 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f63eb2-98ef-42d4-a928-7b15e7575652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:59.637072 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-00f63eb2-98ef-42d4-a928-7b15e7575652 None None] MFA Rules not processed for user `8db037914c6c4b6f9ae111c09d243540`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:59.639045 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-00f63eb2-98ef-42d4-a928-7b15e7575652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:59.679229 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22981d65-ee7a-4bd2-9244-06dd871b1dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:59.680157 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22981d65-ee7a-4bd2-9244-06dd871b1dea admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:59.680443 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22981d65-ee7a-4bd2-9244-06dd871b1dea admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:59.680721 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22981d65-ee7a-4bd2-9244-06dd871b1dea admin admin] PATH_INFO: `/v3/projects/88ae2abddf53489fa6660ecc0b8c9101/users/b2d1e6630bb74b80ad68885818d925f2/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:59.723625 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 825/1634] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:39:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:59.727241 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ea863-5160-4873-9c71-8a8dc7846881 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:59.727715 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ea863-5160-4873-9c71-8a8dc7846881 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:59.728183 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ea863-5160-4873-9c71-8a8dc7846881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:59.733461 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22981d65-ee7a-4bd2-9244-06dd871b1dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ae2abddf53489fa6660ecc0b8c9101, user_id=b2d1e6630bb74b80ad68885818d925f2, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:59.736166 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22981d65-ee7a-4bd2-9244-06dd871b1dea admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:59.754883 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-692ea863-5160-4873-9c71-8a8dc7846881 None None] MFA Rules not processed for user `63fe98c10e974c019e05a2f68d012ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:39:59.756171 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-692ea863-5160-4873-9c71-8a8dc7846881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:39:59.757377 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 810/1635] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:39:59 2022] PUT /identity/v3/projects/88ae2abddf53489fa6660ecc0b8c9101/users/b2d1e6630bb74b80ad68885818d925f2/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:39:59.758236 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22981d65-ee7a-4bd2-9244-06dd871b1dea admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:59.840732 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 826/1636] 10.222.0.36 () {58 vars in 1058 bytes} [Wed Feb 9 04:39:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:39:59.842171 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ea863-5160-4873-9c71-8a8dc7846881 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:59.895400 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22981d65-ee7a-4bd2-9244-06dd871b1dea admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:59.908080 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec8e36-f4b8-4d8f-8810-fd7f5a54b564 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:59.908080 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec8e36-f4b8-4d8f-8810-fd7f5a54b564 service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:59.908080 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec8e36-f4b8-4d8f-8810-fd7f5a54b564 service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:59.908733 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec8e36-f4b8-4d8f-8810-fd7f5a54b564 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:59.934077 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ea863-5160-4873-9c71-8a8dc7846881 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:39:59.939777 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611cf61-120d-41f8-baf5-ee9ea12d5c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:39:59.940637 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611cf61-120d-41f8-baf5-ee9ea12d5c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:39:59.940917 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611cf61-120d-41f8-baf5-ee9ea12d5c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:39:59.941773 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0611cf61-120d-41f8-baf5-ee9ea12d5c63 admin admin] PATH_INFO: `/v3/projects/68538ca073b8467a8045fece4ca77566/users/4518041fb8b648a7bd485a8ab2f56a68/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:39:59.960599 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611cf61-120d-41f8-baf5-ee9ea12d5c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68538ca073b8467a8045fece4ca77566, user_id=4518041fb8b648a7bd485a8ab2f56a68, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:59.963936 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0611cf61-120d-41f8-baf5-ee9ea12d5c63 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:39:59.979041 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 827/1637] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:39:59 2022] PUT /identity/v3/projects/68538ca073b8467a8045fece4ca77566/users/4518041fb8b648a7bd485a8ab2f56a68/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:39:59.979989 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611cf61-120d-41f8-baf5-ee9ea12d5c63 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:39:59.994676 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec8e36-f4b8-4d8f-8810-fd7f5a54b564 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:39:59.996591 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec8e36-f4b8-4d8f-8810-fd7f5a54b564 service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:00.012218 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 811/1638] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:39:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:00.013346 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec8e36-f4b8-4d8f-8810-fd7f5a54b564 service nova] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:00.035374 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec8e36-f4b8-4d8f-8810-fd7f5a54b564 service nova] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:00.081920 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0611cf61-120d-41f8-baf5-ee9ea12d5c63 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:00.086184 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7541a-14a6-4167-b29f-833915c4f375 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:00.086924 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7541a-14a6-4167-b29f-833915c4f375 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:00.087347 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7541a-14a6-4167-b29f-833915c4f375 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:00.087697 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b7541a-14a6-4167-b29f-833915c4f375 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:00.181876 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec92e7-2d0f-4ca4-a331-96b78d98b656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:00.182478 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec92e7-2d0f-4ca4-a331-96b78d98b656 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:00.182773 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec92e7-2d0f-4ca4-a331-96b78d98b656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:00.183051 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec92e7-2d0f-4ca4-a331-96b78d98b656 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:00.183422 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7541a-14a6-4167-b29f-833915c4f375 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:00.183795 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec92e7-2d0f-4ca4-a331-96b78d98b656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:00.184893 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b7541a-14a6-4167-b29f-833915c4f375 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:00.185439 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec92e7-2d0f-4ca4-a331-96b78d98b656 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:00.206446 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 812/1639] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:00.206446 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec92e7-2d0f-4ca4-a331-96b78d98b656 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:00.206878 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 828/1640] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:39:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:00.206878 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7541a-14a6-4167-b29f-833915c4f375 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:00.246862 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b7541a-14a6-4167-b29f-833915c4f375 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:00.262226 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6418c-f403-4512-8589-4b87c03ca984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:00.264755 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6418c-f403-4512-8589-4b87c03ca984 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:00.265411 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6418c-f403-4512-8589-4b87c03ca984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:00.268352 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f6418c-f403-4512-8589-4b87c03ca984 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:00.269737 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6418c-f403-4512-8589-4b87c03ca984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:00.273804 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f6418c-f403-4512-8589-4b87c03ca984 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:00.306105 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 829/1641] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:00.306481 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6418c-f403-4512-8589-4b87c03ca984 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:00.324348 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f6418c-f403-4512-8589-4b87c03ca984 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:00.335583 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9da442-2db8-4d70-aec7-f53926f452a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:00.337608 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9da442-2db8-4d70-aec7-f53926f452a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:00.337912 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9da442-2db8-4d70-aec7-f53926f452a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:00.338195 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9da442-2db8-4d70-aec7-f53926f452a9 admin admin] PATH_INFO: `/v3/projects/88ae2abddf53489fa6660ecc0b8c9101/users/b2d1e6630bb74b80ad68885818d925f2/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:00.344838 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec92e7-2d0f-4ca4-a331-96b78d98b656 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:00.346217 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9da442-2db8-4d70-aec7-f53926f452a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ae2abddf53489fa6660ecc0b8c9101, user_id=b2d1e6630bb74b80ad68885818d925f2, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:00.350001 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9da442-2db8-4d70-aec7-f53926f452a9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:00.351459 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a5b60-2acd-4917-b700-cf6a212b8c0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:00.352253 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a5b60-2acd-4917-b700-cf6a212b8c0b service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:00.352537 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a5b60-2acd-4917-b700-cf6a212b8c0b service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:00.354462 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a5b60-2acd-4917-b700-cf6a212b8c0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:00.388520 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 830/1642] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:00 2022] PUT /identity/v3/projects/88ae2abddf53489fa6660ecc0b8c9101/users/b2d1e6630bb74b80ad68885818d925f2/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:00.388520 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9da442-2db8-4d70-aec7-f53926f452a9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:00.460952 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a5b60-2acd-4917-b700-cf6a212b8c0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:00.463896 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a5b60-2acd-4917-b700-cf6a212b8c0b service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:00.476983 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 813/1643] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:00.478281 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a5b60-2acd-4917-b700-cf6a212b8c0b service nova] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:00.490243 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a5b60-2acd-4917-b700-cf6a212b8c0b service nova] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:00.513792 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9da442-2db8-4d70-aec7-f53926f452a9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:00.518937 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213aa61-f041-4ecd-bb83-953e6d688485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:00.520004 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213aa61-f041-4ecd-bb83-953e6d688485 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:00.520387 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213aa61-f041-4ecd-bb83-953e6d688485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:00.520763 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213aa61-f041-4ecd-bb83-953e6d688485 admin admin] PATH_INFO: `/v3/projects/68538ca073b8467a8045fece4ca77566/users/4518041fb8b648a7bd485a8ab2f56a68/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:00.522938 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213aa61-f041-4ecd-bb83-953e6d688485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68538ca073b8467a8045fece4ca77566, user_id=4518041fb8b648a7bd485a8ab2f56a68, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:00.526064 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b213aa61-f041-4ecd-bb83-953e6d688485 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:00.537515 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 831/1644] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:00 2022] PUT /identity/v3/projects/68538ca073b8467a8045fece4ca77566/users/4518041fb8b648a7bd485a8ab2f56a68/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:00.539008 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffecaf-935c-4653-a5a3-78ac625e98c9 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:00.539402 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffecaf-935c-4653-a5a3-78ac625e98c9 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:00.539785 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffecaf-935c-4653-a5a3-78ac625e98c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:00.561561 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb8140-9f8e-47eb-9383-b12321d6e05b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:00.562378 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb8140-9f8e-47eb-9383-b12321d6e05b service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:00.562929 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb8140-9f8e-47eb-9383-b12321d6e05b service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:00.563315 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb8140-9f8e-47eb-9383-b12321d6e05b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:00.598917 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-c0ffecaf-935c-4653-a5a3-78ac625e98c9 None None] MFA Rules not processed for user `b2d1e6630bb74b80ad68885818d925f2`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:00.600323 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c0ffecaf-935c-4653-a5a3-78ac625e98c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:00.656471 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb8140-9f8e-47eb-9383-b12321d6e05b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:00.658945 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb8140-9f8e-47eb-9383-b12321d6e05b service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:00.681637 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 814/1645] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:00.686220 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c90a4-c523-4aca-af8e-e4ac25cdc517 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:00.686800 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c90a4-c523-4aca-af8e-e4ac25cdc517 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:00.687191 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c90a4-c523-4aca-af8e-e4ac25cdc517 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:00.691804 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 815/1646] 10.222.0.36 () {54 vars in 912 bytes} [Wed Feb 9 04:40:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:40:00.696572 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368a1bc-f68d-409b-a1b0-c32a87003a7e None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:00.697102 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368a1bc-f68d-409b-a1b0-c32a87003a7e None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:00.697473 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368a1bc-f68d-409b-a1b0-c32a87003a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:00.751067 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 832/1647] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:00 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:00.752836 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a724f-42e3-4244-96ad-bdfd65e8d6bd None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:00.753202 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a724f-42e3-4244-96ad-bdfd65e8d6bd None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:00.753518 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a724f-42e3-4244-96ad-bdfd65e8d6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:00.771972 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-3368a1bc-f68d-409b-a1b0-c32a87003a7e None None] MFA Rules not processed for user `4518041fb8b648a7bd485a8ab2f56a68`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:00.775135 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-3368a1bc-f68d-409b-a1b0-c32a87003a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:00.787370 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-844a724f-42e3-4244-96ad-bdfd65e8d6bd None None] MFA Rules not processed for user `63fe98c10e974c019e05a2f68d012ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:00.790318 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-844a724f-42e3-4244-96ad-bdfd65e8d6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:00.948376 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 833/1648] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Feb 9 04:40:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:00.954732 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 816/1649] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:00 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:00.954930 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a724f-42e3-4244-96ad-bdfd65e8d6bd None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:00.955024 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a77f7-b90d-4c72-9168-4deda3d78429 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:00.955024 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a77f7-b90d-4c72-9168-4deda3d78429 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:00.955024 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a77f7-b90d-4c72-9168-4deda3d78429 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:00.957644 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 817/1650] 10.222.0.36 () {54 vars in 912 bytes} [Wed Feb 9 04:40:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:40:01.002425 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece241d-5b1d-4ce5-a285-03c2dc6bc2d4 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:01.002425 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece241d-5b1d-4ce5-a285-03c2dc6bc2d4 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:01.002425 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece241d-5b1d-4ce5-a285-03c2dc6bc2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:01.030778 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-1ece241d-5b1d-4ce5-a285-03c2dc6bc2d4 None None] MFA Rules not processed for user `63fe98c10e974c019e05a2f68d012ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:01.032475 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-1ece241d-5b1d-4ce5-a285-03c2dc6bc2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:01.060496 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 818/1651] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Feb 9 04:40:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:01.092060 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece241d-5b1d-4ce5-a285-03c2dc6bc2d4 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:01.093812 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a724f-42e3-4244-96ad-bdfd65e8d6bd None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:01.095097 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-1ece241d-5b1d-4ce5-a285-03c2dc6bc2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:01.097997 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053f694-5360-4d48-8dba-b50d98bdd17a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:01.098818 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053f694-5360-4d48-8dba-b50d98bdd17a service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:01.099078 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053f694-5360-4d48-8dba-b50d98bdd17a service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:01.099422 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053f694-5360-4d48-8dba-b50d98bdd17a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:01.118994 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053f694-5360-4d48-8dba-b50d98bdd17a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:01.119430 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053f694-5360-4d48-8dba-b50d98bdd17a service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:01.164571 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 834/1652] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:00 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:01.167480 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28061554-00f6-4d9d-98d1-0e059cddc7c2 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:01.170391 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28061554-00f6-4d9d-98d1-0e059cddc7c2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:01.170713 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28061554-00f6-4d9d-98d1-0e059cddc7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:01.241208 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-28061554-00f6-4d9d-98d1-0e059cddc7c2 None None] MFA Rules not processed for user `c43b2e2082b543828b9955ebdf3aaeab`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:01.243096 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-28061554-00f6-4d9d-98d1-0e059cddc7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:01.245695 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece241d-5b1d-4ce5-a285-03c2dc6bc2d4 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:01.260374 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1078bb6-0188-42e5-85c0-de77a878851e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6940472eb8e544c8aa3409328c804282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:01.264099 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1078bb6-0188-42e5-85c0-de77a878851e service glance] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:01.264099 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1078bb6-0188-42e5-85c0-de77a878851e service glance] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:01.264099 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1078bb6-0188-42e5-85c0-de77a878851e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:01.303099 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1078bb6-0188-42e5-85c0-de77a878851e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:01.304577 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1078bb6-0188-42e5-85c0-de77a878851e service glance] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:01.332391 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 819/1653] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:40:01.333114 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1078bb6-0188-42e5-85c0-de77a878851e service glance] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:01.360914 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1078bb6-0188-42e5-85c0-de77a878851e service glance] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:01.369075 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea994f6-e378-4e8e-9097-7fe43a68f5e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:01.370191 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea994f6-e378-4e8e-9097-7fe43a68f5e5 service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:01.370485 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea994f6-e378-4e8e-9097-7fe43a68f5e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:01.370790 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea994f6-e378-4e8e-9097-7fe43a68f5e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:01.372927 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 835/1654] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:01.374207 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28061554-00f6-4d9d-98d1-0e059cddc7c2 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:01.390972 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28061554-00f6-4d9d-98d1-0e059cddc7c2 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:01.397724 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea994f6-e378-4e8e-9097-7fe43a68f5e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:01.399187 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea994f6-e378-4e8e-9097-7fe43a68f5e5 service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:01.406233 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26fd97-bfb2-4d11-96e5-a54c117ecf68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:01.406915 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26fd97-bfb2-4d11-96e5-a54c117ecf68 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:01.407198 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26fd97-bfb2-4d11-96e5-a54c117ecf68 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:01.407476 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26fd97-bfb2-4d11-96e5-a54c117ecf68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:01.422356 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26fd97-bfb2-4d11-96e5-a54c117ecf68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:01.422856 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 820/1655] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:01 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:01.423930 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d26fd97-bfb2-4d11-96e5-a54c117ecf68 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:01.424773 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656db89-cafd-493b-a8bb-85ff147f20d0 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:01.424997 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656db89-cafd-493b-a8bb-85ff147f20d0 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:01.425334 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656db89-cafd-493b-a8bb-85ff147f20d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:01.449392 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 836/1656] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:01.477167 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-b656db89-cafd-493b-a8bb-85ff147f20d0 None None] MFA Rules not processed for user `c43b2e2082b543828b9955ebdf3aaeab`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:01.478431 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-b656db89-cafd-493b-a8bb-85ff147f20d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:01.500348 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 821/1657] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:01.640374 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26fd97-bfb2-4d11-96e5-a54c117ecf68 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:01.652303 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26fd97-bfb2-4d11-96e5-a54c117ecf68 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:01.660309 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373a5b2-1dcf-4b62-b75b-4d5a16db87fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:01.660964 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373a5b2-1dcf-4b62-b75b-4d5a16db87fe service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:01.661271 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373a5b2-1dcf-4b62-b75b-4d5a16db87fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:01.665754 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373a5b2-1dcf-4b62-b75b-4d5a16db87fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:01.781675 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373a5b2-1dcf-4b62-b75b-4d5a16db87fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:01.785767 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373a5b2-1dcf-4b62-b75b-4d5a16db87fe service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:01.809388 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 837/1658] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:01 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:01.865536 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da7996-6bd9-4c46-af87-dfc420290a90 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:01.865825 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da7996-6bd9-4c46-af87-dfc420290a90 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:01.866101 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da7996-6bd9-4c46-af87-dfc420290a90 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:01.868119 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 822/1659] 10.222.0.36 () {54 vars in 912 bytes} [Wed Feb 9 04:40:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:40:01.877333 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac1a1a-de39-495b-b505-6ce1eae90f34 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:01.877620 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac1a1a-de39-495b-b505-6ce1eae90f34 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:01.877898 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac1a1a-de39-495b-b505-6ce1eae90f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:01.956358 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d4ac1a1a-de39-495b-b505-6ce1eae90f34 None None] MFA Rules not processed for user `80015d086ec24caf9414d2ef5f660f08`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:01.958739 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d4ac1a1a-de39-495b-b505-6ce1eae90f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:01.974405 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da7996-6bd9-4c46-af87-dfc420290a90 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:01.997784 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da7996-6bd9-4c46-af87-dfc420290a90 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:02.006054 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126136f-3c2b-4042-bca5-a389ac48107e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:02.007316 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126136f-3c2b-4042-bca5-a389ac48107e service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:02.008380 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126136f-3c2b-4042-bca5-a389ac48107e service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:02.008855 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126136f-3c2b-4042-bca5-a389ac48107e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:02.035973 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 838/1660] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Feb 9 04:40:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:02.047926 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac1a1a-de39-495b-b505-6ce1eae90f34 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:02.063030 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac1a1a-de39-495b-b505-6ce1eae90f34 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:02.071713 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a62534-70e5-423a-b9e5-c260c49db250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:02.072477 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a62534-70e5-423a-b9e5-c260c49db250 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:02.072933 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a62534-70e5-423a-b9e5-c260c49db250 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:02.073353 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a62534-70e5-423a-b9e5-c260c49db250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:02.089916 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a62534-70e5-423a-b9e5-c260c49db250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:02.093946 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a62534-70e5-423a-b9e5-c260c49db250 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:02.103990 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126136f-3c2b-4042-bca5-a389ac48107e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:02.105467 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126136f-3c2b-4042-bca5-a389ac48107e service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:02.116685 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 823/1661] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:02.118622 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 839/1662] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:02.155176 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126136f-3c2b-4042-bca5-a389ac48107e service cinder] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:02.173979 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126136f-3c2b-4042-bca5-a389ac48107e service cinder] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:02.182072 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d596da2-144d-426a-bde3-54ee3283172c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:02.183111 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d596da2-144d-426a-bde3-54ee3283172c service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:02.183620 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d596da2-144d-426a-bde3-54ee3283172c service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:02.184140 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d596da2-144d-426a-bde3-54ee3283172c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:02.223473 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d596da2-144d-426a-bde3-54ee3283172c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:02.229208 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d596da2-144d-426a-bde3-54ee3283172c service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:02.256289 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 824/1663] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:02.384649 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b157bbd-31cb-47b2-8a2a-f5ceec89abbf None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:02.384934 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b157bbd-31cb-47b2-8a2a-f5ceec89abbf None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:02.385274 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b157bbd-31cb-47b2-8a2a-f5ceec89abbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:02.424610 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-7b157bbd-31cb-47b2-8a2a-f5ceec89abbf None None] MFA Rules not processed for user `b46db588a5ee4272a0ebdc24c4f5dab7`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:02.425917 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7b157bbd-31cb-47b2-8a2a-f5ceec89abbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:02.520290 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 840/1664] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:02.535312 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438b1d4-1afc-46f9-a63b-fb7aac71ee36 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:02.535613 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438b1d4-1afc-46f9-a63b-fb7aac71ee36 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:02.535896 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438b1d4-1afc-46f9-a63b-fb7aac71ee36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:02.554987 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-8438b1d4-1afc-46f9-a63b-fb7aac71ee36 None None] MFA Rules not processed for user `b46db588a5ee4272a0ebdc24c4f5dab7`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:02.556192 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-8438b1d4-1afc-46f9-a63b-fb7aac71ee36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:02.564473 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 825/1665] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:02.861932 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b157bbd-31cb-47b2-8a2a-f5ceec89abbf None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:02.891230 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff699ac3-e8a2-40c8-bd1b-951d049a9ca5 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:02.891517 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff699ac3-e8a2-40c8-bd1b-951d049a9ca5 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:02.891795 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff699ac3-e8a2-40c8-bd1b-951d049a9ca5 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:02.897814 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 826/1666] 10.222.0.36 () {54 vars in 912 bytes} [Wed Feb 9 04:40:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:40:02.906792 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aab81f-ed21-49cf-b7bd-19bb0694e265 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:02.907442 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aab81f-ed21-49cf-b7bd-19bb0694e265 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:02.907850 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aab81f-ed21-49cf-b7bd-19bb0694e265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:02.950292 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-c7aab81f-ed21-49cf-b7bd-19bb0694e265 None None] MFA Rules not processed for user `80015d086ec24caf9414d2ef5f660f08`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:02.951567 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-c7aab81f-ed21-49cf-b7bd-19bb0694e265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:02.959518 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 827/1667] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Feb 9 04:40:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:40:02.965743 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b157bbd-31cb-47b2-8a2a-f5ceec89abbf None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:02.970431 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aab81f-ed21-49cf-b7bd-19bb0694e265 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:02.971411 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21d647-801c-4475-bbda-593e1b26ed74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add56fc0cfd8403b86c5ef23fd374a5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:02.972449 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21d647-801c-4475-bbda-593e1b26ed74 service placement] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:02.972781 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21d647-801c-4475-bbda-593e1b26ed74 service placement] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:02.973109 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b21d647-801c-4475-bbda-593e1b26ed74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:02.974973 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5b21d647-801c-4475-bbda-593e1b26ed74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:02.980105 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aab81f-ed21-49cf-b7bd-19bb0694e265 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:02.983966 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24566de5-dfbf-4a74-addd-3631637c0a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:02.985243 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24566de5-dfbf-4a74-addd-3631637c0a6d service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:02.985243 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24566de5-dfbf-4a74-addd-3631637c0a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:02.985456 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24566de5-dfbf-4a74-addd-3631637c0a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:02.988090 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21d647-801c-4475-bbda-593e1b26ed74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:02.990417 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b21d647-801c-4475-bbda-593e1b26ed74 service placement] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:02.994522 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24566de5-dfbf-4a74-addd-3631637c0a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:02.997115 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24566de5-dfbf-4a74-addd-3631637c0a6d service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:03.002906 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 841/1668] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:40:03.009058 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 828/1669] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:40:03.119410 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21d647-801c-4475-bbda-593e1b26ed74 service placement] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:03.138359 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b21d647-801c-4475-bbda-593e1b26ed74 service placement] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:03.148911 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e73c79-db38-43cc-9058-790ee9edb3f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:03.154097 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e73c79-db38-43cc-9058-790ee9edb3f9 service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:03.157477 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e73c79-db38-43cc-9058-790ee9edb3f9 service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:03.157862 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e73c79-db38-43cc-9058-790ee9edb3f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:03.172553 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e73c79-db38-43cc-9058-790ee9edb3f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:03.174225 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e73c79-db38-43cc-9058-790ee9edb3f9 service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:03.198064 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 842/1670] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:04.001208 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24566de5-dfbf-4a74-addd-3631637c0a6d service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:04.142302 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24566de5-dfbf-4a74-addd-3631637c0a6d service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:04.149281 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af75f4f-1a50-47fc-a91a-2af93eacaa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:04.151342 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af75f4f-1a50-47fc-a91a-2af93eacaa16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:04.152231 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af75f4f-1a50-47fc-a91a-2af93eacaa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:04.152682 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af75f4f-1a50-47fc-a91a-2af93eacaa16 admin admin] PATH_INFO: `/v3/users/dd710243719e45e5b48870d61044083d` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:04.155019 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af75f4f-1a50-47fc-a91a-2af93eacaa16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd710243719e45e5b48870d61044083d)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:04.157913 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af75f4f-1a50-47fc-a91a-2af93eacaa16 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:04.272783 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9af75f4f-1a50-47fc-a91a-2af93eacaa16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd710243719e45e5b48870d61044083d'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:04.300991 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9af75f4f-1a50-47fc-a91a-2af93eacaa16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd710243719e45e5b48870d61044083d'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:04.307099 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9af75f4f-1a50-47fc-a91a-2af93eacaa16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd710243719e45e5b48870d61044083d'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:04.355830 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9af75f4f-1a50-47fc-a91a-2af93eacaa16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd710243719e45e5b48870d61044083d'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:04.383057 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9af75f4f-1a50-47fc-a91a-2af93eacaa16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd710243719e45e5b48870d61044083d'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:04.394808 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 829/1671] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:40:04 2022] DELETE /identity/v3/users/dd710243719e45e5b48870d61044083d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:04.397887 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d989ed-f3b4-41bb-bfe6-ad39f52cd807 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:04.398410 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d989ed-f3b4-41bb-bfe6-ad39f52cd807 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:04.398640 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d989ed-f3b4-41bb-bfe6-ad39f52cd807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:04.460712 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-76d989ed-f3b4-41bb-bfe6-ad39f52cd807 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:04.469637 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-76d989ed-f3b4-41bb-bfe6-ad39f52cd807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:04.700221 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 843/1672] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:04.711983 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af75f4f-1a50-47fc-a91a-2af93eacaa16 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:04.714091 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-9af75f4f-1a50-47fc-a91a-2af93eacaa16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:04.894003 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a801d2-a7d8-4ef9-a23d-fa8f9c0a8ce4 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:04.894543 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a801d2-a7d8-4ef9-a23d-fa8f9c0a8ce4 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:04.894988 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a801d2-a7d8-4ef9-a23d-fa8f9c0a8ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:04.950648 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-14a801d2-a7d8-4ef9-a23d-fa8f9c0a8ce4 None None] MFA Rules not processed for user `b46db588a5ee4272a0ebdc24c4f5dab7`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:04.954553 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-14a801d2-a7d8-4ef9-a23d-fa8f9c0a8ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:04.970706 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af75f4f-1a50-47fc-a91a-2af93eacaa16 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:04.981262 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb2ae7-2ec8-48cf-bd04-1119c0460d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:04.981993 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb2ae7-2ec8-48cf-bd04-1119c0460d8d service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:04.982279 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb2ae7-2ec8-48cf-bd04-1119c0460d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:04.982561 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb2ae7-2ec8-48cf-bd04-1119c0460d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:05.000783 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb2ae7-2ec8-48cf-bd04-1119c0460d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:05.002558 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb2ae7-2ec8-48cf-bd04-1119c0460d8d service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:05.030013 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 830/1673] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:05.117583 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 844/1674] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:40:05.642334 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb2ae7-2ec8-48cf-bd04-1119c0460d8d service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:05.644046 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-4feb2ae7-2ec8-48cf-bd04-1119c0460d8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:05.689084 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb2ae7-2ec8-48cf-bd04-1119c0460d8d service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:05.706979 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b431c-80f3-490b-8e4c-a21b86b3fadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:05.707848 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b431c-80f3-490b-8e4c-a21b86b3fadb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:05.708129 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b431c-80f3-490b-8e4c-a21b86b3fadb admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:05.708865 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b431c-80f3-490b-8e4c-a21b86b3fadb admin admin] PATH_INFO: `/v3/projects/91eecc080e2a48aa8b82e2c7be8a801f` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:05.710726 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b431c-80f3-490b-8e4c-a21b86b3fadb admin admin] RBAC: Authorizing `identity:delete_project(project_id=91eecc080e2a48aa8b82e2c7be8a801f)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:05.714065 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: WARNING py.warnings [None req-0e0b431c-80f3-490b-8e4c-a21b86b3fadb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:40:05.714065 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: warnings.warn(msg) Feb 09 04:40:05.714065 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: Feb 09 04:40:05.716780 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b431c-80f3-490b-8e4c-a21b86b3fadb admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:05.885654 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0e0b431c-80f3-490b-8e4c-a21b86b3fadb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91eecc080e2a48aa8b82e2c7be8a801f', 'request_id': 'req-0e0b431c-80f3-490b-8e4c-a21b86b3fadb'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:05.895808 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0e0b431c-80f3-490b-8e4c-a21b86b3fadb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91eecc080e2a48aa8b82e2c7be8a801f', 'request_id': 'req-0e0b431c-80f3-490b-8e4c-a21b86b3fadb'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:05.921657 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0e0b431c-80f3-490b-8e4c-a21b86b3fadb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91eecc080e2a48aa8b82e2c7be8a801f', 'request_id': 'req-0e0b431c-80f3-490b-8e4c-a21b86b3fadb'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:05.939683 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0e0b431c-80f3-490b-8e4c-a21b86b3fadb admin admin] The token cache is being invalidate because project 91eecc080e2a48aa8b82e2c7be8a801f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:40:05.940268 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0e0b431c-80f3-490b-8e4c-a21b86b3fadb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:05.941585 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0e0b431c-80f3-490b-8e4c-a21b86b3fadb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:05.943438 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 831/1675] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:40:05 2022] DELETE /identity/v3/projects/91eecc080e2a48aa8b82e2c7be8a801f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:05.948680 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a801d2-a7d8-4ef9-a23d-fa8f9c0a8ce4 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:05.972815 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a801d2-a7d8-4ef9-a23d-fa8f9c0a8ce4 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:06.061617 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9e1ea-dc9f-4b0d-9fd5-751a30a70dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:06.062519 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9e1ea-dc9f-4b0d-9fd5-751a30a70dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:06.062803 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9e1ea-dc9f-4b0d-9fd5-751a30a70dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:06.063078 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9e1ea-dc9f-4b0d-9fd5-751a30a70dbc admin admin] PATH_INFO: `/v3/users/8db037914c6c4b6f9ae111c09d243540` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:06.064475 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9e1ea-dc9f-4b0d-9fd5-751a30a70dbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8db037914c6c4b6f9ae111c09d243540)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:06.065547 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: WARNING py.warnings [None req-01d9e1ea-dc9f-4b0d-9fd5-751a30a70dbc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 09 04:40:06.065547 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: warnings.warn(msg) Feb 09 04:40:06.065547 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: Feb 09 04:40:06.066844 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9e1ea-dc9f-4b0d-9fd5-751a30a70dbc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:06.150591 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-01d9e1ea-dc9f-4b0d-9fd5-751a30a70dbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8db037914c6c4b6f9ae111c09d243540'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:06.163169 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-01d9e1ea-dc9f-4b0d-9fd5-751a30a70dbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8db037914c6c4b6f9ae111c09d243540'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:06.164196 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-01d9e1ea-dc9f-4b0d-9fd5-751a30a70dbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8db037914c6c4b6f9ae111c09d243540'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:06.187409 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-01d9e1ea-dc9f-4b0d-9fd5-751a30a70dbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8db037914c6c4b6f9ae111c09d243540'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:06.199767 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-01d9e1ea-dc9f-4b0d-9fd5-751a30a70dbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8db037914c6c4b6f9ae111c09d243540'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:06.215039 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 845/1676] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:40:05 2022] DELETE /identity/v3/users/8db037914c6c4b6f9ae111c09d243540 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:40:06.592018 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b431c-80f3-490b-8e4c-a21b86b3fadb admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:06.593638 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-0e0b431c-80f3-490b-8e4c-a21b86b3fadb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:06.640505 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b431c-80f3-490b-8e4c-a21b86b3fadb admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:06.740352 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389b194-8d0c-4692-a5df-1f5deb2997bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:06.741275 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389b194-8d0c-4692-a5df-1f5deb2997bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:06.741555 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389b194-8d0c-4692-a5df-1f5deb2997bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:06.742617 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389b194-8d0c-4692-a5df-1f5deb2997bd admin admin] PATH_INFO: `/v3/projects/4cbf6f0e15b54da9b382f4ab2fc622cf` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:06.743826 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389b194-8d0c-4692-a5df-1f5deb2997bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cbf6f0e15b54da9b382f4ab2fc622cf)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:06.745916 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389b194-8d0c-4692-a5df-1f5deb2997bd admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:06.821206 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-c389b194-8d0c-4692-a5df-1f5deb2997bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cbf6f0e15b54da9b382f4ab2fc622cf', 'request_id': 'req-c389b194-8d0c-4692-a5df-1f5deb2997bd'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:06.833787 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-c389b194-8d0c-4692-a5df-1f5deb2997bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cbf6f0e15b54da9b382f4ab2fc622cf', 'request_id': 'req-c389b194-8d0c-4692-a5df-1f5deb2997bd'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:06.843434 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-c389b194-8d0c-4692-a5df-1f5deb2997bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cbf6f0e15b54da9b382f4ab2fc622cf', 'request_id': 'req-c389b194-8d0c-4692-a5df-1f5deb2997bd'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:06.859847 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-c389b194-8d0c-4692-a5df-1f5deb2997bd admin admin] The token cache is being invalidate because project 4cbf6f0e15b54da9b382f4ab2fc622cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:40:06.860190 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-c389b194-8d0c-4692-a5df-1f5deb2997bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:06.862050 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-c389b194-8d0c-4692-a5df-1f5deb2997bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:06.864845 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 832/1677] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:40:06 2022] DELETE /identity/v3/projects/4cbf6f0e15b54da9b382f4ab2fc622cf => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:06.870282 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fb6dd-a788-478b-bc86-f350ec64996c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:06.870668 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fb6dd-a788-478b-bc86-f350ec64996c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:06.871020 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fb6dd-a788-478b-bc86-f350ec64996c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:06.911860 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-b54fb6dd-a788-478b-bc86-f350ec64996c None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:06.914301 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b54fb6dd-a788-478b-bc86-f350ec64996c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:07.010636 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 846/1678] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:40:07.019888 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fbc03-ca44-436e-a4f2-f704aef54ceb None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:07.020176 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fbc03-ca44-436e-a4f2-f704aef54ceb None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:07.020459 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fbc03-ca44-436e-a4f2-f704aef54ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:07.042877 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-974fbc03-ca44-436e-a4f2-f704aef54ceb None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:07.044111 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-974fbc03-ca44-436e-a4f2-f704aef54ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:07.053734 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 833/1679] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:07.057968 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fb6dd-a788-478b-bc86-f350ec64996c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:07.067819 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fb6dd-a788-478b-bc86-f350ec64996c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:07.072350 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78a235-9475-4de6-96be-fc0fceced87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:07.073070 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78a235-9475-4de6-96be-fc0fceced87f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:07.073355 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78a235-9475-4de6-96be-fc0fceced87f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:07.073628 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78a235-9475-4de6-96be-fc0fceced87f admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:07.074369 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78a235-9475-4de6-96be-fc0fceced87f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:40:07.074674 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78a235-9475-4de6-96be-fc0fceced87f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:07.076309 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78a235-9475-4de6-96be-fc0fceced87f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:07.088645 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 847/1680] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:40:07.093211 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fbc03-ca44-436e-a4f2-f704aef54ceb None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:07.103368 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fbc03-ca44-436e-a4f2-f704aef54ceb None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:07.108242 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3f4a1-c262-46f4-b284-00a33c0202f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:07.108899 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3f4a1-c262-46f4-b284-00a33c0202f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:07.109222 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3f4a1-c262-46f4-b284-00a33c0202f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:07.109498 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3f4a1-c262-46f4-b284-00a33c0202f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:07.110214 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3f4a1-c262-46f4-b284-00a33c0202f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:07.112160 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3f4a1-c262-46f4-b284-00a33c0202f5 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:07.138675 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 834/1681] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:40:07 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:07.142824 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78a235-9475-4de6-96be-fc0fceced87f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:07.153862 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78a235-9475-4de6-96be-fc0fceced87f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:07.214446 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512407f-33fc-496e-a386-67ac64b87f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:07.215124 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512407f-33fc-496e-a386-67ac64b87f2d admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:07.215404 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512407f-33fc-496e-a386-67ac64b87f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:07.215679 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512407f-33fc-496e-a386-67ac64b87f2d admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:07.216379 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512407f-33fc-496e-a386-67ac64b87f2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:07.218580 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512407f-33fc-496e-a386-67ac64b87f2d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:07.240593 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 848/1682] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:40:07 2022] POST /identity/v3/users => generated 303 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:07.244377 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3f4a1-c262-46f4-b284-00a33c0202f5 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:07.255645 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3f4a1-c262-46f4-b284-00a33c0202f5 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:07.260663 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7f9a7-c7fa-4910-86e8-add5e32e7022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:07.261378 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7f9a7-c7fa-4910-86e8-add5e32e7022 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:07.261663 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7f9a7-c7fa-4910-86e8-add5e32e7022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:07.261938 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7f9a7-c7fa-4910-86e8-add5e32e7022 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:07.262676 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7f9a7-c7fa-4910-86e8-add5e32e7022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:07.264312 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af7f9a7-c7fa-4910-86e8-add5e32e7022 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:07.275547 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 835/1683] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:40:07.279558 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512407f-33fc-496e-a386-67ac64b87f2d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:07.289954 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512407f-33fc-496e-a386-67ac64b87f2d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:07.294613 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581adb4b-e3e5-4ae2-96c3-32878a5bd8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:07.295283 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581adb4b-e3e5-4ae2-96c3-32878a5bd8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:07.295566 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581adb4b-e3e5-4ae2-96c3-32878a5bd8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:07.295840 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581adb4b-e3e5-4ae2-96c3-32878a5bd8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:07.296584 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581adb4b-e3e5-4ae2-96c3-32878a5bd8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:07.298365 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581adb4b-e3e5-4ae2-96c3-32878a5bd8a7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:07.309591 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 849/1684] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:40:07.313839 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7f9a7-c7fa-4910-86e8-add5e32e7022 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:07.334616 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7f9a7-c7fa-4910-86e8-add5e32e7022 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:07.339348 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd3144-4bfa-4798-920e-b1dfe18facf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:07.340231 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd3144-4bfa-4798-920e-b1dfe18facf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:07.340515 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd3144-4bfa-4798-920e-b1dfe18facf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:07.340811 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd3144-4bfa-4798-920e-b1dfe18facf6 admin admin] PATH_INFO: `/v3/projects/dbf7e19994e14d6d90524c73b011d5dd/users/2e465f2986fd44c094cadac569041dd9/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:07.355993 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd3144-4bfa-4798-920e-b1dfe18facf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbf7e19994e14d6d90524c73b011d5dd, user_id=2e465f2986fd44c094cadac569041dd9, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:07.358685 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd3144-4bfa-4798-920e-b1dfe18facf6 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:07.373125 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 836/1685] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:07 2022] PUT /identity/v3/projects/dbf7e19994e14d6d90524c73b011d5dd/users/2e465f2986fd44c094cadac569041dd9/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:07.383210 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa95b80-9ad4-4a0d-9ba0-a389060131ec None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:07.383499 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa95b80-9ad4-4a0d-9ba0-a389060131ec None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:07.383795 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa95b80-9ad4-4a0d-9ba0-a389060131ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:07.411605 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-afa95b80-9ad4-4a0d-9ba0-a389060131ec None None] MFA Rules not processed for user `2e465f2986fd44c094cadac569041dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:07.412853 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-afa95b80-9ad4-4a0d-9ba0-a389060131ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:07.476208 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 850/1686] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:07 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:07.480641 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd3144-4bfa-4798-920e-b1dfe18facf6 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:07.542700 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd3144-4bfa-4798-920e-b1dfe18facf6 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:07.548335 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2493a7-2d73-4a22-be0e-d10a87b9ca35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:07.549210 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2493a7-2d73-4a22-be0e-d10a87b9ca35 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:07.549449 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2493a7-2d73-4a22-be0e-d10a87b9ca35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:07.549730 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2493a7-2d73-4a22-be0e-d10a87b9ca35 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:07.550436 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2493a7-2d73-4a22-be0e-d10a87b9ca35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:07.552362 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2493a7-2d73-4a22-be0e-d10a87b9ca35 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:07.580259 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 837/1687] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:40:07 2022] POST /identity/v3/projects => generated 409 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:07.582210 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa95b80-9ad4-4a0d-9ba0-a389060131ec None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:07.592616 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa95b80-9ad4-4a0d-9ba0-a389060131ec None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:07.649148 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af01c0-36d4-4120-84dd-60b82f9521de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:07.649862 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af01c0-36d4-4120-84dd-60b82f9521de admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:07.650143 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af01c0-36d4-4120-84dd-60b82f9521de admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:07.650681 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af01c0-36d4-4120-84dd-60b82f9521de admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:07.651395 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af01c0-36d4-4120-84dd-60b82f9521de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:07.653403 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af01c0-36d4-4120-84dd-60b82f9521de admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:07.674007 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 851/1688] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:40:07 2022] POST /identity/v3/users => generated 311 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:07.677918 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2493a7-2d73-4a22-be0e-d10a87b9ca35 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:07.687895 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2493a7-2d73-4a22-be0e-d10a87b9ca35 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:07.692440 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07abb92-a557-421c-b2a3-c78f3de2081d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:07.693123 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07abb92-a557-421c-b2a3-c78f3de2081d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:07.693407 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07abb92-a557-421c-b2a3-c78f3de2081d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:07.693683 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07abb92-a557-421c-b2a3-c78f3de2081d admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:07.694414 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07abb92-a557-421c-b2a3-c78f3de2081d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:07.696007 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07abb92-a557-421c-b2a3-c78f3de2081d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:07.706127 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 838/1689] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:07.710680 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af01c0-36d4-4120-84dd-60b82f9521de admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:07.720340 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af01c0-36d4-4120-84dd-60b82f9521de admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:07.725658 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c6f0d-cc0e-4db5-8154-4843dc004dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:07.726568 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c6f0d-cc0e-4db5-8154-4843dc004dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:07.726851 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c6f0d-cc0e-4db5-8154-4843dc004dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:07.727135 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c6f0d-cc0e-4db5-8154-4843dc004dd1 admin admin] PATH_INFO: `/v3/projects/869e4dded223483093ef6104763c63c1/users/13d5dd2a56d549e4933d76cd3ac4bbd7/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:07.741098 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c6f0d-cc0e-4db5-8154-4843dc004dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869e4dded223483093ef6104763c63c1, user_id=13d5dd2a56d549e4933d76cd3ac4bbd7, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:07.743787 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97c6f0d-cc0e-4db5-8154-4843dc004dd1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:07.756104 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 852/1690] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:07 2022] PUT /identity/v3/projects/869e4dded223483093ef6104763c63c1/users/13d5dd2a56d549e4933d76cd3ac4bbd7/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:07.760340 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07abb92-a557-421c-b2a3-c78f3de2081d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:07.770687 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07abb92-a557-421c-b2a3-c78f3de2081d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:07.826274 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a4e2d-031f-47df-aec2-b336506c99ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:07.826941 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a4e2d-031f-47df-aec2-b336506c99ce admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:07.827221 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a4e2d-031f-47df-aec2-b336506c99ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:07.827498 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a4e2d-031f-47df-aec2-b336506c99ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:07.828231 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a4e2d-031f-47df-aec2-b336506c99ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:07.829848 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a4e2d-031f-47df-aec2-b336506c99ce admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:07.840821 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 839/1691] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:07.844725 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c6f0d-cc0e-4db5-8154-4843dc004dd1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:07.858669 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c6f0d-cc0e-4db5-8154-4843dc004dd1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:07.863206 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59041c1-79d5-4064-b011-1391fe2b513f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:07.864097 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59041c1-79d5-4064-b011-1391fe2b513f admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:07.864373 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59041c1-79d5-4064-b011-1391fe2b513f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:07.864650 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59041c1-79d5-4064-b011-1391fe2b513f admin admin] PATH_INFO: `/v3/projects/869e4dded223483093ef6104763c63c1/users/13d5dd2a56d549e4933d76cd3ac4bbd7/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:07.866613 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59041c1-79d5-4064-b011-1391fe2b513f admin admin] RBAC: Authorizing `identity:create_grant(project_id=869e4dded223483093ef6104763c63c1, user_id=13d5dd2a56d549e4933d76cd3ac4bbd7, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:07.869312 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59041c1-79d5-4064-b011-1391fe2b513f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:07.880017 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 853/1692] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:07 2022] PUT /identity/v3/projects/869e4dded223483093ef6104763c63c1/users/13d5dd2a56d549e4933d76cd3ac4bbd7/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:07.890978 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfab33-0472-4b53-8913-2531c20fa74c None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:07.891270 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfab33-0472-4b53-8913-2531c20fa74c None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:07.891554 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edfab33-0472-4b53-8913-2531c20fa74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:07.918885 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-1edfab33-0472-4b53-8913-2531c20fa74c None None] MFA Rules not processed for user `13d5dd2a56d549e4933d76cd3ac4bbd7`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:07.920078 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-1edfab33-0472-4b53-8913-2531c20fa74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:07.984528 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 840/1693] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:07 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:40:07.994128 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59041c1-79d5-4064-b011-1391fe2b513f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:07.995849 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c59041c1-79d5-4064-b011-1391fe2b513f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:08.049103 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59041c1-79d5-4064-b011-1391fe2b513f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:08.052640 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b160704-cb54-4afd-96ac-dd78e4ae2cb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:08.053281 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b160704-cb54-4afd-96ac-dd78e4ae2cb5 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:08.053559 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b160704-cb54-4afd-96ac-dd78e4ae2cb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:08.053832 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b160704-cb54-4afd-96ac-dd78e4ae2cb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:08.062307 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b160704-cb54-4afd-96ac-dd78e4ae2cb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:08.063730 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b160704-cb54-4afd-96ac-dd78e4ae2cb5 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:08.073836 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 854/1694] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:07 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:08.249219 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfab33-0472-4b53-8913-2531c20fa74c None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:08.259659 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edfab33-0472-4b53-8913-2531c20fa74c None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:08.263903 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c4ed8-9c09-4eee-9cb0-1f7e2e1a5cdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:08.264613 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c4ed8-9c09-4eee-9cb0-1f7e2e1a5cdc service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:08.264881 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c4ed8-9c09-4eee-9cb0-1f7e2e1a5cdc service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:08.265195 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c4ed8-9c09-4eee-9cb0-1f7e2e1a5cdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:08.320657 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c4ed8-9c09-4eee-9cb0-1f7e2e1a5cdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:08.322175 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c4ed8-9c09-4eee-9cb0-1f7e2e1a5cdc service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:08.331113 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 841/1695] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:08 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:11.009952 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce033fdc-0702-48fd-823b-36bd54a7cf63 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:11.010406 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce033fdc-0702-48fd-823b-36bd54a7cf63 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:11.010563 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce033fdc-0702-48fd-823b-36bd54a7cf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:11.028831 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ce033fdc-0702-48fd-823b-36bd54a7cf63 None None] MFA Rules not processed for user `98a27dbe620c4aff967363a7d48c46e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:11.030060 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ce033fdc-0702-48fd-823b-36bd54a7cf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:11.117146 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 855/1696] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Feb 9 04:40:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:11.216688 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c4ed8-9c09-4eee-9cb0-1f7e2e1a5cdc service cinder] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:11.218266 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-3f6c4ed8-9c09-4eee-9cb0-1f7e2e1a5cdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:11.287653 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c4ed8-9c09-4eee-9cb0-1f7e2e1a5cdc service cinder] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:11.292807 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed576804-6551-492a-898f-726b413fdd7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66fd482451f743cdb692677e57508764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:11.293547 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed576804-6551-492a-898f-726b413fdd7c service swift] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:11.293831 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed576804-6551-492a-898f-726b413fdd7c service swift] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:11.294106 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed576804-6551-492a-898f-726b413fdd7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:11.302846 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed576804-6551-492a-898f-726b413fdd7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:11.304437 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed576804-6551-492a-898f-726b413fdd7c service swift] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:11.312294 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 842/1697] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Feb 9 04:40:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:40:18.794271 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce033fdc-0702-48fd-823b-36bd54a7cf63 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:18.795860 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ce033fdc-0702-48fd-823b-36bd54a7cf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:18.865183 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce033fdc-0702-48fd-823b-36bd54a7cf63 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:18.870985 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce49c9f-49c5-4438-9831-0ae52470012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:18.871863 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce49c9f-49c5-4438-9831-0ae52470012c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:18.872169 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce49c9f-49c5-4438-9831-0ae52470012c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:18.872471 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce49c9f-49c5-4438-9831-0ae52470012c admin admin] PATH_INFO: `/v3/users/dc69e7f932e346bd89284ef286605175` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:18.873735 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce49c9f-49c5-4438-9831-0ae52470012c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc69e7f932e346bd89284ef286605175)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:18.875716 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce49c9f-49c5-4438-9831-0ae52470012c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:18.925624 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6ce49c9f-49c5-4438-9831-0ae52470012c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc69e7f932e346bd89284ef286605175'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:18.932219 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6ce49c9f-49c5-4438-9831-0ae52470012c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc69e7f932e346bd89284ef286605175'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:18.932827 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6ce49c9f-49c5-4438-9831-0ae52470012c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc69e7f932e346bd89284ef286605175'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:18.944066 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6ce49c9f-49c5-4438-9831-0ae52470012c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc69e7f932e346bd89284ef286605175'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:18.950729 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6ce49c9f-49c5-4438-9831-0ae52470012c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc69e7f932e346bd89284ef286605175'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:18.956778 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 856/1698] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:40:18 2022] DELETE /identity/v3/users/dc69e7f932e346bd89284ef286605175 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:18.961746 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff7095-adc1-4edd-96a8-e6673d66bb27 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:18.962266 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff7095-adc1-4edd-96a8-e6673d66bb27 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:18.962358 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff7095-adc1-4edd-96a8-e6673d66bb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:18.979315 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-0dff7095-adc1-4edd-96a8-e6673d66bb27 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:18.980502 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-0dff7095-adc1-4edd-96a8-e6673d66bb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:19.036830 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 843/1699] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:19.046410 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce49c9f-49c5-4438-9831-0ae52470012c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:19.047793 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6ce49c9f-49c5-4438-9831-0ae52470012c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:19.102467 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce49c9f-49c5-4438-9831-0ae52470012c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:19.106028 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c50b6-9e90-4d99-85df-9a787051faab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:19.106664 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c50b6-9e90-4d99-85df-9a787051faab service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:19.106950 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c50b6-9e90-4d99-85df-9a787051faab service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:19.107224 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c50b6-9e90-4d99-85df-9a787051faab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:19.115835 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c50b6-9e90-4d99-85df-9a787051faab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:19.117333 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c50b6-9e90-4d99-85df-9a787051faab service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:19.126372 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 857/1700] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:19.391023 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff7095-adc1-4edd-96a8-e6673d66bb27 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:19.392637 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-0dff7095-adc1-4edd-96a8-e6673d66bb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:19.422357 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff7095-adc1-4edd-96a8-e6673d66bb27 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:19.428360 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9211923-c6e7-4d9b-a4da-a9ed18c5dfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:19.429266 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9211923-c6e7-4d9b-a4da-a9ed18c5dfa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:19.429552 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9211923-c6e7-4d9b-a4da-a9ed18c5dfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:19.429829 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9211923-c6e7-4d9b-a4da-a9ed18c5dfa2 admin admin] PATH_INFO: `/v3/projects/89d762f8f89e44b9bf0b09c9e9dc5404` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:19.431068 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9211923-c6e7-4d9b-a4da-a9ed18c5dfa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d762f8f89e44b9bf0b09c9e9dc5404)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:19.433061 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9211923-c6e7-4d9b-a4da-a9ed18c5dfa2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:19.507153 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a9211923-c6e7-4d9b-a4da-a9ed18c5dfa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d762f8f89e44b9bf0b09c9e9dc5404', 'request_id': 'req-a9211923-c6e7-4d9b-a4da-a9ed18c5dfa2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:19.509538 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a9211923-c6e7-4d9b-a4da-a9ed18c5dfa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d762f8f89e44b9bf0b09c9e9dc5404', 'request_id': 'req-a9211923-c6e7-4d9b-a4da-a9ed18c5dfa2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:19.517582 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a9211923-c6e7-4d9b-a4da-a9ed18c5dfa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d762f8f89e44b9bf0b09c9e9dc5404', 'request_id': 'req-a9211923-c6e7-4d9b-a4da-a9ed18c5dfa2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:19.528931 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a9211923-c6e7-4d9b-a4da-a9ed18c5dfa2 admin admin] The token cache is being invalidate because project 89d762f8f89e44b9bf0b09c9e9dc5404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:40:19.529267 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a9211923-c6e7-4d9b-a4da-a9ed18c5dfa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:19.529925 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a9211923-c6e7-4d9b-a4da-a9ed18c5dfa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:19.531811 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 844/1701] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:40:19 2022] DELETE /identity/v3/projects/89d762f8f89e44b9bf0b09c9e9dc5404 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:19.539321 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75e71f-4057-4987-8894-8a8fc514ec42 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:19.539628 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75e71f-4057-4987-8894-8a8fc514ec42 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:19.539975 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75e71f-4057-4987-8894-8a8fc514ec42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:19.588049 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-7e75e71f-4057-4987-8894-8a8fc514ec42 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:19.589366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7e75e71f-4057-4987-8894-8a8fc514ec42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:19.670947 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 858/1702] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:19.679125 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529fc00-0a8a-4d92-9a4e-563e22e47933 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:19.679442 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529fc00-0a8a-4d92-9a4e-563e22e47933 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:19.679725 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529fc00-0a8a-4d92-9a4e-563e22e47933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:19.707185 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-e529fc00-0a8a-4d92-9a4e-563e22e47933 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:19.709099 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-e529fc00-0a8a-4d92-9a4e-563e22e47933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:19.747150 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75e71f-4057-4987-8894-8a8fc514ec42 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:19.749015 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 845/1703] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:19.768942 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75e71f-4057-4987-8894-8a8fc514ec42 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:19.778740 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6ed03-100c-400c-bd6f-94b32afe10cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:19.779534 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6ed03-100c-400c-bd6f-94b32afe10cb admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:19.779891 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6ed03-100c-400c-bd6f-94b32afe10cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:19.780238 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6ed03-100c-400c-bd6f-94b32afe10cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:19.782620 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6ed03-100c-400c-bd6f-94b32afe10cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:40:19.783015 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6ed03-100c-400c-bd6f-94b32afe10cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:19.784858 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6ed03-100c-400c-bd6f-94b32afe10cb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:19.825499 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529fc00-0a8a-4d92-9a4e-563e22e47933 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:19.833640 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 859/1704] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:40:19.836486 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529fc00-0a8a-4d92-9a4e-563e22e47933 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:19.842015 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0628228-3233-4e3b-92f7-651ad8059ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:19.845386 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0628228-3233-4e3b-92f7-651ad8059ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:19.845819 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0628228-3233-4e3b-92f7-651ad8059ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:19.849900 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0628228-3233-4e3b-92f7-651ad8059ce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:19.850810 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0628228-3233-4e3b-92f7-651ad8059ce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:19.853079 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0628228-3233-4e3b-92f7-651ad8059ce2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:19.906153 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 846/1705] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:40:19 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:40:19.910884 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6ed03-100c-400c-bd6f-94b32afe10cb admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:19.921410 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6ed03-100c-400c-bd6f-94b32afe10cb admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:20.040874 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f0720-5854-4bad-84a1-3cf6f94c897b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:20.041834 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f0720-5854-4bad-84a1-3cf6f94c897b admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:20.042415 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f0720-5854-4bad-84a1-3cf6f94c897b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:20.042855 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f0720-5854-4bad-84a1-3cf6f94c897b admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:20.044077 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f0720-5854-4bad-84a1-3cf6f94c897b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:20.046460 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f0720-5854-4bad-84a1-3cf6f94c897b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:20.118321 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 860/1706] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:40:19 2022] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:20.122895 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0628228-3233-4e3b-92f7-651ad8059ce2 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:20.138630 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0628228-3233-4e3b-92f7-651ad8059ce2 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:20.143871 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1ac8d-45e9-4972-9d03-cbc702185312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:20.144499 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1ac8d-45e9-4972-9d03-cbc702185312 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:20.145344 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1ac8d-45e9-4972-9d03-cbc702185312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:20.145625 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1ac8d-45e9-4972-9d03-cbc702185312 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:20.146722 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1ac8d-45e9-4972-9d03-cbc702185312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:20.148348 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1ac8d-45e9-4972-9d03-cbc702185312 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:20.160989 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 847/1707] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:40:20.164747 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f0720-5854-4bad-84a1-3cf6f94c897b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:20.177672 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f0720-5854-4bad-84a1-3cf6f94c897b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:20.183121 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3c519-d152-4d3b-9edf-9cf7074c655a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:20.183885 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3c519-d152-4d3b-9edf-9cf7074c655a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:20.184165 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3c519-d152-4d3b-9edf-9cf7074c655a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:20.184438 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3c519-d152-4d3b-9edf-9cf7074c655a admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:20.185246 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3c519-d152-4d3b-9edf-9cf7074c655a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:20.186857 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3c519-d152-4d3b-9edf-9cf7074c655a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:20.198460 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 861/1708] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:20.202730 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1ac8d-45e9-4972-9d03-cbc702185312 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:20.214176 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1ac8d-45e9-4972-9d03-cbc702185312 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:20.219004 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264753b-01c0-44a9-b6d2-b0c018312961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:20.219895 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264753b-01c0-44a9-b6d2-b0c018312961 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:20.220181 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264753b-01c0-44a9-b6d2-b0c018312961 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:20.220599 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264753b-01c0-44a9-b6d2-b0c018312961 admin admin] PATH_INFO: `/v3/projects/688c418cb28841f6b505b0f91e2f5499/users/4c340edc466d41b7b043c510bea3e220/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:20.239469 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264753b-01c0-44a9-b6d2-b0c018312961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688c418cb28841f6b505b0f91e2f5499, user_id=4c340edc466d41b7b043c510bea3e220, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:20.242003 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264753b-01c0-44a9-b6d2-b0c018312961 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:20.256514 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 848/1709] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:20 2022] PUT /identity/v3/projects/688c418cb28841f6b505b0f91e2f5499/users/4c340edc466d41b7b043c510bea3e220/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:20.268745 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f86331-c3c8-42ee-ac6b-ce1c4931690f None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:20.269140 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f86331-c3c8-42ee-ac6b-ce1c4931690f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:20.269336 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f86331-c3c8-42ee-ac6b-ce1c4931690f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:20.296512 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-78f86331-c3c8-42ee-ac6b-ce1c4931690f None None] MFA Rules not processed for user `4c340edc466d41b7b043c510bea3e220`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:20.297732 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-78f86331-c3c8-42ee-ac6b-ce1c4931690f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:20.356124 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 862/1710] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:20.366640 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264753b-01c0-44a9-b6d2-b0c018312961 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:20.368275 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-1264753b-01c0-44a9-b6d2-b0c018312961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:20.439581 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264753b-01c0-44a9-b6d2-b0c018312961 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:20.445098 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3064072f-f6e1-46c9-ac39-8fb8298448dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:20.445739 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064072f-f6e1-46c9-ac39-8fb8298448dc service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:20.446018 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064072f-f6e1-46c9-ac39-8fb8298448dc service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:20.446291 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3064072f-f6e1-46c9-ac39-8fb8298448dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:20.453775 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3064072f-f6e1-46c9-ac39-8fb8298448dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:20.455364 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3064072f-f6e1-46c9-ac39-8fb8298448dc service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:20.464318 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 849/1711] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:20.649335 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f86331-c3c8-42ee-ac6b-ce1c4931690f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:20.708453 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f86331-c3c8-42ee-ac6b-ce1c4931690f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:20.712947 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f383f2-ce81-45bf-b18f-a36c57a3c233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:20.713836 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f383f2-ce81-45bf-b18f-a36c57a3c233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:20.714122 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f383f2-ce81-45bf-b18f-a36c57a3c233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:20.714402 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f383f2-ce81-45bf-b18f-a36c57a3c233 admin admin] PATH_INFO: `/v3/users/4c340edc466d41b7b043c510bea3e220` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:20.715596 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f383f2-ce81-45bf-b18f-a36c57a3c233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c340edc466d41b7b043c510bea3e220)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:20.717562 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f383f2-ce81-45bf-b18f-a36c57a3c233 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:20.761155 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-27f383f2-ce81-45bf-b18f-a36c57a3c233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c340edc466d41b7b043c510bea3e220'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:20.767662 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-27f383f2-ce81-45bf-b18f-a36c57a3c233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c340edc466d41b7b043c510bea3e220'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:20.768318 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-27f383f2-ce81-45bf-b18f-a36c57a3c233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c340edc466d41b7b043c510bea3e220'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:20.780609 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-27f383f2-ce81-45bf-b18f-a36c57a3c233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c340edc466d41b7b043c510bea3e220'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:20.788002 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-27f383f2-ce81-45bf-b18f-a36c57a3c233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c340edc466d41b7b043c510bea3e220'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:20.793922 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 863/1712] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:40:20 2022] DELETE /identity/v3/users/4c340edc466d41b7b043c510bea3e220 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:20.798502 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb09eb1-5600-4651-9a4c-82bdb4e3ee89 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:20.798797 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb09eb1-5600-4651-9a4c-82bdb4e3ee89 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:20.799076 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb09eb1-5600-4651-9a4c-82bdb4e3ee89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:20.815425 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-5bb09eb1-5600-4651-9a4c-82bdb4e3ee89 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:20.817161 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-5bb09eb1-5600-4651-9a4c-82bdb4e3ee89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:20.875947 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 850/1713] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:20.888213 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f383f2-ce81-45bf-b18f-a36c57a3c233 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:20.889798 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-27f383f2-ce81-45bf-b18f-a36c57a3c233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:20.948689 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f383f2-ce81-45bf-b18f-a36c57a3c233 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:20.952356 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04865d-2b88-428d-abb3-1b3f738d1c87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:20.953020 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04865d-2b88-428d-abb3-1b3f738d1c87 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:20.953401 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04865d-2b88-428d-abb3-1b3f738d1c87 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:20.953676 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04865d-2b88-428d-abb3-1b3f738d1c87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:20.963239 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04865d-2b88-428d-abb3-1b3f738d1c87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:20.964672 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04865d-2b88-428d-abb3-1b3f738d1c87 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:20.974643 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 864/1714] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:21.265240 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb09eb1-5600-4651-9a4c-82bdb4e3ee89 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:21.266728 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-5bb09eb1-5600-4651-9a4c-82bdb4e3ee89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:21.288958 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb09eb1-5600-4651-9a4c-82bdb4e3ee89 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:21.295429 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f506a67-941c-4513-92b0-dea7d319fd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:21.296403 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f506a67-941c-4513-92b0-dea7d319fd3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:21.296883 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f506a67-941c-4513-92b0-dea7d319fd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:21.297189 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f506a67-941c-4513-92b0-dea7d319fd3e admin admin] PATH_INFO: `/v3/projects/688c418cb28841f6b505b0f91e2f5499` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:21.298678 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f506a67-941c-4513-92b0-dea7d319fd3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=688c418cb28841f6b505b0f91e2f5499)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:21.300634 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f506a67-941c-4513-92b0-dea7d319fd3e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:21.344482 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3f506a67-941c-4513-92b0-dea7d319fd3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '688c418cb28841f6b505b0f91e2f5499', 'request_id': 'req-3f506a67-941c-4513-92b0-dea7d319fd3e'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:21.352472 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3f506a67-941c-4513-92b0-dea7d319fd3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '688c418cb28841f6b505b0f91e2f5499', 'request_id': 'req-3f506a67-941c-4513-92b0-dea7d319fd3e'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:21.358467 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3f506a67-941c-4513-92b0-dea7d319fd3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '688c418cb28841f6b505b0f91e2f5499', 'request_id': 'req-3f506a67-941c-4513-92b0-dea7d319fd3e'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:21.368653 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3f506a67-941c-4513-92b0-dea7d319fd3e admin admin] The token cache is being invalidate because project 688c418cb28841f6b505b0f91e2f5499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:40:21.368940 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3f506a67-941c-4513-92b0-dea7d319fd3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:21.369589 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3f506a67-941c-4513-92b0-dea7d319fd3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:21.371117 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 851/1715] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:40:21 2022] DELETE /identity/v3/projects/688c418cb28841f6b505b0f91e2f5499 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:21.376919 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1628d-c662-4535-ae80-023d75263f9f None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:21.377272 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1628d-c662-4535-ae80-023d75263f9f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:21.377529 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1628d-c662-4535-ae80-023d75263f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:21.402347 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-f0d1628d-c662-4535-ae80-023d75263f9f None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:21.403583 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f0d1628d-c662-4535-ae80-023d75263f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:21.461950 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 865/1716] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:21.469790 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b7d9d-3963-4771-bff5-1d4a4dd41f57 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:21.470081 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b7d9d-3963-4771-bff5-1d4a4dd41f57 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:21.470387 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b7d9d-3963-4771-bff5-1d4a4dd41f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:21.494904 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-886b7d9d-3963-4771-bff5-1d4a4dd41f57 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:21.496106 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-886b7d9d-3963-4771-bff5-1d4a4dd41f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:21.504024 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 852/1717] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:21.508206 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1628d-c662-4535-ae80-023d75263f9f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:21.517692 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1628d-c662-4535-ae80-023d75263f9f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:21.522223 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a916912-d667-48fa-8bf6-1d9c9dd679dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:21.522866 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a916912-d667-48fa-8bf6-1d9c9dd679dc admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:21.523148 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a916912-d667-48fa-8bf6-1d9c9dd679dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:21.523426 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a916912-d667-48fa-8bf6-1d9c9dd679dc admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:21.524165 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a916912-d667-48fa-8bf6-1d9c9dd679dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:40:21.524472 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a916912-d667-48fa-8bf6-1d9c9dd679dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:21.526369 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a916912-d667-48fa-8bf6-1d9c9dd679dc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:21.538027 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 866/1718] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:40:21.542007 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b7d9d-3963-4771-bff5-1d4a4dd41f57 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:21.552179 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b7d9d-3963-4771-bff5-1d4a4dd41f57 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:21.556683 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4a92f-1cc8-42f4-99fc-20e76b2a9fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:21.557358 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4a92f-1cc8-42f4-99fc-20e76b2a9fdc admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:21.557639 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4a92f-1cc8-42f4-99fc-20e76b2a9fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:21.557911 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4a92f-1cc8-42f4-99fc-20e76b2a9fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:21.558617 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4a92f-1cc8-42f4-99fc-20e76b2a9fdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:21.560499 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4a92f-1cc8-42f4-99fc-20e76b2a9fdc admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:21.601238 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 853/1719] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:40:21 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:21.607066 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a916912-d667-48fa-8bf6-1d9c9dd679dc admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:21.620137 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a916912-d667-48fa-8bf6-1d9c9dd679dc admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:21.679233 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd9ddc-122f-4888-842c-4719da4cac88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:21.679908 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd9ddc-122f-4888-842c-4719da4cac88 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:21.680190 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd9ddc-122f-4888-842c-4719da4cac88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:21.680465 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd9ddc-122f-4888-842c-4719da4cac88 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:21.681209 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd9ddc-122f-4888-842c-4719da4cac88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:21.683191 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd9ddc-122f-4888-842c-4719da4cac88 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:21.716770 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 867/1720] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:40:21 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:21.718077 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4a92f-1cc8-42f4-99fc-20e76b2a9fdc admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:21.729041 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4a92f-1cc8-42f4-99fc-20e76b2a9fdc admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:21.733989 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2867372-dfa8-484b-aad4-e01689d65542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:21.734706 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2867372-dfa8-484b-aad4-e01689d65542 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:21.734994 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2867372-dfa8-484b-aad4-e01689d65542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:21.735274 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2867372-dfa8-484b-aad4-e01689d65542 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:21.736024 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2867372-dfa8-484b-aad4-e01689d65542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:21.737716 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2867372-dfa8-484b-aad4-e01689d65542 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:21.749764 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 854/1721] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:21.754283 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd9ddc-122f-4888-842c-4719da4cac88 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:21.766892 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd9ddc-122f-4888-842c-4719da4cac88 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:21.773451 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd04df-4508-4027-bee1-717d4598b5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:21.774185 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd04df-4508-4027-bee1-717d4598b5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:21.774475 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd04df-4508-4027-bee1-717d4598b5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:21.774754 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd04df-4508-4027-bee1-717d4598b5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:21.775933 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd04df-4508-4027-bee1-717d4598b5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:21.777680 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd04df-4508-4027-bee1-717d4598b5c0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:21.788900 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 868/1722] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:21.793061 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2867372-dfa8-484b-aad4-e01689d65542 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:21.803527 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2867372-dfa8-484b-aad4-e01689d65542 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:21.808263 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24d6b7-785f-4727-bc78-ab61e00b23fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:21.809198 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24d6b7-785f-4727-bc78-ab61e00b23fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:21.809482 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24d6b7-785f-4727-bc78-ab61e00b23fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:21.809759 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f24d6b7-785f-4727-bc78-ab61e00b23fe admin admin] PATH_INFO: `/v3/projects/f29800f3567d40f1b6e9274dcc3dfeb7/users/298910a0883d4afba25d4ebcbf70f088/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:21.824341 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24d6b7-785f-4727-bc78-ab61e00b23fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=f29800f3567d40f1b6e9274dcc3dfeb7, user_id=298910a0883d4afba25d4ebcbf70f088, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:21.827038 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f24d6b7-785f-4727-bc78-ab61e00b23fe admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:21.839990 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 855/1723] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:21 2022] PUT /identity/v3/projects/f29800f3567d40f1b6e9274dcc3dfeb7/users/298910a0883d4afba25d4ebcbf70f088/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:21.851038 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d6a72-57d5-4589-a493-0cf1d993667c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:21.851344 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d6a72-57d5-4589-a493-0cf1d993667c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:21.851610 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d6a72-57d5-4589-a493-0cf1d993667c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:21.883928 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ca2d6a72-57d5-4589-a493-0cf1d993667c None None] MFA Rules not processed for user `298910a0883d4afba25d4ebcbf70f088`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:21.885217 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ca2d6a72-57d5-4589-a493-0cf1d993667c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:21.964917 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 869/1724] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:21.969385 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24d6b7-785f-4727-bc78-ab61e00b23fe admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:22.037166 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f24d6b7-785f-4727-bc78-ab61e00b23fe admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:22.043507 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcaab3-9224-4cf8-bc51-2a3ad5815e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:22.044323 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcaab3-9224-4cf8-bc51-2a3ad5815e30 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:22.044740 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcaab3-9224-4cf8-bc51-2a3ad5815e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:22.045165 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcaab3-9224-4cf8-bc51-2a3ad5815e30 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:22.045945 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcaab3-9224-4cf8-bc51-2a3ad5815e30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:22.047937 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcaab3-9224-4cf8-bc51-2a3ad5815e30 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:22.078327 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 856/1725] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:40:21 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:22.081893 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d6a72-57d5-4589-a493-0cf1d993667c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:22.093194 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d6a72-57d5-4589-a493-0cf1d993667c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:22.161201 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c374db-945d-45f9-b94c-c7574f20cae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:22.161883 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c374db-945d-45f9-b94c-c7574f20cae2 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:22.162165 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c374db-945d-45f9-b94c-c7574f20cae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:22.162439 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c374db-945d-45f9-b94c-c7574f20cae2 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:22.163157 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c374db-945d-45f9-b94c-c7574f20cae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:22.165405 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c374db-945d-45f9-b94c-c7574f20cae2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:22.202643 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 870/1726] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:40:22 2022] POST /identity/v3/users => generated 291 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:22.222210 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcaab3-9224-4cf8-bc51-2a3ad5815e30 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:22.235723 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcaab3-9224-4cf8-bc51-2a3ad5815e30 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:22.241530 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7a13f-bba7-4a9b-b315-31d76315f704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:22.242495 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7a13f-bba7-4a9b-b315-31d76315f704 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:22.242981 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7a13f-bba7-4a9b-b315-31d76315f704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:22.243400 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c7a13f-bba7-4a9b-b315-31d76315f704 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:22.244357 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7a13f-bba7-4a9b-b315-31d76315f704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:22.246477 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c7a13f-bba7-4a9b-b315-31d76315f704 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:22.264388 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 857/1727] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:22.265025 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c374db-945d-45f9-b94c-c7574f20cae2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:22.282333 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c374db-945d-45f9-b94c-c7574f20cae2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:22.288072 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ccd58-78d8-4634-822a-3d26ce4244a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:22.289068 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ccd58-78d8-4634-822a-3d26ce4244a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:22.289432 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ccd58-78d8-4634-822a-3d26ce4244a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:22.289768 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ccd58-78d8-4634-822a-3d26ce4244a2 admin admin] PATH_INFO: `/v3/projects/381bbcf1b36946ee94caf9f3bd719ed8/users/e6a29857ecce45dda181e4a0a2527570/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:22.305911 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ccd58-78d8-4634-822a-3d26ce4244a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=381bbcf1b36946ee94caf9f3bd719ed8, user_id=e6a29857ecce45dda181e4a0a2527570, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:22.308777 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ccd58-78d8-4634-822a-3d26ce4244a2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:22.336408 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 871/1728] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:22 2022] PUT /identity/v3/projects/381bbcf1b36946ee94caf9f3bd719ed8/users/e6a29857ecce45dda181e4a0a2527570/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:22.338655 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7a13f-bba7-4a9b-b315-31d76315f704 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:22.352847 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c7a13f-bba7-4a9b-b315-31d76315f704 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:22.432511 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99a2ff-c94f-4035-9d8b-a9baed2a767f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:22.433238 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99a2ff-c94f-4035-9d8b-a9baed2a767f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:22.433761 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99a2ff-c94f-4035-9d8b-a9baed2a767f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:22.434327 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99a2ff-c94f-4035-9d8b-a9baed2a767f admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:22.435423 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99a2ff-c94f-4035-9d8b-a9baed2a767f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:22.437539 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99a2ff-c94f-4035-9d8b-a9baed2a767f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:22.451815 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 858/1729] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:22.452787 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ccd58-78d8-4634-822a-3d26ce4244a2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:22.466492 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ccd58-78d8-4634-822a-3d26ce4244a2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:22.480307 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf5252-29d0-462e-97b1-6031d4be9a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:22.482173 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf5252-29d0-462e-97b1-6031d4be9a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:22.482638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf5252-29d0-462e-97b1-6031d4be9a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:22.483088 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf5252-29d0-462e-97b1-6031d4be9a98 admin admin] PATH_INFO: `/v3/projects/381bbcf1b36946ee94caf9f3bd719ed8/users/e6a29857ecce45dda181e4a0a2527570/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:22.486914 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf5252-29d0-462e-97b1-6031d4be9a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=381bbcf1b36946ee94caf9f3bd719ed8, user_id=e6a29857ecce45dda181e4a0a2527570, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:22.491721 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf5252-29d0-462e-97b1-6031d4be9a98 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:22.503133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 872/1730] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:22 2022] PUT /identity/v3/projects/381bbcf1b36946ee94caf9f3bd719ed8/users/e6a29857ecce45dda181e4a0a2527570/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:22.514531 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee49f9-6ff4-48b4-ba89-426d46dabb03 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:22.514814 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee49f9-6ff4-48b4-ba89-426d46dabb03 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:22.515091 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee49f9-6ff4-48b4-ba89-426d46dabb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:22.543057 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-1cee49f9-6ff4-48b4-ba89-426d46dabb03 None None] MFA Rules not processed for user `e6a29857ecce45dda181e4a0a2527570`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:22.544316 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-1cee49f9-6ff4-48b4-ba89-426d46dabb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:22.621618 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 859/1731] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:22 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:22.632230 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf5252-29d0-462e-97b1-6031d4be9a98 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:22.634060 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-cccf5252-29d0-462e-97b1-6031d4be9a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:22.697705 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf5252-29d0-462e-97b1-6031d4be9a98 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:22.702913 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b6f37-141c-4e7e-8569-0087a1f7be22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:22.703584 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b6f37-141c-4e7e-8569-0087a1f7be22 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:22.703865 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b6f37-141c-4e7e-8569-0087a1f7be22 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:22.704169 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b6f37-141c-4e7e-8569-0087a1f7be22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:22.717022 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b6f37-141c-4e7e-8569-0087a1f7be22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:22.718587 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b6f37-141c-4e7e-8569-0087a1f7be22 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:22.737134 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 873/1732] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:22 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:22.775777 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee49f9-6ff4-48b4-ba89-426d46dabb03 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:22.777193 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-1cee49f9-6ff4-48b4-ba89-426d46dabb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:22.789767 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee49f9-6ff4-48b4-ba89-426d46dabb03 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:22.793411 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194df3f-c014-4698-8bd5-ce9a33beb8dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:22.794049 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194df3f-c014-4698-8bd5-ce9a33beb8dd service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:22.794329 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194df3f-c014-4698-8bd5-ce9a33beb8dd service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:22.794600 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194df3f-c014-4698-8bd5-ce9a33beb8dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:22.851633 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194df3f-c014-4698-8bd5-ce9a33beb8dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:22.853716 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194df3f-c014-4698-8bd5-ce9a33beb8dd service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:22.866910 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 860/1733] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:26.159030 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b6f37-141c-4e7e-8569-0087a1f7be22 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:26.233403 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b6f37-141c-4e7e-8569-0087a1f7be22 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:26.238147 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c68ba-3abb-4c22-bac9-606a996772ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:26.239591 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c68ba-3abb-4c22-bac9-606a996772ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:26.239878 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c68ba-3abb-4c22-bac9-606a996772ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:26.240157 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c68ba-3abb-4c22-bac9-606a996772ab admin admin] PATH_INFO: `/v3/users/298910a0883d4afba25d4ebcbf70f088` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:26.241410 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c68ba-3abb-4c22-bac9-606a996772ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=298910a0883d4afba25d4ebcbf70f088)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:26.243350 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239c68ba-3abb-4c22-bac9-606a996772ab admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:26.312495 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-239c68ba-3abb-4c22-bac9-606a996772ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298910a0883d4afba25d4ebcbf70f088'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:26.319691 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-239c68ba-3abb-4c22-bac9-606a996772ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298910a0883d4afba25d4ebcbf70f088'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:26.320361 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-239c68ba-3abb-4c22-bac9-606a996772ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298910a0883d4afba25d4ebcbf70f088'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:26.331417 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-239c68ba-3abb-4c22-bac9-606a996772ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298910a0883d4afba25d4ebcbf70f088'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:26.338410 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-239c68ba-3abb-4c22-bac9-606a996772ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298910a0883d4afba25d4ebcbf70f088'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:26.344463 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 874/1734] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:40:26 2022] DELETE /identity/v3/users/298910a0883d4afba25d4ebcbf70f088 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:26.349246 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0deba-83bb-4247-8a97-a5aa172d49dd None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:26.349742 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0deba-83bb-4247-8a97-a5aa172d49dd None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:26.349845 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0deba-83bb-4247-8a97-a5aa172d49dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:26.366653 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-c0c0deba-83bb-4247-8a97-a5aa172d49dd None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:26.367834 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-c0c0deba-83bb-4247-8a97-a5aa172d49dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:26.422800 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 861/1735] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:26.433556 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c68ba-3abb-4c22-bac9-606a996772ab admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:26.435023 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-239c68ba-3abb-4c22-bac9-606a996772ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:26.507879 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c68ba-3abb-4c22-bac9-606a996772ab admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:26.511833 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339d191-65e0-4832-808d-016758c36162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:26.512510 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339d191-65e0-4832-808d-016758c36162 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:26.512797 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339d191-65e0-4832-808d-016758c36162 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:26.513111 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5339d191-65e0-4832-808d-016758c36162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:26.523693 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339d191-65e0-4832-808d-016758c36162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:26.525471 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5339d191-65e0-4832-808d-016758c36162 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:26.536865 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 875/1736] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:26.940491 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0deba-83bb-4247-8a97-a5aa172d49dd None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:26.942018 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-c0c0deba-83bb-4247-8a97-a5aa172d49dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:26.964109 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0deba-83bb-4247-8a97-a5aa172d49dd None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:26.979893 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340a638-e022-487e-bd87-f9b65ba0e53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:26.992151 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340a638-e022-487e-bd87-f9b65ba0e53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:26.993143 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340a638-e022-487e-bd87-f9b65ba0e53e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:26.993572 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340a638-e022-487e-bd87-f9b65ba0e53e admin admin] PATH_INFO: `/v3/projects/f29800f3567d40f1b6e9274dcc3dfeb7` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:26.996069 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340a638-e022-487e-bd87-f9b65ba0e53e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f29800f3567d40f1b6e9274dcc3dfeb7)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:27.000082 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340a638-e022-487e-bd87-f9b65ba0e53e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:27.093116 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7340a638-e022-487e-bd87-f9b65ba0e53e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f29800f3567d40f1b6e9274dcc3dfeb7', 'request_id': 'req-7340a638-e022-487e-bd87-f9b65ba0e53e'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:27.105873 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7340a638-e022-487e-bd87-f9b65ba0e53e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f29800f3567d40f1b6e9274dcc3dfeb7', 'request_id': 'req-7340a638-e022-487e-bd87-f9b65ba0e53e'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:27.122926 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7340a638-e022-487e-bd87-f9b65ba0e53e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f29800f3567d40f1b6e9274dcc3dfeb7', 'request_id': 'req-7340a638-e022-487e-bd87-f9b65ba0e53e'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:27.160826 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7340a638-e022-487e-bd87-f9b65ba0e53e admin admin] The token cache is being invalidate because project f29800f3567d40f1b6e9274dcc3dfeb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:40:27.160826 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7340a638-e022-487e-bd87-f9b65ba0e53e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:27.160826 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7340a638-e022-487e-bd87-f9b65ba0e53e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:27.163161 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 862/1737] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:40:26 2022] DELETE /identity/v3/projects/f29800f3567d40f1b6e9274dcc3dfeb7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:27.167217 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339d191-65e0-4832-808d-016758c36162 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:27.189812 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5339d191-65e0-4832-808d-016758c36162 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:27.281346 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bea6c0-6ca2-46d0-86c5-03d1d212c01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:27.282508 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bea6c0-6ca2-46d0-86c5-03d1d212c01e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:27.283351 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bea6c0-6ca2-46d0-86c5-03d1d212c01e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:27.283815 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bea6c0-6ca2-46d0-86c5-03d1d212c01e admin admin] PATH_INFO: `/v3/users/e6a29857ecce45dda181e4a0a2527570` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:27.286144 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bea6c0-6ca2-46d0-86c5-03d1d212c01e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a29857ecce45dda181e4a0a2527570)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:27.288599 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bea6c0-6ca2-46d0-86c5-03d1d212c01e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:27.353913 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c8bea6c0-6ca2-46d0-86c5-03d1d212c01e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a29857ecce45dda181e4a0a2527570'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:27.362264 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c8bea6c0-6ca2-46d0-86c5-03d1d212c01e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a29857ecce45dda181e4a0a2527570'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:27.363089 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c8bea6c0-6ca2-46d0-86c5-03d1d212c01e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a29857ecce45dda181e4a0a2527570'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:27.390516 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c8bea6c0-6ca2-46d0-86c5-03d1d212c01e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a29857ecce45dda181e4a0a2527570'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:27.400850 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c8bea6c0-6ca2-46d0-86c5-03d1d212c01e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a29857ecce45dda181e4a0a2527570'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:27.418793 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 876/1738] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:40:27 2022] DELETE /identity/v3/users/e6a29857ecce45dda181e4a0a2527570 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:27.720827 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340a638-e022-487e-bd87-f9b65ba0e53e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:27.722290 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7340a638-e022-487e-bd87-f9b65ba0e53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:27.740513 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340a638-e022-487e-bd87-f9b65ba0e53e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:27.815875 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140aae64-6407-4954-846a-07ea8473307c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:27.816765 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140aae64-6407-4954-846a-07ea8473307c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:27.817073 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140aae64-6407-4954-846a-07ea8473307c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:27.817344 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140aae64-6407-4954-846a-07ea8473307c admin admin] PATH_INFO: `/v3/projects/381bbcf1b36946ee94caf9f3bd719ed8` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:27.818534 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140aae64-6407-4954-846a-07ea8473307c admin admin] RBAC: Authorizing `identity:delete_project(project_id=381bbcf1b36946ee94caf9f3bd719ed8)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:27.820473 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140aae64-6407-4954-846a-07ea8473307c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:27.864385 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-140aae64-6407-4954-846a-07ea8473307c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '381bbcf1b36946ee94caf9f3bd719ed8', 'request_id': 'req-140aae64-6407-4954-846a-07ea8473307c'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:27.871651 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-140aae64-6407-4954-846a-07ea8473307c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '381bbcf1b36946ee94caf9f3bd719ed8', 'request_id': 'req-140aae64-6407-4954-846a-07ea8473307c'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:27.877656 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-140aae64-6407-4954-846a-07ea8473307c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '381bbcf1b36946ee94caf9f3bd719ed8', 'request_id': 'req-140aae64-6407-4954-846a-07ea8473307c'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:27.887208 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-140aae64-6407-4954-846a-07ea8473307c admin admin] The token cache is being invalidate because project 381bbcf1b36946ee94caf9f3bd719ed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:40:27.887481 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-140aae64-6407-4954-846a-07ea8473307c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:27.888093 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-140aae64-6407-4954-846a-07ea8473307c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:27.889638 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 863/1739] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:40:27 2022] DELETE /identity/v3/projects/381bbcf1b36946ee94caf9f3bd719ed8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:27.896266 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980c5ec-7608-41e7-a2fc-586bedb06b47 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:27.896633 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980c5ec-7608-41e7-a2fc-586bedb06b47 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:27.896983 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980c5ec-7608-41e7-a2fc-586bedb06b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:27.915525 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a980c5ec-7608-41e7-a2fc-586bedb06b47 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:27.916730 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a980c5ec-7608-41e7-a2fc-586bedb06b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:27.971638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 877/1740] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:27.979680 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa97d97-029e-4f35-96a0-9a807535162e None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:27.979965 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa97d97-029e-4f35-96a0-9a807535162e None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:27.980238 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa97d97-029e-4f35-96a0-9a807535162e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:27.997861 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-4aa97d97-029e-4f35-96a0-9a807535162e None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:27.999038 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-4aa97d97-029e-4f35-96a0-9a807535162e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:28.007427 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 864/1741] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:28.011404 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980c5ec-7608-41e7-a2fc-586bedb06b47 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:28.021536 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980c5ec-7608-41e7-a2fc-586bedb06b47 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:28.026404 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc4d69-bdb6-400c-900d-88dfe873d421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:28.027049 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc4d69-bdb6-400c-900d-88dfe873d421 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:28.027334 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc4d69-bdb6-400c-900d-88dfe873d421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:28.027613 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc4d69-bdb6-400c-900d-88dfe873d421 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:28.028350 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc4d69-bdb6-400c-900d-88dfe873d421 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:40:28.028657 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc4d69-bdb6-400c-900d-88dfe873d421 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:28.030296 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc4d69-bdb6-400c-900d-88dfe873d421 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:28.041462 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 878/1742] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:40:28.045810 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa97d97-029e-4f35-96a0-9a807535162e None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:28.054788 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa97d97-029e-4f35-96a0-9a807535162e None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:28.059347 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb0c65-e16e-4d5e-8397-58e80e3be765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:28.060017 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb0c65-e16e-4d5e-8397-58e80e3be765 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:28.060302 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb0c65-e16e-4d5e-8397-58e80e3be765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:28.060579 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb0c65-e16e-4d5e-8397-58e80e3be765 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:28.061329 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb0c65-e16e-4d5e-8397-58e80e3be765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:28.063215 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb0c65-e16e-4d5e-8397-58e80e3be765 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:28.088345 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 865/1743] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:40:28 2022] POST /identity/v3/projects => generated 401 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:40:28.092400 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc4d69-bdb6-400c-900d-88dfe873d421 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:28.102050 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc4d69-bdb6-400c-900d-88dfe873d421 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:28.155983 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87429874-3753-4ce9-8386-d725e4eb0e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:28.156640 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87429874-3753-4ce9-8386-d725e4eb0e17 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:28.156921 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87429874-3753-4ce9-8386-d725e4eb0e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:28.157227 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87429874-3753-4ce9-8386-d725e4eb0e17 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:28.157916 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87429874-3753-4ce9-8386-d725e4eb0e17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:28.159827 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87429874-3753-4ce9-8386-d725e4eb0e17 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:28.179515 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 879/1744] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:40:28 2022] POST /identity/v3/users => generated 301 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:28.183321 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb0c65-e16e-4d5e-8397-58e80e3be765 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:28.194149 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb0c65-e16e-4d5e-8397-58e80e3be765 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:28.198802 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e959942-507e-437b-af83-f1f3c345600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:28.199454 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e959942-507e-437b-af83-f1f3c345600c admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:28.199733 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e959942-507e-437b-af83-f1f3c345600c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:28.200005 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e959942-507e-437b-af83-f1f3c345600c admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:28.200738 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e959942-507e-437b-af83-f1f3c345600c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:28.202352 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e959942-507e-437b-af83-f1f3c345600c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:28.213378 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 866/1745] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:28.217380 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87429874-3753-4ce9-8386-d725e4eb0e17 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:28.227247 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87429874-3753-4ce9-8386-d725e4eb0e17 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:28.232455 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5908080-68e6-4c4e-a95f-262c0828ad51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:28.233164 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5908080-68e6-4c4e-a95f-262c0828ad51 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:28.233453 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5908080-68e6-4c4e-a95f-262c0828ad51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:28.233735 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5908080-68e6-4c4e-a95f-262c0828ad51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:28.234520 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5908080-68e6-4c4e-a95f-262c0828ad51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:28.236112 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5908080-68e6-4c4e-a95f-262c0828ad51 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:28.247529 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 880/1746] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:40:28.252043 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e959942-507e-437b-af83-f1f3c345600c admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:28.264261 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e959942-507e-437b-af83-f1f3c345600c admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:28.269355 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bae17b-bfa3-4757-95fb-34eeb3cec66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:28.270952 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bae17b-bfa3-4757-95fb-34eeb3cec66a admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:28.271287 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bae17b-bfa3-4757-95fb-34eeb3cec66a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:28.271601 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bae17b-bfa3-4757-95fb-34eeb3cec66a admin admin] PATH_INFO: `/v3/projects/7f69aa72c4144175b0c4fdfb5fa47920/users/4dd92ed4988d41c0b13c5cd397862adf/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:28.289526 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bae17b-bfa3-4757-95fb-34eeb3cec66a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f69aa72c4144175b0c4fdfb5fa47920, user_id=4dd92ed4988d41c0b13c5cd397862adf, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:28.292399 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bae17b-bfa3-4757-95fb-34eeb3cec66a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:28.307907 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 867/1747] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:28 2022] PUT /identity/v3/projects/7f69aa72c4144175b0c4fdfb5fa47920/users/4dd92ed4988d41c0b13c5cd397862adf/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:40:28.320199 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc4bbf-7eb2-4892-9d81-de96e957e1c6 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:28.320639 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc4bbf-7eb2-4892-9d81-de96e957e1c6 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:28.321040 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc4bbf-7eb2-4892-9d81-de96e957e1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:28.354728 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ffbc4bbf-7eb2-4892-9d81-de96e957e1c6 None None] MFA Rules not processed for user `4dd92ed4988d41c0b13c5cd397862adf`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:28.356011 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ffbc4bbf-7eb2-4892-9d81-de96e957e1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:28.417346 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 881/1748] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:28.421754 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bae17b-bfa3-4757-95fb-34eeb3cec66a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:28.488220 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bae17b-bfa3-4757-95fb-34eeb3cec66a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:28.494669 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3fce9-dd8b-4491-80c8-d01a89726b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:28.495319 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3fce9-dd8b-4491-80c8-d01a89726b05 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:28.495599 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3fce9-dd8b-4491-80c8-d01a89726b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:28.495870 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3fce9-dd8b-4491-80c8-d01a89726b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:28.496580 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3fce9-dd8b-4491-80c8-d01a89726b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:28.498516 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3fce9-dd8b-4491-80c8-d01a89726b05 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:28.528059 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 868/1749] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:40:28 2022] POST /identity/v3/projects => generated 401 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:40:28.532306 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc4bbf-7eb2-4892-9d81-de96e957e1c6 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:28.549246 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc4bbf-7eb2-4892-9d81-de96e957e1c6 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:28.624385 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2b1d-64d6-4fc4-8a12-06fbfed4b257 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:28.624850 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2b1d-64d6-4fc4-8a12-06fbfed4b257 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:28.625287 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2b1d-64d6-4fc4-8a12-06fbfed4b257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:28.652897 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17861758-961e-449a-b079-a23a14b22f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:28.654426 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17861758-961e-449a-b079-a23a14b22f02 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:28.654914 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17861758-961e-449a-b079-a23a14b22f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:28.656566 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17861758-961e-449a-b079-a23a14b22f02 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:28.657657 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17861758-961e-449a-b079-a23a14b22f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:28.658720 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-70fd2b1d-64d6-4fc4-8a12-06fbfed4b257 None None] MFA Rules not processed for user `80015d086ec24caf9414d2ef5f660f08`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:28.660019 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-70fd2b1d-64d6-4fc4-8a12-06fbfed4b257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:28.661307 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17861758-961e-449a-b079-a23a14b22f02 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:28.703104 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 882/1750] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:40:28 2022] POST /identity/v3/users => generated 307 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:28.707817 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17861758-961e-449a-b079-a23a14b22f02 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:28.721804 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17861758-961e-449a-b079-a23a14b22f02 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:28.724260 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 869/1751] 10.222.0.47 () {58 vars in 1015 bytes} [Wed Feb 9 04:40:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:40:28.727931 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f1ec6-364e-4035-90b3-a5d1aa3c0714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:28.729496 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f1ec6-364e-4035-90b3-a5d1aa3c0714 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:28.729875 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f1ec6-364e-4035-90b3-a5d1aa3c0714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:28.730627 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f1ec6-364e-4035-90b3-a5d1aa3c0714 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:28.731455 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f1ec6-364e-4035-90b3-a5d1aa3c0714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:28.733663 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f1ec6-364e-4035-90b3-a5d1aa3c0714 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:28.746518 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 883/1752] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:40:28.747780 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd2b1d-64d6-4fc4-8a12-06fbfed4b257 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:28.749920 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-70fd2b1d-64d6-4fc4-8a12-06fbfed4b257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:28.751224 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f1ec6-364e-4035-90b3-a5d1aa3c0714 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:28.773849 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd2b1d-64d6-4fc4-8a12-06fbfed4b257 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:28.774083 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f1ec6-364e-4035-90b3-a5d1aa3c0714 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:28.784132 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b1425-570f-4afb-9312-b6353a4c1cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:28.786274 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b1425-570f-4afb-9312-b6353a4c1cfe admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:28.786778 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b1425-570f-4afb-9312-b6353a4c1cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:28.787254 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b1425-570f-4afb-9312-b6353a4c1cfe admin admin] PATH_INFO: `/v3/projects/0874ae0306a942c49f3d7a1910a3f8c8/users/5f8ef3682b1e42819cd6b227dcbcf674/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:28.788969 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2cf4f-f6af-48e5-a0f5-8aafa84b35b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:28.789886 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2cf4f-f6af-48e5-a0f5-8aafa84b35b1 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:28.792290 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2cf4f-f6af-48e5-a0f5-8aafa84b35b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:28.792540 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e2cf4f-f6af-48e5-a0f5-8aafa84b35b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:28.812777 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b1425-570f-4afb-9312-b6353a4c1cfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0874ae0306a942c49f3d7a1910a3f8c8, user_id=5f8ef3682b1e42819cd6b227dcbcf674, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:28.815947 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566b1425-570f-4afb-9312-b6353a4c1cfe admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:28.830440 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2cf4f-f6af-48e5-a0f5-8aafa84b35b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:28.834256 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e2cf4f-f6af-48e5-a0f5-8aafa84b35b1 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:28.844167 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 884/1753] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:28 2022] PUT /identity/v3/projects/0874ae0306a942c49f3d7a1910a3f8c8/users/5f8ef3682b1e42819cd6b227dcbcf674/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:28.845328 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b1425-570f-4afb-9312-b6353a4c1cfe admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:28.854762 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 870/1754] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:28.931429 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b1425-570f-4afb-9312-b6353a4c1cfe admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:28.949754 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451151ae-4fdf-42b3-8bc9-05d87de8afee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:28.950482 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451151ae-4fdf-42b3-8bc9-05d87de8afee admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:28.950763 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451151ae-4fdf-42b3-8bc9-05d87de8afee admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:28.951034 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451151ae-4fdf-42b3-8bc9-05d87de8afee admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:28.952281 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451151ae-4fdf-42b3-8bc9-05d87de8afee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:28.954067 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451151ae-4fdf-42b3-8bc9-05d87de8afee admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:28.966768 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 885/1755] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:28.971168 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2cf4f-f6af-48e5-a0f5-8aafa84b35b1 service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:28.991588 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e2cf4f-f6af-48e5-a0f5-8aafa84b35b1 service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:29.001893 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0c94f-1726-48bf-85b6-16a8153fcba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:29.003256 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0c94f-1726-48bf-85b6-16a8153fcba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:29.004304 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0c94f-1726-48bf-85b6-16a8153fcba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:29.005659 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0c94f-1726-48bf-85b6-16a8153fcba5 admin admin] PATH_INFO: `/v3/projects/0874ae0306a942c49f3d7a1910a3f8c8/users/5f8ef3682b1e42819cd6b227dcbcf674/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:29.010904 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0c94f-1726-48bf-85b6-16a8153fcba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0874ae0306a942c49f3d7a1910a3f8c8, user_id=5f8ef3682b1e42819cd6b227dcbcf674, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:29.014852 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0c94f-1726-48bf-85b6-16a8153fcba5 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:29.041965 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 871/1756] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:28 2022] PUT /identity/v3/projects/0874ae0306a942c49f3d7a1910a3f8c8/users/5f8ef3682b1e42819cd6b227dcbcf674/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:40:29.043824 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9057ef4-6f04-4fc1-9893-c5d6062df0c6 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:29.044354 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9057ef4-6f04-4fc1-9893-c5d6062df0c6 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:29.044891 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9057ef4-6f04-4fc1-9893-c5d6062df0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:29.084578 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-f9057ef4-6f04-4fc1-9893-c5d6062df0c6 None None] MFA Rules not processed for user `5f8ef3682b1e42819cd6b227dcbcf674`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:29.086456 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f9057ef4-6f04-4fc1-9893-c5d6062df0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:29.179072 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 886/1757] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:29 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:40:29.188883 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0c94f-1726-48bf-85b6-16a8153fcba5 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:29.190909 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-5ea0c94f-1726-48bf-85b6-16a8153fcba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:29.274489 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0c94f-1726-48bf-85b6-16a8153fcba5 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:29.282108 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52f520-9230-4dc4-80d0-986bf746ebfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:29.283247 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52f520-9230-4dc4-80d0-986bf746ebfb service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:29.283247 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52f520-9230-4dc4-80d0-986bf746ebfb service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:29.283534 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52f520-9230-4dc4-80d0-986bf746ebfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:29.311849 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52f520-9230-4dc4-80d0-986bf746ebfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:29.313698 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f52f520-9230-4dc4-80d0-986bf746ebfb service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:29.330692 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 872/1758] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:29 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:29.439095 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9057ef4-6f04-4fc1-9893-c5d6062df0c6 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:29.450466 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9057ef4-6f04-4fc1-9893-c5d6062df0c6 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:29.454633 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0d90a-8bb1-4b1b-a579-59e881cc04c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:29.455525 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0d90a-8bb1-4b1b-a579-59e881cc04c4 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:29.455988 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0d90a-8bb1-4b1b-a579-59e881cc04c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:29.456438 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0d90a-8bb1-4b1b-a579-59e881cc04c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:29.517817 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af0d90a-8bb1-4b1b-a579-59e881cc04c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:29.519305 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af0d90a-8bb1-4b1b-a579-59e881cc04c4 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:29.531736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 887/1759] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:29.811895 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52f520-9230-4dc4-80d0-986bf746ebfb service cinder] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:29.814048 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-4f52f520-9230-4dc4-80d0-986bf746ebfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:29.847916 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0d90a-8bb1-4b1b-a579-59e881cc04c4 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:29.850152 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9af0d90a-8bb1-4b1b-a579-59e881cc04c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:29.900197 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52f520-9230-4dc4-80d0-986bf746ebfb service cinder] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:29.906862 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6efd3-6bb7-4773-bb56-0c51af8cf370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:29.908204 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6efd3-6bb7-4773-bb56-0c51af8cf370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:29.908725 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6efd3-6bb7-4773-bb56-0c51af8cf370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:29.909207 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6efd3-6bb7-4773-bb56-0c51af8cf370 admin admin] PATH_INFO: `/v3/users/2e465f2986fd44c094cadac569041dd9` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:29.910757 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6efd3-6bb7-4773-bb56-0c51af8cf370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e465f2986fd44c094cadac569041dd9)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:29.914589 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6efd3-6bb7-4773-bb56-0c51af8cf370 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:29.997325 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-e2f6efd3-6bb7-4773-bb56-0c51af8cf370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e465f2986fd44c094cadac569041dd9'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:30.009112 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-e2f6efd3-6bb7-4773-bb56-0c51af8cf370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e465f2986fd44c094cadac569041dd9'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:30.010594 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-e2f6efd3-6bb7-4773-bb56-0c51af8cf370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e465f2986fd44c094cadac569041dd9'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:30.026379 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0d90a-8bb1-4b1b-a579-59e881cc04c4 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:30.028493 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-e2f6efd3-6bb7-4773-bb56-0c51af8cf370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e465f2986fd44c094cadac569041dd9'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:30.036853 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99688c3-e2fb-45ee-b802-cd2327c8a98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:30.038802 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99688c3-e2fb-45ee-b802-cd2327c8a98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:30.039324 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99688c3-e2fb-45ee-b802-cd2327c8a98d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:30.039924 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99688c3-e2fb-45ee-b802-cd2327c8a98d admin admin] PATH_INFO: `/v3/users/161b6a4262a44ca499d802dfe16b5ae5` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:30.043227 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99688c3-e2fb-45ee-b802-cd2327c8a98d admin admin] RBAC: Authorizing `identity:delete_user(user_id=161b6a4262a44ca499d802dfe16b5ae5)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:30.052701 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-e2f6efd3-6bb7-4773-bb56-0c51af8cf370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e465f2986fd44c094cadac569041dd9'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:30.053510 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99688c3-e2fb-45ee-b802-cd2327c8a98d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:30.069997 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 873/1760] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:40:29 2022] DELETE /identity/v3/users/2e465f2986fd44c094cadac569041dd9 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:30.077064 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024bcd6-3116-44ef-9f7d-28e264ca9cf3 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:30.077316 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024bcd6-3116-44ef-9f7d-28e264ca9cf3 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:30.077598 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024bcd6-3116-44ef-9f7d-28e264ca9cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:30.144594 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-2024bcd6-3116-44ef-9f7d-28e264ca9cf3 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:30.146320 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-2024bcd6-3116-44ef-9f7d-28e264ca9cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:30.158723 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c99688c3-e2fb-45ee-b802-cd2327c8a98d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '161b6a4262a44ca499d802dfe16b5ae5'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:30.176639 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c99688c3-e2fb-45ee-b802-cd2327c8a98d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '161b6a4262a44ca499d802dfe16b5ae5'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:30.177406 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c99688c3-e2fb-45ee-b802-cd2327c8a98d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '161b6a4262a44ca499d802dfe16b5ae5'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:30.211421 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c99688c3-e2fb-45ee-b802-cd2327c8a98d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '161b6a4262a44ca499d802dfe16b5ae5'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:30.231111 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c99688c3-e2fb-45ee-b802-cd2327c8a98d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '161b6a4262a44ca499d802dfe16b5ae5'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:30.249450 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 888/1761] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:40:29 2022] DELETE /identity/v3/users/161b6a4262a44ca499d802dfe16b5ae5 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:30.255108 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9936e-9102-46a2-bbda-0722cedbf5ef None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:30.257229 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9936e-9102-46a2-bbda-0722cedbf5ef None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:30.258678 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9936e-9102-46a2-bbda-0722cedbf5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:30.269321 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 874/1762] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:30.286861 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024bcd6-3116-44ef-9f7d-28e264ca9cf3 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:30.288291 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-2024bcd6-3116-44ef-9f7d-28e264ca9cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:30.300456 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d7e9936e-9102-46a2-bbda-0722cedbf5ef None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:30.302731 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d7e9936e-9102-46a2-bbda-0722cedbf5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:30.438839 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024bcd6-3116-44ef-9f7d-28e264ca9cf3 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:30.463555 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 889/1763] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:30.501429 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9936e-9102-46a2-bbda-0722cedbf5ef None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:30.503127 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d7e9936e-9102-46a2-bbda-0722cedbf5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:30.516591 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455ab21-a663-43a3-a114-58056fcd1395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:30.517720 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455ab21-a663-43a3-a114-58056fcd1395 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:30.518015 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455ab21-a663-43a3-a114-58056fcd1395 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:30.518302 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455ab21-a663-43a3-a114-58056fcd1395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:30.530571 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455ab21-a663-43a3-a114-58056fcd1395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:30.532034 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455ab21-a663-43a3-a114-58056fcd1395 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:30.551925 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 875/1764] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:40:30.585898 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9936e-9102-46a2-bbda-0722cedbf5ef None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:30.590890 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed36db-d189-4667-979b-726ac4d593d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:30.591574 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed36db-d189-4667-979b-726ac4d593d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:30.591861 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed36db-d189-4667-979b-726ac4d593d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:30.592136 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed36db-d189-4667-979b-726ac4d593d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:30.605502 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed36db-d189-4667-979b-726ac4d593d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:30.607087 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed36db-d189-4667-979b-726ac4d593d4 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:30.622710 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 890/1765] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:40:30.907004 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef5e96-59ed-4207-800b-2d815932a529 None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:30.907522 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef5e96-59ed-4207-800b-2d815932a529 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:30.907615 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef5e96-59ed-4207-800b-2d815932a529 None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:30.909720 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 876/1766] 10.222.0.36 () {54 vars in 921 bytes} [Wed Feb 9 04:40:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:40:30.966775 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9335a5-66d0-470e-8942-ecfc958ea1c2 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:30.967623 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9335a5-66d0-470e-8942-ecfc958ea1c2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:30.967915 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9335a5-66d0-470e-8942-ecfc958ea1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:30.997447 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ae9335a5-66d0-470e-8942-ecfc958ea1c2 None None] MFA Rules not processed for user `63fe98c10e974c019e05a2f68d012ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:30.998759 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ae9335a5-66d0-470e-8942-ecfc958ea1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:31.086943 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 891/1767] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Feb 9 04:40:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:40:31.335601 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef5e96-59ed-4207-800b-2d815932a529 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:31.337589 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-84ef5e96-59ed-4207-800b-2d815932a529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:31.370692 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9335a5-66d0-470e-8942-ecfc958ea1c2 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:31.372493 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef5e96-59ed-4207-800b-2d815932a529 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:31.372969 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ae9335a5-66d0-470e-8942-ecfc958ea1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:31.381631 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ceda6-4c7c-4fe1-b28a-9095ca0c1cbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:31.382650 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ceda6-4c7c-4fe1-b28a-9095ca0c1cbc service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:31.383308 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ceda6-4c7c-4fe1-b28a-9095ca0c1cbc service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:31.384567 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ceda6-4c7c-4fe1-b28a-9095ca0c1cbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:31.397712 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9335a5-66d0-470e-8942-ecfc958ea1c2 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:31.414551 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a65b5-7451-46df-8957-d4133fee7444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:31.415444 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a65b5-7451-46df-8957-d4133fee7444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:31.415728 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a65b5-7451-46df-8957-d4133fee7444 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:31.416005 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a65b5-7451-46df-8957-d4133fee7444 admin admin] PATH_INFO: `/v3/projects/dbf7e19994e14d6d90524c73b011d5dd` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:31.419166 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a65b5-7451-46df-8957-d4133fee7444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbf7e19994e14d6d90524c73b011d5dd)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:31.422158 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a65b5-7451-46df-8957-d4133fee7444 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:31.439017 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ceda6-4c7c-4fe1-b28a-9095ca0c1cbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:31.441152 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ceda6-4c7c-4fe1-b28a-9095ca0c1cbc service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:31.465438 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 877/1768] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:31.593167 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-851a65b5-7451-46df-8957-d4133fee7444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbf7e19994e14d6d90524c73b011d5dd', 'request_id': 'req-851a65b5-7451-46df-8957-d4133fee7444'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:31.614697 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ceda6-4c7c-4fe1-b28a-9095ca0c1cbc service nova] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:31.616447 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-951ceda6-4c7c-4fe1-b28a-9095ca0c1cbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:31.633901 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-851a65b5-7451-46df-8957-d4133fee7444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbf7e19994e14d6d90524c73b011d5dd', 'request_id': 'req-851a65b5-7451-46df-8957-d4133fee7444'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:31.656229 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ceda6-4c7c-4fe1-b28a-9095ca0c1cbc service nova] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:31.663624 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-851a65b5-7451-46df-8957-d4133fee7444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbf7e19994e14d6d90524c73b011d5dd', 'request_id': 'req-851a65b5-7451-46df-8957-d4133fee7444'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:31.709758 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-851a65b5-7451-46df-8957-d4133fee7444 admin admin] The token cache is being invalidate because project dbf7e19994e14d6d90524c73b011d5dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:40:31.710168 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-851a65b5-7451-46df-8957-d4133fee7444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:31.713540 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-851a65b5-7451-46df-8957-d4133fee7444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:31.721240 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 892/1769] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:40:31 2022] DELETE /identity/v3/projects/dbf7e19994e14d6d90524c73b011d5dd => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:31.730263 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a65b5-7451-46df-8957-d4133fee7444 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:31.737378 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-851a65b5-7451-46df-8957-d4133fee7444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:31.820477 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab334ae-f79f-4973-a48e-50a2ea53156b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:31.821383 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab334ae-f79f-4973-a48e-50a2ea53156b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:31.821672 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab334ae-f79f-4973-a48e-50a2ea53156b admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:31.824648 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab334ae-f79f-4973-a48e-50a2ea53156b admin admin] PATH_INFO: `/v3/projects/25e113c098564c28972f0418b73b4f71` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:31.830541 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab334ae-f79f-4973-a48e-50a2ea53156b admin admin] RBAC: Authorizing `identity:delete_project(project_id=25e113c098564c28972f0418b73b4f71)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:31.836413 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab334ae-f79f-4973-a48e-50a2ea53156b admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:31.888898 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a65b5-7451-46df-8957-d4133fee7444 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:31.903093 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b9901-7025-4973-b30b-2b7e79f99c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:31.904133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b9901-7025-4973-b30b-2b7e79f99c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:31.904510 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b9901-7025-4973-b30b-2b7e79f99c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:31.904879 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b9901-7025-4973-b30b-2b7e79f99c4e admin admin] PATH_INFO: `/v3/users/13d5dd2a56d549e4933d76cd3ac4bbd7` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:31.919393 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b9901-7025-4973-b30b-2b7e79f99c4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=13d5dd2a56d549e4933d76cd3ac4bbd7)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:31.935628 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b9901-7025-4973-b30b-2b7e79f99c4e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:31.940234 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-fab334ae-f79f-4973-a48e-50a2ea53156b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25e113c098564c28972f0418b73b4f71', 'request_id': 'req-fab334ae-f79f-4973-a48e-50a2ea53156b'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:31.956967 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-fab334ae-f79f-4973-a48e-50a2ea53156b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25e113c098564c28972f0418b73b4f71', 'request_id': 'req-fab334ae-f79f-4973-a48e-50a2ea53156b'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:31.969321 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-fab334ae-f79f-4973-a48e-50a2ea53156b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25e113c098564c28972f0418b73b4f71', 'request_id': 'req-fab334ae-f79f-4973-a48e-50a2ea53156b'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:31.983158 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-fab334ae-f79f-4973-a48e-50a2ea53156b admin admin] The token cache is being invalidate because project 25e113c098564c28972f0418b73b4f71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:40:31.983881 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-fab334ae-f79f-4973-a48e-50a2ea53156b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:31.985755 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-fab334ae-f79f-4973-a48e-50a2ea53156b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:31.988747 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 878/1770] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:40:31 2022] DELETE /identity/v3/projects/25e113c098564c28972f0418b73b4f71 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:31.996931 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27575790-3f53-4cb0-b12d-8995110f1c44 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:31.997545 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27575790-3f53-4cb0-b12d-8995110f1c44 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:31.998021 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27575790-3f53-4cb0-b12d-8995110f1c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:32.047421 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-27575790-3f53-4cb0-b12d-8995110f1c44 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:32.050319 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-27575790-3f53-4cb0-b12d-8995110f1c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:32.063870 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-238b9901-7025-4973-b30b-2b7e79f99c4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13d5dd2a56d549e4933d76cd3ac4bbd7'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:32.077493 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-238b9901-7025-4973-b30b-2b7e79f99c4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13d5dd2a56d549e4933d76cd3ac4bbd7'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:32.078592 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-238b9901-7025-4973-b30b-2b7e79f99c4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13d5dd2a56d549e4933d76cd3ac4bbd7'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:32.120039 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-238b9901-7025-4973-b30b-2b7e79f99c4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13d5dd2a56d549e4933d76cd3ac4bbd7'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:32.138578 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-238b9901-7025-4973-b30b-2b7e79f99c4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13d5dd2a56d549e4933d76cd3ac4bbd7'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:32.147824 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 893/1771] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:40:31 2022] DELETE /identity/v3/users/13d5dd2a56d549e4933d76cd3ac4bbd7 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:32.157033 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 879/1772] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:32.164559 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a41fec-2d8b-4af3-a94f-7f10425459fd None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:32.165105 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a41fec-2d8b-4af3-a94f-7f10425459fd None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:32.165535 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a41fec-2d8b-4af3-a94f-7f10425459fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:32.201681 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-57a41fec-2d8b-4af3-a94f-7f10425459fd None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:32.202929 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-57a41fec-2d8b-4af3-a94f-7f10425459fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:32.278578 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 894/1773] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:32.282770 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27575790-3f53-4cb0-b12d-8995110f1c44 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:32.293368 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27575790-3f53-4cb0-b12d-8995110f1c44 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:32.298720 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d7eac-ccc6-47e4-8fe8-9e42593da031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:32.299389 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d7eac-ccc6-47e4-8fe8-9e42593da031 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:32.299664 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d7eac-ccc6-47e4-8fe8-9e42593da031 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:32.300346 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d7eac-ccc6-47e4-8fe8-9e42593da031 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:32.301707 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d7eac-ccc6-47e4-8fe8-9e42593da031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:40:32.302143 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d7eac-ccc6-47e4-8fe8-9e42593da031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:32.303756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d7eac-ccc6-47e4-8fe8-9e42593da031 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:32.318397 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 880/1774] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:40:32.322854 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a41fec-2d8b-4af3-a94f-7f10425459fd None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:32.333609 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a41fec-2d8b-4af3-a94f-7f10425459fd None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:32.338682 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a057e8-44bb-4d23-b95e-2511fda9dc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:32.339643 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a057e8-44bb-4d23-b95e-2511fda9dc1b admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:32.339934 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a057e8-44bb-4d23-b95e-2511fda9dc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:32.340211 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a057e8-44bb-4d23-b95e-2511fda9dc1b admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:32.341420 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a057e8-44bb-4d23-b95e-2511fda9dc1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:32.343308 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a057e8-44bb-4d23-b95e-2511fda9dc1b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:32.380272 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 895/1775] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:40:32 2022] POST /identity/v3/projects => generated 403 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:32.387962 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d7eac-ccc6-47e4-8fe8-9e42593da031 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:32.400067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d7eac-ccc6-47e4-8fe8-9e42593da031 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:32.461664 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e208a6-ed12-4fca-a7fc-ff83d9a5f77d None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:32.462468 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e208a6-ed12-4fca-a7fc-ff83d9a5f77d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:32.462899 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e208a6-ed12-4fca-a7fc-ff83d9a5f77d None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:32.465368 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 896/1776] 10.222.0.36 () {54 vars in 921 bytes} [Wed Feb 9 04:40:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 09 04:40:32.476760 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7dc10-3556-43db-be33-096f5e810e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:32.477633 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7dc10-3556-43db-be33-096f5e810e3d admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:32.478559 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7dc10-3556-43db-be33-096f5e810e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:32.479225 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7dc10-3556-43db-be33-096f5e810e3d admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:32.480430 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7dc10-3556-43db-be33-096f5e810e3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:32.481235 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c8bdf-6cf7-4e76-8b22-a019dc5554e7 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:32.481528 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c8bdf-6cf7-4e76-8b22-a019dc5554e7 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:32.481955 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c8bdf-6cf7-4e76-8b22-a019dc5554e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:32.483177 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7dc10-3556-43db-be33-096f5e810e3d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:32.514126 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-5f6c8bdf-6cf7-4e76-8b22-a019dc5554e7 None None] MFA Rules not processed for user `63fe98c10e974c019e05a2f68d012ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:32.515765 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5f6c8bdf-6cf7-4e76-8b22-a019dc5554e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:32.516537 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 881/1777] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:40:32 2022] POST /identity/v3/users => generated 302 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:32.520844 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7dc10-3556-43db-be33-096f5e810e3d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:32.533809 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7dc10-3556-43db-be33-096f5e810e3d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:32.542512 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740e71f-9f6f-474e-8427-ab22daefcf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:32.543181 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740e71f-9f6f-474e-8427-ab22daefcf1d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:32.549654 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740e71f-9f6f-474e-8427-ab22daefcf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:32.550148 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740e71f-9f6f-474e-8427-ab22daefcf1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:32.552353 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740e71f-9f6f-474e-8427-ab22daefcf1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:32.554905 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740e71f-9f6f-474e-8427-ab22daefcf1d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:32.569047 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 882/1778] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:32.574363 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740e71f-9f6f-474e-8427-ab22daefcf1d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:32.588621 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740e71f-9f6f-474e-8427-ab22daefcf1d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:32.595195 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20e233-d395-4156-9c08-ff3cf965d766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:32.596246 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20e233-d395-4156-9c08-ff3cf965d766 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:32.596984 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20e233-d395-4156-9c08-ff3cf965d766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:32.598013 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20e233-d395-4156-9c08-ff3cf965d766 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:32.599276 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20e233-d395-4156-9c08-ff3cf965d766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:32.601802 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20e233-d395-4156-9c08-ff3cf965d766 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:32.623540 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 897/1779] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Feb 9 04:40:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:40:32.629716 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 883/1780] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:32.634116 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c8bdf-6cf7-4e76-8b22-a019dc5554e7 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:32.662010 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c8bdf-6cf7-4e76-8b22-a019dc5554e7 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:32.673107 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf4810-1304-4273-ad56-4b25438c73aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:32.674829 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf4810-1304-4273-ad56-4b25438c73aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:32.675300 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf4810-1304-4273-ad56-4b25438c73aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:32.676682 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf4810-1304-4273-ad56-4b25438c73aa admin admin] PATH_INFO: `/v3/projects/1127ac2aaed44d5e8e58eb934df1f2bb/users/f479d3411e2945a09cf575f713aaf7f7/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:32.699554 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf4810-1304-4273-ad56-4b25438c73aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1127ac2aaed44d5e8e58eb934df1f2bb, user_id=f479d3411e2945a09cf575f713aaf7f7, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:32.703883 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf4810-1304-4273-ad56-4b25438c73aa admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:32.732649 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 898/1781] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:32 2022] PUT /identity/v3/projects/1127ac2aaed44d5e8e58eb934df1f2bb/users/f479d3411e2945a09cf575f713aaf7f7/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:32.744753 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313372da-2272-4fe8-a740-4f287095c30f None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:32.745053 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313372da-2272-4fe8-a740-4f287095c30f None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:32.745345 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313372da-2272-4fe8-a740-4f287095c30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:32.784384 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-313372da-2272-4fe8-a740-4f287095c30f None None] MFA Rules not processed for user `f479d3411e2945a09cf575f713aaf7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:32.790144 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-313372da-2272-4fe8-a740-4f287095c30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:32.898395 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 884/1782] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:32.899407 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf4810-1304-4273-ad56-4b25438c73aa admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:32.907144 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313372da-2272-4fe8-a740-4f287095c30f None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:32.908315 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-313372da-2272-4fe8-a740-4f287095c30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:33.013440 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313372da-2272-4fe8-a740-4f287095c30f None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:33.028016 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713e789-5092-4e03-8d7b-4b34253bb551 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:33.028777 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713e789-5092-4e03-8d7b-4b34253bb551 service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:33.029089 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713e789-5092-4e03-8d7b-4b34253bb551 service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:33.029371 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713e789-5092-4e03-8d7b-4b34253bb551 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:33.037528 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf4810-1304-4273-ad56-4b25438c73aa admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:33.042665 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713e789-5092-4e03-8d7b-4b34253bb551 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:33.044604 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713e789-5092-4e03-8d7b-4b34253bb551 service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:33.052996 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e209d9-8cfc-469d-b3c3-44c0e456f14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:33.053760 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e209d9-8cfc-469d-b3c3-44c0e456f14a admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:33.054139 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e209d9-8cfc-469d-b3c3-44c0e456f14a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:33.054505 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e209d9-8cfc-469d-b3c3-44c0e456f14a admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:33.055253 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e209d9-8cfc-469d-b3c3-44c0e456f14a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:33.057285 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e209d9-8cfc-469d-b3c3-44c0e456f14a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:33.058064 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 885/1783] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:40:33.130470 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 899/1784] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:40:32 2022] POST /identity/v3/projects => generated 405 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:33.131114 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713e789-5092-4e03-8d7b-4b34253bb551 service nova] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:33.146421 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713e789-5092-4e03-8d7b-4b34253bb551 service nova] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:33.262926 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d255ba1-d2a2-4783-a1a1-f613cf15b83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:33.264560 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d255ba1-d2a2-4783-a1a1-f613cf15b83a admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:33.265138 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d255ba1-d2a2-4783-a1a1-f613cf15b83a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:33.265596 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d255ba1-d2a2-4783-a1a1-f613cf15b83a admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:33.266398 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d255ba1-d2a2-4783-a1a1-f613cf15b83a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:33.269938 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d255ba1-d2a2-4783-a1a1-f613cf15b83a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:33.306095 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 886/1785] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:40:33 2022] POST /identity/v3/users => generated 309 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:40:33.310346 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e209d9-8cfc-469d-b3c3-44c0e456f14a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:33.322388 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e209d9-8cfc-469d-b3c3-44c0e456f14a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:33.327581 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac2253-e22f-44c0-9f02-e58216226bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:33.329044 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac2253-e22f-44c0-9f02-e58216226bac admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:33.329044 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac2253-e22f-44c0-9f02-e58216226bac admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:33.329044 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac2253-e22f-44c0-9f02-e58216226bac admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:33.329692 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac2253-e22f-44c0-9f02-e58216226bac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:33.331374 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac2253-e22f-44c0-9f02-e58216226bac admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:33.344102 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 900/1786] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:33.348474 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d255ba1-d2a2-4783-a1a1-f613cf15b83a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:33.360045 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d255ba1-d2a2-4783-a1a1-f613cf15b83a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:33.366080 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92861d-1622-450a-bb54-cffbb8c14d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:33.366977 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92861d-1622-450a-bb54-cffbb8c14d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:33.367262 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92861d-1622-450a-bb54-cffbb8c14d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:33.367541 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92861d-1622-450a-bb54-cffbb8c14d55 admin admin] PATH_INFO: `/v3/projects/5f0c62b4b20e458587c134ff4768c12a/users/51666cc1adf546c4bc1457662673458c/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:33.384603 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92861d-1622-450a-bb54-cffbb8c14d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0c62b4b20e458587c134ff4768c12a, user_id=51666cc1adf546c4bc1457662673458c, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:33.389044 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c92861d-1622-450a-bb54-cffbb8c14d55 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:33.409840 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 887/1787] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:33 2022] PUT /identity/v3/projects/5f0c62b4b20e458587c134ff4768c12a/users/51666cc1adf546c4bc1457662673458c/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:40:33.414418 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac2253-e22f-44c0-9f02-e58216226bac admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:33.429456 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac2253-e22f-44c0-9f02-e58216226bac admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:33.571098 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f0a60-8ddc-4eae-a23f-8c471e020adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:33.572173 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f0a60-8ddc-4eae-a23f-8c471e020adb admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:33.572662 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f0a60-8ddc-4eae-a23f-8c471e020adb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:33.573234 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f0a60-8ddc-4eae-a23f-8c471e020adb admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:33.574526 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f0a60-8ddc-4eae-a23f-8c471e020adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:33.578061 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f0a60-8ddc-4eae-a23f-8c471e020adb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:33.609966 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 901/1788] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:33.614631 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92861d-1622-450a-bb54-cffbb8c14d55 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:33.626921 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c92861d-1622-450a-bb54-cffbb8c14d55 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:33.637643 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427537f4-1225-4782-b53d-8308e51994d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:33.640207 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427537f4-1225-4782-b53d-8308e51994d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:33.640715 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427537f4-1225-4782-b53d-8308e51994d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:33.641253 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427537f4-1225-4782-b53d-8308e51994d3 admin admin] PATH_INFO: `/v3/projects/5f0c62b4b20e458587c134ff4768c12a/users/51666cc1adf546c4bc1457662673458c/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:33.643660 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427537f4-1225-4782-b53d-8308e51994d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0c62b4b20e458587c134ff4768c12a, user_id=51666cc1adf546c4bc1457662673458c, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:33.648170 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427537f4-1225-4782-b53d-8308e51994d3 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:33.663993 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 888/1789] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:33 2022] PUT /identity/v3/projects/5f0c62b4b20e458587c134ff4768c12a/users/51666cc1adf546c4bc1457662673458c/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:33.674152 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b3394-fa77-4694-983f-5f8c66a01b1a None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:33.674627 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b3394-fa77-4694-983f-5f8c66a01b1a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:33.674719 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b3394-fa77-4694-983f-5f8c66a01b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:33.727954 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-7f8b3394-fa77-4694-983f-5f8c66a01b1a None None] MFA Rules not processed for user `51666cc1adf546c4bc1457662673458c`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:33.729333 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7f8b3394-fa77-4694-983f-5f8c66a01b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:33.831913 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427537f4-1225-4782-b53d-8308e51994d3 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:33.837322 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-427537f4-1225-4782-b53d-8308e51994d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:33.959622 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 902/1790] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:33 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:34.020273 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b3394-fa77-4694-983f-5f8c66a01b1a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:34.021902 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7f8b3394-fa77-4694-983f-5f8c66a01b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:34.078559 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427537f4-1225-4782-b53d-8308e51994d3 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:34.111485 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891f814-e7c4-4c24-93e2-757367f5d9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:34.114332 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891f814-e7c4-4c24-93e2-757367f5d9ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:34.115087 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891f814-e7c4-4c24-93e2-757367f5d9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:34.116161 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891f814-e7c4-4c24-93e2-757367f5d9ad admin admin] PATH_INFO: `/v3/projects/869e4dded223483093ef6104763c63c1` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:34.118159 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891f814-e7c4-4c24-93e2-757367f5d9ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=869e4dded223483093ef6104763c63c1)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:34.120812 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891f814-e7c4-4c24-93e2-757367f5d9ad admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:34.174245 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b3394-fa77-4694-983f-5f8c66a01b1a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:34.183191 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c14602-498a-4b59-aea4-f35cf5e37788 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:34.184193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c14602-498a-4b59-aea4-f35cf5e37788 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:34.185064 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c14602-498a-4b59-aea4-f35cf5e37788 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:34.185462 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c14602-498a-4b59-aea4-f35cf5e37788 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:34.202990 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c14602-498a-4b59-aea4-f35cf5e37788 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:34.206087 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c14602-498a-4b59-aea4-f35cf5e37788 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:34.210062 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-b891f814-e7c4-4c24-93e2-757367f5d9ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869e4dded223483093ef6104763c63c1', 'request_id': 'req-b891f814-e7c4-4c24-93e2-757367f5d9ad'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:34.224904 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-b891f814-e7c4-4c24-93e2-757367f5d9ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869e4dded223483093ef6104763c63c1', 'request_id': 'req-b891f814-e7c4-4c24-93e2-757367f5d9ad'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:34.226554 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 903/1791] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:34 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:40:34.250012 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c14602-498a-4b59-aea4-f35cf5e37788 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:34.252090 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-41c14602-498a-4b59-aea4-f35cf5e37788 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:34.270267 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-b891f814-e7c4-4c24-93e2-757367f5d9ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869e4dded223483093ef6104763c63c1', 'request_id': 'req-b891f814-e7c4-4c24-93e2-757367f5d9ad'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:34.287002 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-b891f814-e7c4-4c24-93e2-757367f5d9ad admin admin] The token cache is being invalidate because project 869e4dded223483093ef6104763c63c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:40:34.287575 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-b891f814-e7c4-4c24-93e2-757367f5d9ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:34.288498 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-b891f814-e7c4-4c24-93e2-757367f5d9ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:34.288677 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c14602-498a-4b59-aea4-f35cf5e37788 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:34.290989 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 889/1792] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:40:33 2022] DELETE /identity/v3/projects/869e4dded223483093ef6104763c63c1 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:40:34.298320 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2d5a3-b7c4-42ab-b3b6-ac9970b1a3b3 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:34.298917 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2d5a3-b7c4-42ab-b3b6-ac9970b1a3b3 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:34.300316 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2d5a3-b7c4-42ab-b3b6-ac9970b1a3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:34.343141 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-77c2d5a3-b7c4-42ab-b3b6-ac9970b1a3b3 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:34.344668 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-77c2d5a3-b7c4-42ab-b3b6-ac9970b1a3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:34.440842 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac322b8-eaf2-4415-8e50-62cb5d5f23a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:34.442037 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac322b8-eaf2-4415-8e50-62cb5d5f23a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:34.443334 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac322b8-eaf2-4415-8e50-62cb5d5f23a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:34.443764 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac322b8-eaf2-4415-8e50-62cb5d5f23a4 admin admin] PATH_INFO: `/v3/users/d2517076ac50486480fb6fb271a8dae1` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:34.445606 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac322b8-eaf2-4415-8e50-62cb5d5f23a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2517076ac50486480fb6fb271a8dae1)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:34.448159 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac322b8-eaf2-4415-8e50-62cb5d5f23a4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:34.477937 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 890/1793] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:34.479569 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2d5a3-b7c4-42ab-b3b6-ac9970b1a3b3 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:34.482213 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-77c2d5a3-b7c4-42ab-b3b6-ac9970b1a3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:34.504856 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2d5a3-b7c4-42ab-b3b6-ac9970b1a3b3 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:34.513672 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa15f68-0dfd-4b00-9ec1-9ae46f7c4063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:34.515606 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa15f68-0dfd-4b00-9ec1-9ae46f7c4063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:34.516169 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa15f68-0dfd-4b00-9ec1-9ae46f7c4063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:34.517280 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa15f68-0dfd-4b00-9ec1-9ae46f7c4063 admin admin] PATH_INFO: `/v3/users/f479d3411e2945a09cf575f713aaf7f7` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:34.521913 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa15f68-0dfd-4b00-9ec1-9ae46f7c4063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f479d3411e2945a09cf575f713aaf7f7)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:34.526668 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-dac322b8-eaf2-4415-8e50-62cb5d5f23a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2517076ac50486480fb6fb271a8dae1'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:34.528217 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa15f68-0dfd-4b00-9ec1-9ae46f7c4063 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:34.536893 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-dac322b8-eaf2-4415-8e50-62cb5d5f23a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2517076ac50486480fb6fb271a8dae1'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:34.538041 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-dac322b8-eaf2-4415-8e50-62cb5d5f23a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2517076ac50486480fb6fb271a8dae1'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:34.554683 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-dac322b8-eaf2-4415-8e50-62cb5d5f23a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2517076ac50486480fb6fb271a8dae1'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:34.568635 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-dac322b8-eaf2-4415-8e50-62cb5d5f23a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2517076ac50486480fb6fb271a8dae1'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:34.576894 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 904/1794] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:40:34 2022] DELETE /identity/v3/users/d2517076ac50486480fb6fb271a8dae1 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:34.579852 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11374f-d772-404f-98db-b17aeda7f08a None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:34.580121 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11374f-d772-404f-98db-b17aeda7f08a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:34.580425 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11374f-d772-404f-98db-b17aeda7f08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:34.604251 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2a11374f-d772-404f-98db-b17aeda7f08a None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:34.605625 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2a11374f-d772-404f-98db-b17aeda7f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:34.606524 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-caa15f68-0dfd-4b00-9ec1-9ae46f7c4063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f479d3411e2945a09cf575f713aaf7f7'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:34.621168 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-caa15f68-0dfd-4b00-9ec1-9ae46f7c4063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f479d3411e2945a09cf575f713aaf7f7'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:34.621912 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-caa15f68-0dfd-4b00-9ec1-9ae46f7c4063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f479d3411e2945a09cf575f713aaf7f7'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:34.638389 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-caa15f68-0dfd-4b00-9ec1-9ae46f7c4063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f479d3411e2945a09cf575f713aaf7f7'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:34.646591 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-caa15f68-0dfd-4b00-9ec1-9ae46f7c4063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f479d3411e2945a09cf575f713aaf7f7'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:34.662705 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 891/1795] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:40:34 2022] DELETE /identity/v3/users/f479d3411e2945a09cf575f713aaf7f7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:34.665095 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fca1f-9cf2-4106-af8d-5f16f843782d None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:34.666150 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fca1f-9cf2-4106-af8d-5f16f843782d None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:34.667285 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fca1f-9cf2-4106-af8d-5f16f843782d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:34.691107 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-124fca1f-9cf2-4106-af8d-5f16f843782d None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:34.692615 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-124fca1f-9cf2-4106-af8d-5f16f843782d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:34.712661 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 905/1796] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:34.713956 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11374f-d772-404f-98db-b17aeda7f08a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:34.716881 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2a11374f-d772-404f-98db-b17aeda7f08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:34.732278 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11374f-d772-404f-98db-b17aeda7f08a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:34.774496 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 892/1797] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:34.777465 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e31ab-693d-451d-b7a0-f568b1f8b2bd None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:34.777882 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e31ab-693d-451d-b7a0-f568b1f8b2bd None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:34.778474 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e31ab-693d-451d-b7a0-f568b1f8b2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:34.802072 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-fc7e31ab-693d-451d-b7a0-f568b1f8b2bd None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:34.804483 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-fc7e31ab-693d-451d-b7a0-f568b1f8b2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:34.804797 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8ebdc-5ba5-40e6-b434-ab3232aab48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:34.805828 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8ebdc-5ba5-40e6-b434-ab3232aab48d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:34.806212 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8ebdc-5ba5-40e6-b434-ab3232aab48d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:34.806608 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8ebdc-5ba5-40e6-b434-ab3232aab48d admin admin] PATH_INFO: `/v3/users/4dd92ed4988d41c0b13c5cd397862adf` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:34.808109 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8ebdc-5ba5-40e6-b434-ab3232aab48d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd92ed4988d41c0b13c5cd397862adf)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:34.810663 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8ebdc-5ba5-40e6-b434-ab3232aab48d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:34.816200 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 893/1798] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:34.823120 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e31ab-693d-451d-b7a0-f568b1f8b2bd None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:34.835781 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e31ab-693d-451d-b7a0-f568b1f8b2bd None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:34.840485 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84effe7-79e4-4cdf-a431-5491ecf96f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:34.841224 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84effe7-79e4-4cdf-a431-5491ecf96f92 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:34.841579 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84effe7-79e4-4cdf-a431-5491ecf96f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:34.842039 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84effe7-79e4-4cdf-a431-5491ecf96f92 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:34.842802 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84effe7-79e4-4cdf-a431-5491ecf96f92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:40:34.843140 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84effe7-79e4-4cdf-a431-5491ecf96f92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:34.844920 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84effe7-79e4-4cdf-a431-5491ecf96f92 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:34.858197 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 894/1799] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:40:34.859027 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84effe7-79e4-4cdf-a431-5491ecf96f92 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:34.862621 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-f84effe7-79e4-4cdf-a431-5491ecf96f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:34.883875 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-66c8ebdc-5ba5-40e6-b434-ab3232aab48d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd92ed4988d41c0b13c5cd397862adf'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:34.896025 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-66c8ebdc-5ba5-40e6-b434-ab3232aab48d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd92ed4988d41c0b13c5cd397862adf'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:34.897201 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-66c8ebdc-5ba5-40e6-b434-ab3232aab48d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd92ed4988d41c0b13c5cd397862adf'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:34.913355 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-66c8ebdc-5ba5-40e6-b434-ab3232aab48d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd92ed4988d41c0b13c5cd397862adf'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:34.922170 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-66c8ebdc-5ba5-40e6-b434-ab3232aab48d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd92ed4988d41c0b13c5cd397862adf'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:34.927441 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84effe7-79e4-4cdf-a431-5491ecf96f92 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:34.930077 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 906/1800] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:40:34 2022] DELETE /identity/v3/users/4dd92ed4988d41c0b13c5cd397862adf => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:34.931057 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8ebdc-5ba5-40e6-b434-ab3232aab48d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:34.932370 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-66c8ebdc-5ba5-40e6-b434-ab3232aab48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:34.935110 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1845c-f628-4c02-b8b2-83cb1e029056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:34.935784 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1845c-f628-4c02-b8b2-83cb1e029056 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:34.936072 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1845c-f628-4c02-b8b2-83cb1e029056 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:34.936350 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1845c-f628-4c02-b8b2-83cb1e029056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:34.938392 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-5ac1845c-f628-4c02-b8b2-83cb1e029056 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:34.951417 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1845c-f628-4c02-b8b2-83cb1e029056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:34.952464 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1845c-f628-4c02-b8b2-83cb1e029056 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:34.962736 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 895/1801] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:34.966076 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1845c-f628-4c02-b8b2-83cb1e029056 service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:34.969675 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-5ac1845c-f628-4c02-b8b2-83cb1e029056 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:34.991020 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1845c-f628-4c02-b8b2-83cb1e029056 service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:34.998847 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8ebdc-5ba5-40e6-b434-ab3232aab48d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:35.016761 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f9e68-4da1-4d38-81d8-680036263e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:35.018734 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f9e68-4da1-4d38-81d8-680036263e6a service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:35.019684 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f9e68-4da1-4d38-81d8-680036263e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:35.020661 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f9e68-4da1-4d38-81d8-680036263e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:35.025593 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-241f9e68-4da1-4d38-81d8-680036263e6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:35.079201 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e98493-27e9-4c8b-9983-82ba99c36b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:35.081030 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e98493-27e9-4c8b-9983-82ba99c36b55 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:35.081629 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e98493-27e9-4c8b-9983-82ba99c36b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:35.082749 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e98493-27e9-4c8b-9983-82ba99c36b55 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:35.084230 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e98493-27e9-4c8b-9983-82ba99c36b55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:35.086197 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e98493-27e9-4c8b-9983-82ba99c36b55 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:35.118770 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 896/1802] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:40:34 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:35.120276 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e41e50-6768-44ed-91bd-44b17b8760c5 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:35.120518 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e41e50-6768-44ed-91bd-44b17b8760c5 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:35.120750 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e41e50-6768-44ed-91bd-44b17b8760c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:35.140739 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f9e68-4da1-4d38-81d8-680036263e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:35.140867 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-c4e41e50-6768-44ed-91bd-44b17b8760c5 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:35.142027 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-c4e41e50-6768-44ed-91bd-44b17b8760c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:35.142315 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f9e68-4da1-4d38-81d8-680036263e6a service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:35.157648 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 907/1803] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:35.158551 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f9e68-4da1-4d38-81d8-680036263e6a service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:35.195492 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f9e68-4da1-4d38-81d8-680036263e6a service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:35.308829 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce421c-450c-4c05-b71a-e754b44f09be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:35.309728 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce421c-450c-4c05-b71a-e754b44f09be admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:35.310145 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce421c-450c-4c05-b71a-e754b44f09be admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:35.310562 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce421c-450c-4c05-b71a-e754b44f09be admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:35.311116 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 897/1804] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:35.314939 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce421c-450c-4c05-b71a-e754b44f09be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:35.320013 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce421c-450c-4c05-b71a-e754b44f09be admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:35.347228 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e41e50-6768-44ed-91bd-44b17b8760c5 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:35.347454 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 908/1805] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:40:35 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:35.351993 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce421c-450c-4c05-b71a-e754b44f09be admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:35.362576 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce421c-450c-4c05-b71a-e754b44f09be admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:35.368113 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b05091-4752-40d3-8677-2623c98e4a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:35.369130 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b05091-4752-40d3-8677-2623c98e4a96 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:35.369621 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b05091-4752-40d3-8677-2623c98e4a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:35.370764 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b05091-4752-40d3-8677-2623c98e4a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:35.372163 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b05091-4752-40d3-8677-2623c98e4a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:35.374106 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b05091-4752-40d3-8677-2623c98e4a96 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:35.386573 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 909/1806] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:40:35.391260 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b05091-4752-40d3-8677-2623c98e4a96 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:35.413998 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b05091-4752-40d3-8677-2623c98e4a96 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:35.421820 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237c9eb-078a-44ab-abec-14aa616fb0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:35.423245 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237c9eb-078a-44ab-abec-14aa616fb0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:35.423667 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237c9eb-078a-44ab-abec-14aa616fb0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:35.423838 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1237c9eb-078a-44ab-abec-14aa616fb0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:35.424968 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237c9eb-078a-44ab-abec-14aa616fb0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:35.427341 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1237c9eb-078a-44ab-abec-14aa616fb0f5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:35.459263 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e41e50-6768-44ed-91bd-44b17b8760c5 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:35.463949 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73caf758-f6fe-4bfd-9146-6bf36e486caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:35.464579 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caf758-f6fe-4bfd-9146-6bf36e486caa service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:35.464755 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caf758-f6fe-4bfd-9146-6bf36e486caa service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:35.465266 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73caf758-f6fe-4bfd-9146-6bf36e486caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:35.468276 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 910/1807] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:35.470640 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237c9eb-078a-44ab-abec-14aa616fb0f5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:35.479079 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73caf758-f6fe-4bfd-9146-6bf36e486caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:35.480490 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73caf758-f6fe-4bfd-9146-6bf36e486caa service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:35.487256 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1237c9eb-078a-44ab-abec-14aa616fb0f5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:35.493143 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4102a-0fe6-45e8-8b1f-b7e23614e5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:35.493340 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 898/1808] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:40:35.494140 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4102a-0fe6-45e8-8b1f-b7e23614e5d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:35.494537 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4102a-0fe6-45e8-8b1f-b7e23614e5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:35.494822 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4102a-0fe6-45e8-8b1f-b7e23614e5d5 admin admin] PATH_INFO: `/v3/projects/88ba48b41a314e9b8d94d922a768583c/users/23cb63fbab8343ebb3328436c4f85ef3/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:35.514198 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4102a-0fe6-45e8-8b1f-b7e23614e5d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ba48b41a314e9b8d94d922a768583c, user_id=23cb63fbab8343ebb3328436c4f85ef3, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:35.517219 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4102a-0fe6-45e8-8b1f-b7e23614e5d5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:35.539328 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 911/1809] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:35 2022] PUT /identity/v3/projects/88ba48b41a314e9b8d94d922a768583c/users/23cb63fbab8343ebb3328436c4f85ef3/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:35.550133 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95977f6f-0238-4aaa-909c-1ba94f3186d3 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:35.550436 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95977f6f-0238-4aaa-909c-1ba94f3186d3 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:35.551297 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95977f6f-0238-4aaa-909c-1ba94f3186d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:35.621336 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-95977f6f-0238-4aaa-909c-1ba94f3186d3 None None] MFA Rules not processed for user `23cb63fbab8343ebb3328436c4f85ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:35.626265 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-95977f6f-0238-4aaa-909c-1ba94f3186d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:35.719477 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4102a-0fe6-45e8-8b1f-b7e23614e5d5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:35.721715 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-41b4102a-0fe6-45e8-8b1f-b7e23614e5d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:35.792635 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 899/1810] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:35.793713 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95977f6f-0238-4aaa-909c-1ba94f3186d3 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:35.855785 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4102a-0fe6-45e8-8b1f-b7e23614e5d5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:35.875447 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34b8f9-98be-4cac-a28b-9ae7d5cbf070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:35.878118 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34b8f9-98be-4cac-a28b-9ae7d5cbf070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:35.878502 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34b8f9-98be-4cac-a28b-9ae7d5cbf070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:35.878976 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34b8f9-98be-4cac-a28b-9ae7d5cbf070 admin admin] PATH_INFO: `/v3/projects/5b5bbf7218fd4a73a5dc6d1ab682c07f` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:35.880698 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34b8f9-98be-4cac-a28b-9ae7d5cbf070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b5bbf7218fd4a73a5dc6d1ab682c07f)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:35.885625 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34b8f9-98be-4cac-a28b-9ae7d5cbf070 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:35.959494 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-dc34b8f9-98be-4cac-a28b-9ae7d5cbf070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b5bbf7218fd4a73a5dc6d1ab682c07f', 'request_id': 'req-dc34b8f9-98be-4cac-a28b-9ae7d5cbf070'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:35.971670 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-dc34b8f9-98be-4cac-a28b-9ae7d5cbf070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b5bbf7218fd4a73a5dc6d1ab682c07f', 'request_id': 'req-dc34b8f9-98be-4cac-a28b-9ae7d5cbf070'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:35.978142 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95977f6f-0238-4aaa-909c-1ba94f3186d3 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:35.984192 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-dc34b8f9-98be-4cac-a28b-9ae7d5cbf070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b5bbf7218fd4a73a5dc6d1ab682c07f', 'request_id': 'req-dc34b8f9-98be-4cac-a28b-9ae7d5cbf070'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:35.999912 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-dc34b8f9-98be-4cac-a28b-9ae7d5cbf070 admin admin] The token cache is being invalidate because project 5b5bbf7218fd4a73a5dc6d1ab682c07f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:40:36.000643 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-dc34b8f9-98be-4cac-a28b-9ae7d5cbf070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.001638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-dc34b8f9-98be-4cac-a28b-9ae7d5cbf070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.004031 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 912/1811] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:40:35 2022] DELETE /identity/v3/projects/5b5bbf7218fd4a73a5dc6d1ab682c07f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:36.005326 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34b8f9-98be-4cac-a28b-9ae7d5cbf070 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:36.010728 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-dc34b8f9-98be-4cac-a28b-9ae7d5cbf070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:36.089029 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f00d9-acc5-4800-9479-5180a8a789c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:36.092166 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f00d9-acc5-4800-9479-5180a8a789c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:36.092166 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f00d9-acc5-4800-9479-5180a8a789c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:36.092166 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f00d9-acc5-4800-9479-5180a8a789c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:36.092166 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f00d9-acc5-4800-9479-5180a8a789c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:36.094143 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643f00d9-acc5-4800-9479-5180a8a789c7 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:36.132647 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34b8f9-98be-4cac-a28b-9ae7d5cbf070 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:36.147031 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ed696-2777-4d13-b3ec-a7e4714b23a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:36.148162 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ed696-2777-4d13-b3ec-a7e4714b23a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:36.149145 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ed696-2777-4d13-b3ec-a7e4714b23a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:36.149645 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ed696-2777-4d13-b3ec-a7e4714b23a3 admin admin] PATH_INFO: `/v3/projects/1127ac2aaed44d5e8e58eb934df1f2bb` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:36.151612 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ed696-2777-4d13-b3ec-a7e4714b23a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1127ac2aaed44d5e8e58eb934df1f2bb)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:36.153992 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ed696-2777-4d13-b3ec-a7e4714b23a3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:36.159421 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 900/1812] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:40:35 2022] POST /identity/v3/projects => generated 385 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:36.160189 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f00d9-acc5-4800-9479-5180a8a789c7 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:36.166343 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-643f00d9-acc5-4800-9479-5180a8a789c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:36.220390 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-223ed696-2777-4d13-b3ec-a7e4714b23a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1127ac2aaed44d5e8e58eb934df1f2bb', 'request_id': 'req-223ed696-2777-4d13-b3ec-a7e4714b23a3'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.227763 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-223ed696-2777-4d13-b3ec-a7e4714b23a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1127ac2aaed44d5e8e58eb934df1f2bb', 'request_id': 'req-223ed696-2777-4d13-b3ec-a7e4714b23a3'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.239926 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-223ed696-2777-4d13-b3ec-a7e4714b23a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1127ac2aaed44d5e8e58eb934df1f2bb', 'request_id': 'req-223ed696-2777-4d13-b3ec-a7e4714b23a3'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.258755 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-223ed696-2777-4d13-b3ec-a7e4714b23a3 admin admin] The token cache is being invalidate because project 1127ac2aaed44d5e8e58eb934df1f2bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:40:36.259174 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-223ed696-2777-4d13-b3ec-a7e4714b23a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.260156 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-223ed696-2777-4d13-b3ec-a7e4714b23a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.262296 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 913/1813] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:40:36 2022] DELETE /identity/v3/projects/1127ac2aaed44d5e8e58eb934df1f2bb => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:36.262867 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ed696-2777-4d13-b3ec-a7e4714b23a3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:36.264444 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-223ed696-2777-4d13-b3ec-a7e4714b23a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:36.280448 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f00d9-acc5-4800-9479-5180a8a789c7 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:36.336518 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ed696-2777-4d13-b3ec-a7e4714b23a3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:36.343204 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12b337-2193-49a6-b2e7-3051a83a3b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:36.343621 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12b337-2193-49a6-b2e7-3051a83a3b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:36.343907 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12b337-2193-49a6-b2e7-3051a83a3b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:36.344188 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12b337-2193-49a6-b2e7-3051a83a3b2b admin admin] PATH_INFO: `/v3/projects/7f69aa72c4144175b0c4fdfb5fa47920` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:36.345606 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12b337-2193-49a6-b2e7-3051a83a3b2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f69aa72c4144175b0c4fdfb5fa47920)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:36.348225 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12b337-2193-49a6-b2e7-3051a83a3b2b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:36.371770 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfea3b-a304-482e-8477-1ab3899d6e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:36.372900 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfea3b-a304-482e-8477-1ab3899d6e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:36.373282 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfea3b-a304-482e-8477-1ab3899d6e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:36.373630 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfea3b-a304-482e-8477-1ab3899d6e2a admin admin] PATH_INFO: `/v3/users/b2d1e6630bb74b80ad68885818d925f2` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:36.375057 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfea3b-a304-482e-8477-1ab3899d6e2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d1e6630bb74b80ad68885818d925f2)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:36.377159 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfea3b-a304-482e-8477-1ab3899d6e2a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:36.400525 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ab12b337-2193-49a6-b2e7-3051a83a3b2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f69aa72c4144175b0c4fdfb5fa47920', 'request_id': 'req-ab12b337-2193-49a6-b2e7-3051a83a3b2b'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.407594 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ab12b337-2193-49a6-b2e7-3051a83a3b2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f69aa72c4144175b0c4fdfb5fa47920', 'request_id': 'req-ab12b337-2193-49a6-b2e7-3051a83a3b2b'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.416488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ab12b337-2193-49a6-b2e7-3051a83a3b2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f69aa72c4144175b0c4fdfb5fa47920', 'request_id': 'req-ab12b337-2193-49a6-b2e7-3051a83a3b2b'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.427944 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ab12b337-2193-49a6-b2e7-3051a83a3b2b admin admin] The token cache is being invalidate because project 7f69aa72c4144175b0c4fdfb5fa47920 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:40:36.428441 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ab12b337-2193-49a6-b2e7-3051a83a3b2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.429472 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ab12b337-2193-49a6-b2e7-3051a83a3b2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.431056 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 914/1814] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:40:36 2022] DELETE /identity/v3/projects/7f69aa72c4144175b0c4fdfb5fa47920 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:36.431343 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-23dfea3b-a304-482e-8477-1ab3899d6e2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d1e6630bb74b80ad68885818d925f2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.434782 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12b337-2193-49a6-b2e7-3051a83a3b2b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:36.437321 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ab12b337-2193-49a6-b2e7-3051a83a3b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:36.438772 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-23dfea3b-a304-482e-8477-1ab3899d6e2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d1e6630bb74b80ad68885818d925f2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.439638 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-23dfea3b-a304-482e-8477-1ab3899d6e2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d1e6630bb74b80ad68885818d925f2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.459260 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-23dfea3b-a304-482e-8477-1ab3899d6e2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d1e6630bb74b80ad68885818d925f2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.477885 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-23dfea3b-a304-482e-8477-1ab3899d6e2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d1e6630bb74b80ad68885818d925f2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.484622 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 901/1815] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:40:36 2022] DELETE /identity/v3/users/b2d1e6630bb74b80ad68885818d925f2 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:36.485271 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfea3b-a304-482e-8477-1ab3899d6e2a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:36.486902 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-23dfea3b-a304-482e-8477-1ab3899d6e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:36.521542 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12b337-2193-49a6-b2e7-3051a83a3b2b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:36.581553 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfea3b-a304-482e-8477-1ab3899d6e2a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:36.588994 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8a3c3-66f6-4054-8626-8a2a7f8e2e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:36.590339 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8a3c3-66f6-4054-8626-8a2a7f8e2e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:36.590917 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8a3c3-66f6-4054-8626-8a2a7f8e2e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:36.591368 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8a3c3-66f6-4054-8626-8a2a7f8e2e7a admin admin] PATH_INFO: `/v3/users/51666cc1adf546c4bc1457662673458c` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:36.591776 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c9edd-5786-4240-b77f-ec73a4025b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:36.592616 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c9edd-5786-4240-b77f-ec73a4025b38 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:36.592915 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c9edd-5786-4240-b77f-ec73a4025b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:36.593222 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c9edd-5786-4240-b77f-ec73a4025b38 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:36.593745 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8a3c3-66f6-4054-8626-8a2a7f8e2e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=51666cc1adf546c4bc1457662673458c)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:36.593931 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c9edd-5786-4240-b77f-ec73a4025b38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:36.596123 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c9edd-5786-4240-b77f-ec73a4025b38 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:36.596418 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8a3c3-66f6-4054-8626-8a2a7f8e2e7a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:36.636085 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 915/1816] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:40:36 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:36.636085 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c9edd-5786-4240-b77f-ec73a4025b38 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:36.639385 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-743c9edd-5786-4240-b77f-ec73a4025b38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:36.661123 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c9edd-5786-4240-b77f-ec73a4025b38 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:36.666589 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550cae66-8736-4bbf-b2ff-b2c991760c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:36.668688 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550cae66-8736-4bbf-b2ff-b2c991760c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:36.669222 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550cae66-8736-4bbf-b2ff-b2c991760c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:36.669512 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550cae66-8736-4bbf-b2ff-b2c991760c6b admin admin] PATH_INFO: `/v3/users/5f8ef3682b1e42819cd6b227dcbcf674` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:36.670916 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550cae66-8736-4bbf-b2ff-b2c991760c6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f8ef3682b1e42819cd6b227dcbcf674)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:36.674014 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550cae66-8736-4bbf-b2ff-b2c991760c6b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:36.690432 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-adc8a3c3-66f6-4054-8626-8a2a7f8e2e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51666cc1adf546c4bc1457662673458c'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.707141 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-adc8a3c3-66f6-4054-8626-8a2a7f8e2e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51666cc1adf546c4bc1457662673458c'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.708183 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-adc8a3c3-66f6-4054-8626-8a2a7f8e2e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51666cc1adf546c4bc1457662673458c'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.744440 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-adc8a3c3-66f6-4054-8626-8a2a7f8e2e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51666cc1adf546c4bc1457662673458c'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.746798 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-550cae66-8736-4bbf-b2ff-b2c991760c6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f8ef3682b1e42819cd6b227dcbcf674'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.756970 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-550cae66-8736-4bbf-b2ff-b2c991760c6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f8ef3682b1e42819cd6b227dcbcf674'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.757865 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-550cae66-8736-4bbf-b2ff-b2c991760c6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f8ef3682b1e42819cd6b227dcbcf674'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.765394 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-adc8a3c3-66f6-4054-8626-8a2a7f8e2e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51666cc1adf546c4bc1457662673458c'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.777511 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 902/1817] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:40:36 2022] DELETE /identity/v3/users/51666cc1adf546c4bc1457662673458c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:36.778530 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8a3c3-66f6-4054-8626-8a2a7f8e2e7a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:36.782675 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-adc8a3c3-66f6-4054-8626-8a2a7f8e2e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:36.801681 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-550cae66-8736-4bbf-b2ff-b2c991760c6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f8ef3682b1e42819cd6b227dcbcf674'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.815773 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-550cae66-8736-4bbf-b2ff-b2c991760c6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f8ef3682b1e42819cd6b227dcbcf674'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:36.826480 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 916/1818] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:40:36 2022] DELETE /identity/v3/users/5f8ef3682b1e42819cd6b227dcbcf674 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:36.958595 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8a3c3-66f6-4054-8626-8a2a7f8e2e7a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:37.015987 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550cae66-8736-4bbf-b2ff-b2c991760c6b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:37.018881 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-550cae66-8736-4bbf-b2ff-b2c991760c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:37.113785 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9048da-8d06-481c-833b-6dd17308d776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:37.114470 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9048da-8d06-481c-833b-6dd17308d776 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:37.114754 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9048da-8d06-481c-833b-6dd17308d776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:37.115196 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9048da-8d06-481c-833b-6dd17308d776 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:37.116085 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9048da-8d06-481c-833b-6dd17308d776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:37.117988 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9048da-8d06-481c-833b-6dd17308d776 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:37.129856 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 903/1819] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:37.136761 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9048da-8d06-481c-833b-6dd17308d776 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:37.141329 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-ae9048da-8d06-481c-833b-6dd17308d776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:37.164978 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9048da-8d06-481c-833b-6dd17308d776 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:37.174878 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a4194-23eb-4f6e-af94-545ef8f06cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:37.176917 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a4194-23eb-4f6e-af94-545ef8f06cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:37.177169 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550cae66-8736-4bbf-b2ff-b2c991760c6b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:37.177828 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a4194-23eb-4f6e-af94-545ef8f06cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:37.178314 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a4194-23eb-4f6e-af94-545ef8f06cdf admin admin] PATH_INFO: `/v3/projects/05309a1376b64d6283b83645d593f1d3/users/0cbf2de18b3f40fab6a499f90796e5a0/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:37.182092 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f45028-6191-4fcf-9a12-714ffb83b7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:37.182971 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f45028-6191-4fcf-9a12-714ffb83b7af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:37.183265 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f45028-6191-4fcf-9a12-714ffb83b7af admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:37.183983 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f45028-6191-4fcf-9a12-714ffb83b7af admin admin] PATH_INFO: `/v3/projects/88ae2abddf53489fa6660ecc0b8c9101` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:37.185702 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f45028-6191-4fcf-9a12-714ffb83b7af admin admin] RBAC: Authorizing `identity:delete_project(project_id=88ae2abddf53489fa6660ecc0b8c9101)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:37.187390 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f45028-6191-4fcf-9a12-714ffb83b7af admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:37.203770 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a4194-23eb-4f6e-af94-545ef8f06cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=05309a1376b64d6283b83645d593f1d3, user_id=0cbf2de18b3f40fab6a499f90796e5a0, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:37.211397 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a4194-23eb-4f6e-af94-545ef8f06cdf admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:37.249137 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 904/1820] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:37 2022] PUT /identity/v3/projects/05309a1376b64d6283b83645d593f1d3/users/0cbf2de18b3f40fab6a499f90796e5a0/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:37.250277 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a4194-23eb-4f6e-af94-545ef8f06cdf admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:37.277821 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d6f45028-6191-4fcf-9a12-714ffb83b7af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88ae2abddf53489fa6660ecc0b8c9101', 'request_id': 'req-d6f45028-6191-4fcf-9a12-714ffb83b7af'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:37.288869 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d6f45028-6191-4fcf-9a12-714ffb83b7af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88ae2abddf53489fa6660ecc0b8c9101', 'request_id': 'req-d6f45028-6191-4fcf-9a12-714ffb83b7af'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:37.300859 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d6f45028-6191-4fcf-9a12-714ffb83b7af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88ae2abddf53489fa6660ecc0b8c9101', 'request_id': 'req-d6f45028-6191-4fcf-9a12-714ffb83b7af'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:37.325945 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d6f45028-6191-4fcf-9a12-714ffb83b7af admin admin] The token cache is being invalidate because project 88ae2abddf53489fa6660ecc0b8c9101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:40:37.326350 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d6f45028-6191-4fcf-9a12-714ffb83b7af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:37.327112 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d6f45028-6191-4fcf-9a12-714ffb83b7af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:37.329223 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 917/1821] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:40:37 2022] DELETE /identity/v3/projects/88ae2abddf53489fa6660ecc0b8c9101 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:37.341686 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73f4aa-88b6-4d94-94ff-457286a33f70 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:37.343129 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73f4aa-88b6-4d94-94ff-457286a33f70 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:37.344829 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73f4aa-88b6-4d94-94ff-457286a33f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:37.354242 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a4194-23eb-4f6e-af94-545ef8f06cdf admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:37.372956 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-8d73f4aa-88b6-4d94-94ff-457286a33f70 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:37.375022 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8d73f4aa-88b6-4d94-94ff-457286a33f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:37.433302 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b211775-ca76-4f4e-8a09-16531f87e2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:37.434033 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b211775-ca76-4f4e-8a09-16531f87e2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:37.434266 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b211775-ca76-4f4e-8a09-16531f87e2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:37.434841 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b211775-ca76-4f4e-8a09-16531f87e2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:37.435332 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b211775-ca76-4f4e-8a09-16531f87e2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:37.437030 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b211775-ca76-4f4e-8a09-16531f87e2e4 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:37.451609 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 905/1822] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:37.455416 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b211775-ca76-4f4e-8a09-16531f87e2e4 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:37.457518 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-9b211775-ca76-4f4e-8a09-16531f87e2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:37.478902 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b211775-ca76-4f4e-8a09-16531f87e2e4 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:37.484987 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 918/1823] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:37.496730 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bde91e-0895-4cac-aec4-54b75982cfd3 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:37.497153 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bde91e-0895-4cac-aec4-54b75982cfd3 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:37.497383 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bde91e-0895-4cac-aec4-54b75982cfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:37.498827 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035f967-30cc-4db4-82ca-26f4fb6f07f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:37.502231 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035f967-30cc-4db4-82ca-26f4fb6f07f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:37.502514 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035f967-30cc-4db4-82ca-26f4fb6f07f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:37.505587 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035f967-30cc-4db4-82ca-26f4fb6f07f8 admin admin] PATH_INFO: `/v3/projects/05309a1376b64d6283b83645d593f1d3/users/0cbf2de18b3f40fab6a499f90796e5a0/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:37.508347 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035f967-30cc-4db4-82ca-26f4fb6f07f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05309a1376b64d6283b83645d593f1d3, user_id=0cbf2de18b3f40fab6a499f90796e5a0, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:37.511502 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035f967-30cc-4db4-82ca-26f4fb6f07f8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:37.528208 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 906/1824] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:37 2022] PUT /identity/v3/projects/05309a1376b64d6283b83645d593f1d3/users/0cbf2de18b3f40fab6a499f90796e5a0/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:37.560199 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a7bde91e-0895-4cac-aec4-54b75982cfd3 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:37.561623 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39010ecb-571f-489a-b848-f456d11bf9b7 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:37.561753 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a7bde91e-0895-4cac-aec4-54b75982cfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:37.562375 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39010ecb-571f-489a-b848-f456d11bf9b7 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:37.562879 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39010ecb-571f-489a-b848-f456d11bf9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:37.620093 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-39010ecb-571f-489a-b848-f456d11bf9b7 None None] MFA Rules not processed for user `0cbf2de18b3f40fab6a499f90796e5a0`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:37.621605 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-39010ecb-571f-489a-b848-f456d11bf9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:37.668072 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 919/1825] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:40:37.672541 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bde91e-0895-4cac-aec4-54b75982cfd3 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:37.677732 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a7bde91e-0895-4cac-aec4-54b75982cfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:37.695336 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bde91e-0895-4cac-aec4-54b75982cfd3 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:37.701961 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e29c3-68f2-4df6-9530-11a6a44c4bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:37.703000 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e29c3-68f2-4df6-9530-11a6a44c4bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:37.703284 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e29c3-68f2-4df6-9530-11a6a44c4bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:37.703559 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e29c3-68f2-4df6-9530-11a6a44c4bce admin admin] PATH_INFO: `/v3/projects/0874ae0306a942c49f3d7a1910a3f8c8` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:37.705096 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e29c3-68f2-4df6-9530-11a6a44c4bce admin admin] RBAC: Authorizing `identity:delete_project(project_id=0874ae0306a942c49f3d7a1910a3f8c8)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:37.707528 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e29c3-68f2-4df6-9530-11a6a44c4bce admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:37.765052 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 907/1826] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:40:37.765986 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39010ecb-571f-489a-b848-f456d11bf9b7 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:37.770893 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-39010ecb-571f-489a-b848-f456d11bf9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:37.785520 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39010ecb-571f-489a-b848-f456d11bf9b7 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:37.786971 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d53e29c3-68f2-4df6-9530-11a6a44c4bce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0874ae0306a942c49f3d7a1910a3f8c8', 'request_id': 'req-d53e29c3-68f2-4df6-9530-11a6a44c4bce'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:37.794243 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d53e29c3-68f2-4df6-9530-11a6a44c4bce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0874ae0306a942c49f3d7a1910a3f8c8', 'request_id': 'req-d53e29c3-68f2-4df6-9530-11a6a44c4bce'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:37.807022 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d53e29c3-68f2-4df6-9530-11a6a44c4bce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0874ae0306a942c49f3d7a1910a3f8c8', 'request_id': 'req-d53e29c3-68f2-4df6-9530-11a6a44c4bce'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:37.824632 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d53e29c3-68f2-4df6-9530-11a6a44c4bce admin admin] The token cache is being invalidate because project 0874ae0306a942c49f3d7a1910a3f8c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:40:37.825030 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d53e29c3-68f2-4df6-9530-11a6a44c4bce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:37.825726 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d53e29c3-68f2-4df6-9530-11a6a44c4bce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:37.827287 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 920/1827] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:40:37 2022] DELETE /identity/v3/projects/0874ae0306a942c49f3d7a1910a3f8c8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:37.828200 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e29c3-68f2-4df6-9530-11a6a44c4bce admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:37.832093 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d53e29c3-68f2-4df6-9530-11a6a44c4bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:37.854925 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975d002-02f0-486d-a33a-e11f9512a09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:37.855528 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975d002-02f0-486d-a33a-e11f9512a09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:37.855806 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975d002-02f0-486d-a33a-e11f9512a09e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:37.856072 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975d002-02f0-486d-a33a-e11f9512a09e admin admin] PATH_INFO: `/v3/projects/5f0c62b4b20e458587c134ff4768c12a` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:37.857376 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975d002-02f0-486d-a33a-e11f9512a09e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f0c62b4b20e458587c134ff4768c12a)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:37.859298 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975d002-02f0-486d-a33a-e11f9512a09e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:37.894872 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e29c3-68f2-4df6-9530-11a6a44c4bce admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:37.904708 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3975d002-02f0-486d-a33a-e11f9512a09e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f0c62b4b20e458587c134ff4768c12a', 'request_id': 'req-3975d002-02f0-486d-a33a-e11f9512a09e'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:37.912548 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3975d002-02f0-486d-a33a-e11f9512a09e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f0c62b4b20e458587c134ff4768c12a', 'request_id': 'req-3975d002-02f0-486d-a33a-e11f9512a09e'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:37.918731 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3975d002-02f0-486d-a33a-e11f9512a09e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f0c62b4b20e458587c134ff4768c12a', 'request_id': 'req-3975d002-02f0-486d-a33a-e11f9512a09e'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:37.929139 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3975d002-02f0-486d-a33a-e11f9512a09e admin admin] The token cache is being invalidate because project 5f0c62b4b20e458587c134ff4768c12a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:40:37.929427 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3975d002-02f0-486d-a33a-e11f9512a09e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:37.930067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3975d002-02f0-486d-a33a-e11f9512a09e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:37.931794 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 908/1828] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:40:37 2022] DELETE /identity/v3/projects/5f0c62b4b20e458587c134ff4768c12a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:37.932490 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975d002-02f0-486d-a33a-e11f9512a09e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:37.933902 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-3975d002-02f0-486d-a33a-e11f9512a09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:37.949372 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bc4c5-4ba1-4939-81a6-56f8c9ddc235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:37.950038 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bc4c5-4ba1-4939-81a6-56f8c9ddc235 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:37.950321 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bc4c5-4ba1-4939-81a6-56f8c9ddc235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:37.950648 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bc4c5-4ba1-4939-81a6-56f8c9ddc235 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:37.951393 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bc4c5-4ba1-4939-81a6-56f8c9ddc235 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:40:37.951699 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bc4c5-4ba1-4939-81a6-56f8c9ddc235 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:37.953330 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bc4c5-4ba1-4939-81a6-56f8c9ddc235 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:37.964368 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 921/1829] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:40:37.965621 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8096f-5a22-4950-83e0-25650f9ac204 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:37.965907 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8096f-5a22-4950-83e0-25650f9ac204 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:37.966185 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8096f-5a22-4950-83e0-25650f9ac204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:37.984211 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-f4b8096f-5a22-4950-83e0-25650f9ac204 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:37.985428 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f4b8096f-5a22-4950-83e0-25650f9ac204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:37.988761 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975d002-02f0-486d-a33a-e11f9512a09e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:37.992347 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbfc0d-cb86-400d-9879-224950c94eda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:37.992987 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbfc0d-cb86-400d-9879-224950c94eda service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:37.993300 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbfc0d-cb86-400d-9879-224950c94eda service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:37.993576 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbfc0d-cb86-400d-9879-224950c94eda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:37.995422 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-e1bbfc0d-cb86-400d-9879-224950c94eda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:37.997161 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 922/1830] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:37.998590 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690581b-1645-4050-ada7-f616caf3ae16 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:37.999027 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690581b-1645-4050-ada7-f616caf3ae16 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:37.999312 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690581b-1645-4050-ada7-f616caf3ae16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:38.016882 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-1690581b-1645-4050-ada7-f616caf3ae16 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:38.018620 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1690581b-1645-4050-ada7-f616caf3ae16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:38.027071 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 923/1831] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:38.027845 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690581b-1645-4050-ada7-f616caf3ae16 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:38.029254 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1690581b-1645-4050-ada7-f616caf3ae16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:38.041569 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690581b-1645-4050-ada7-f616caf3ae16 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:38.047070 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf0c791-b5b1-4c58-9040-7347aea11eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:38.047737 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c791-b5b1-4c58-9040-7347aea11eea admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:38.048014 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c791-b5b1-4c58-9040-7347aea11eea admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:38.048269 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf0c791-b5b1-4c58-9040-7347aea11eea admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:38.049032 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0c791-b5b1-4c58-9040-7347aea11eea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:38.051490 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf0c791-b5b1-4c58-9040-7347aea11eea admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:38.062056 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbfc0d-cb86-400d-9879-224950c94eda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:38.063486 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbfc0d-cb86-400d-9879-224950c94eda service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:38.073382 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 909/1832] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:38.074652 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750b196-0738-485b-b5bb-36efc0340c39 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:38.074939 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750b196-0738-485b-b5bb-36efc0340c39 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:38.075216 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750b196-0738-485b-b5bb-36efc0340c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:38.081315 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 924/1833] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:40:38 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:38.083192 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a33471-561e-431b-9621-e0733ad2a2a9 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:38.084224 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a33471-561e-431b-9621-e0733ad2a2a9 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:38.084224 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a33471-561e-431b-9621-e0733ad2a2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:38.093455 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-b750b196-0738-485b-b5bb-36efc0340c39 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:38.094698 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-b750b196-0738-485b-b5bb-36efc0340c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:38.105046 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-c3a33471-561e-431b-9621-e0733ad2a2a9 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:38.106261 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c3a33471-561e-431b-9621-e0733ad2a2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:38.163610 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 910/1834] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:38.164649 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750b196-0738-485b-b5bb-36efc0340c39 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:38.177532 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750b196-0738-485b-b5bb-36efc0340c39 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:38.182075 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 925/1835] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:38.183459 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a33471-561e-431b-9621-e0733ad2a2a9 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:38.186180 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d9771-f9f1-45be-8cd6-3780d4df9d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:38.187032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d9771-f9f1-45be-8cd6-3780d4df9d7c admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:38.187323 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d9771-f9f1-45be-8cd6-3780d4df9d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:38.187622 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d9771-f9f1-45be-8cd6-3780d4df9d7c admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:38.188529 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d9771-f9f1-45be-8cd6-3780d4df9d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:38.190890 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d9771-f9f1-45be-8cd6-3780d4df9d7c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:38.195207 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a33471-561e-431b-9621-e0733ad2a2a9 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:38.201172 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4314280-5e47-4edc-a46c-f79c7d9964f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:38.201769 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4314280-5e47-4edc-a46c-f79c7d9964f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:38.202130 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4314280-5e47-4edc-a46c-f79c7d9964f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:38.202411 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4314280-5e47-4edc-a46c-f79c7d9964f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:38.203241 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4314280-5e47-4edc-a46c-f79c7d9964f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:40:38.203559 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4314280-5e47-4edc-a46c-f79c7d9964f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:38.205664 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4314280-5e47-4edc-a46c-f79c7d9964f9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:38.218333 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 911/1836] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:40:38 2022] POST /identity/v3/users => generated 295 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:38.219271 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d9771-f9f1-45be-8cd6-3780d4df9d7c admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:38.225207 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 926/1837] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:40:38.226080 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4314280-5e47-4edc-a46c-f79c7d9964f9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:38.234080 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d9771-f9f1-45be-8cd6-3780d4df9d7c admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:38.238742 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4314280-5e47-4edc-a46c-f79c7d9964f9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:38.244053 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfa78a-6a8d-4238-b424-b386421efb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:38.244747 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfa78a-6a8d-4238-b424-b386421efb68 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:38.245054 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfa78a-6a8d-4238-b424-b386421efb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:38.245407 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfa78a-6a8d-4238-b424-b386421efb68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:38.246082 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfa78a-6a8d-4238-b424-b386421efb68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:38.246185 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb6d7e-7607-455c-9203-ecbc4f19edbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:38.246945 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb6d7e-7607-455c-9203-ecbc4f19edbf admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:38.247723 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcfa78a-6a8d-4238-b424-b386421efb68 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:38.248372 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb6d7e-7607-455c-9203-ecbc4f19edbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:38.248616 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb6d7e-7607-455c-9203-ecbc4f19edbf admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:38.249417 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb6d7e-7607-455c-9203-ecbc4f19edbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:40:38.249726 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb6d7e-7607-455c-9203-ecbc4f19edbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:38.251429 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbb6d7e-7607-455c-9203-ecbc4f19edbf admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:38.261685 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 927/1838] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:38.262703 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfa78a-6a8d-4238-b424-b386421efb68 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:38.272728 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 912/1839] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:40:38.272728 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb6d7e-7607-455c-9203-ecbc4f19edbf admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:38.277834 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfa78a-6a8d-4238-b424-b386421efb68 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:38.280502 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb6d7e-7607-455c-9203-ecbc4f19edbf admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:38.283484 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1c70b-aee9-4286-8fd7-2fe42f9ac9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:38.284272 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1c70b-aee9-4286-8fd7-2fe42f9ac9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:38.284624 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1c70b-aee9-4286-8fd7-2fe42f9ac9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:38.285567 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1c70b-aee9-4286-8fd7-2fe42f9ac9e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:38.286011 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0981bd-7a71-49fe-b349-2cc3ddd05a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:38.286435 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1c70b-aee9-4286-8fd7-2fe42f9ac9e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:38.286806 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0981bd-7a71-49fe-b349-2cc3ddd05a0f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:38.287154 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0981bd-7a71-49fe-b349-2cc3ddd05a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:38.287493 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0981bd-7a71-49fe-b349-2cc3ddd05a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:38.288298 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0981bd-7a71-49fe-b349-2cc3ddd05a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:38.288676 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1c70b-aee9-4286-8fd7-2fe42f9ac9e6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:38.290021 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0981bd-7a71-49fe-b349-2cc3ddd05a0f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:38.300588 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 913/1840] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:38.304496 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0981bd-7a71-49fe-b349-2cc3ddd05a0f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:38.315487 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0981bd-7a71-49fe-b349-2cc3ddd05a0f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:38.319433 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 928/1841] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:40:38 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:38.319433 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1c70b-aee9-4286-8fd7-2fe42f9ac9e6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:38.379397 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1c70b-aee9-4286-8fd7-2fe42f9ac9e6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:38.382369 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67716fe3-cfe2-458f-be0f-c6dddcfb523a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:38.383343 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67716fe3-cfe2-458f-be0f-c6dddcfb523a admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:38.383631 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67716fe3-cfe2-458f-be0f-c6dddcfb523a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:38.383914 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67716fe3-cfe2-458f-be0f-c6dddcfb523a admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:38.384079 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9792f2e-e597-4154-bd5a-eae1efce15b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:38.384621 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67716fe3-cfe2-458f-be0f-c6dddcfb523a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:38.384962 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9792f2e-e597-4154-bd5a-eae1efce15b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:38.385269 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9792f2e-e597-4154-bd5a-eae1efce15b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:38.385570 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9792f2e-e597-4154-bd5a-eae1efce15b4 admin admin] PATH_INFO: `/v3/projects/7fd147277bb0465a84c08988c3eae7e6/users/cdb86c70c42a4030a155a7daa45ac92a/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:38.386573 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67716fe3-cfe2-458f-be0f-c6dddcfb523a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:38.400572 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9792f2e-e597-4154-bd5a-eae1efce15b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd147277bb0465a84c08988c3eae7e6, user_id=cdb86c70c42a4030a155a7daa45ac92a, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:38.403588 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9792f2e-e597-4154-bd5a-eae1efce15b4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:38.412556 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 914/1842] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:40:38 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:38.413693 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67716fe3-cfe2-458f-be0f-c6dddcfb523a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:38.421358 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 929/1843] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:38 2022] PUT /identity/v3/projects/7fd147277bb0465a84c08988c3eae7e6/users/cdb86c70c42a4030a155a7daa45ac92a/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:38.422384 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9792f2e-e597-4154-bd5a-eae1efce15b4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:38.482297 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67716fe3-cfe2-458f-be0f-c6dddcfb523a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:38.497332 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9792f2e-e597-4154-bd5a-eae1efce15b4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:38.502253 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c35a72-c986-4e18-90ad-467f9092f666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:38.502934 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c35a72-c986-4e18-90ad-467f9092f666 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:38.503219 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c35a72-c986-4e18-90ad-467f9092f666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:38.503529 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c35a72-c986-4e18-90ad-467f9092f666 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:38.504827 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c35a72-c986-4e18-90ad-467f9092f666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:38.506795 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c35a72-c986-4e18-90ad-467f9092f666 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:38.534351 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 930/1844] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:40:38 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:38.536445 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417ae7a-44e6-4c39-aef9-f49b6b050d64 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:38.536735 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417ae7a-44e6-4c39-aef9-f49b6b050d64 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:38.537032 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417ae7a-44e6-4c39-aef9-f49b6b050d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:38.559381 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaeea55-2d05-4bce-870a-22a470f173e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:38.560678 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaeea55-2d05-4bce-870a-22a470f173e9 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:38.561160 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaeea55-2d05-4bce-870a-22a470f173e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:38.561625 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaeea55-2d05-4bce-870a-22a470f173e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:38.562583 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaeea55-2d05-4bce-870a-22a470f173e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:38.564844 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaeea55-2d05-4bce-870a-22a470f173e9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:38.566450 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a417ae7a-44e6-4c39-aef9-f49b6b050d64 None None] MFA Rules not processed for user `cdb86c70c42a4030a155a7daa45ac92a`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:38.567894 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a417ae7a-44e6-4c39-aef9-f49b6b050d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:38.648231 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 915/1845] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:40:38 2022] POST /identity/v3/users => generated 290 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:38.649443 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaeea55-2d05-4bce-870a-22a470f173e9 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:38.661871 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 931/1846] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:38.662664 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417ae7a-44e6-4c39-aef9-f49b6b050d64 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:38.673631 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417ae7a-44e6-4c39-aef9-f49b6b050d64 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:38.679994 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c68b2b-b5f1-4bfa-bb30-842802c0fd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:38.680919 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c68b2b-b5f1-4bfa-bb30-842802c0fd24 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:38.681744 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c68b2b-b5f1-4bfa-bb30-842802c0fd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:38.682091 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c68b2b-b5f1-4bfa-bb30-842802c0fd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:38.683014 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c68b2b-b5f1-4bfa-bb30-842802c0fd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:38.684903 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c68b2b-b5f1-4bfa-bb30-842802c0fd24 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:38.696075 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 932/1847] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:38.696954 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c68b2b-b5f1-4bfa-bb30-842802c0fd24 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:38.699717 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaeea55-2d05-4bce-870a-22a470f173e9 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:38.705530 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65dd7d-3f67-411d-9f66-0f9f5b362d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:38.706887 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65dd7d-3f67-411d-9f66-0f9f5b362d16 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:38.707315 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65dd7d-3f67-411d-9f66-0f9f5b362d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:38.707782 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65dd7d-3f67-411d-9f66-0f9f5b362d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:38.708295 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c68b2b-b5f1-4bfa-bb30-842802c0fd24 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:38.709387 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65dd7d-3f67-411d-9f66-0f9f5b362d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:38.711172 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65dd7d-3f67-411d-9f66-0f9f5b362d16 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:38.714415 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b362e-b64d-4871-9670-6223b62119e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:38.715087 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b362e-b64d-4871-9670-6223b62119e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:38.715887 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b362e-b64d-4871-9670-6223b62119e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:38.716168 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b362e-b64d-4871-9670-6223b62119e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:38.716886 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b362e-b64d-4871-9670-6223b62119e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:38.718840 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b362e-b64d-4871-9670-6223b62119e8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:38.729180 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 916/1848] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:38.730483 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65dd7d-3f67-411d-9f66-0f9f5b362d16 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:38.742966 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65dd7d-3f67-411d-9f66-0f9f5b362d16 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:38.748764 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c3697-d984-45f7-b4d4-e51a19409aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:38.749523 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c3697-d984-45f7-b4d4-e51a19409aeb admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:38.749959 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c3697-d984-45f7-b4d4-e51a19409aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:38.750314 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 933/1849] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:40:38 2022] POST /identity/v3/projects => generated 391 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:38.751153 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b362e-b64d-4871-9670-6223b62119e8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:38.754094 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c3697-d984-45f7-b4d4-e51a19409aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:38.755412 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c3697-d984-45f7-b4d4-e51a19409aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:38.757041 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c3697-d984-45f7-b4d4-e51a19409aeb admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:38.771498 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 917/1850] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:38.771498 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c3697-d984-45f7-b4d4-e51a19409aeb admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:38.782444 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c3697-d984-45f7-b4d4-e51a19409aeb admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:38.857051 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b362e-b64d-4871-9670-6223b62119e8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:38.862334 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d8e49-b0fe-401d-a625-474d73b7f717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:38.863684 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d8e49-b0fe-401d-a625-474d73b7f717 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:38.864014 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d8e49-b0fe-401d-a625-474d73b7f717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:38.864238 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d8e49-b0fe-401d-a625-474d73b7f717 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:38.864984 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d8e49-b0fe-401d-a625-474d73b7f717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:38.865504 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d69b3-891e-4cbf-8ddb-f475f957b54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:38.866394 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d69b3-891e-4cbf-8ddb-f475f957b54f admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:38.866938 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d8e49-b0fe-401d-a625-474d73b7f717 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:38.867093 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d69b3-891e-4cbf-8ddb-f475f957b54f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:38.867493 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d69b3-891e-4cbf-8ddb-f475f957b54f admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:38.868274 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d69b3-891e-4cbf-8ddb-f475f957b54f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:38.871333 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d69b3-891e-4cbf-8ddb-f475f957b54f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:38.878187 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 934/1851] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:38.879157 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d8e49-b0fe-401d-a625-474d73b7f717 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:38.889816 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d8e49-b0fe-401d-a625-474d73b7f717 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:38.897554 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01d9ce-a975-46f6-8c14-a15a792b7802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:38.898751 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01d9ce-a975-46f6-8c14-a15a792b7802 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:38.899502 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01d9ce-a975-46f6-8c14-a15a792b7802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:38.900220 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01d9ce-a975-46f6-8c14-a15a792b7802 admin admin] PATH_INFO: `/v3/projects/167c72dd46c24277abf808e48281f8e0/users/9099ffa379314992bffbf25a03b61c51/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:38.914606 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 918/1852] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:40:38 2022] POST /identity/v3/users => generated 302 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:38.918381 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d69b3-891e-4cbf-8ddb-f475f957b54f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:38.923171 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01d9ce-a975-46f6-8c14-a15a792b7802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=167c72dd46c24277abf808e48281f8e0, user_id=9099ffa379314992bffbf25a03b61c51, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:38.926323 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01d9ce-a975-46f6-8c14-a15a792b7802 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:38.931404 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d69b3-891e-4cbf-8ddb-f475f957b54f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:38.939111 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003b170-d00a-4806-8a9a-68f7788ba182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:38.940166 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003b170-d00a-4806-8a9a-68f7788ba182 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:38.940278 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003b170-d00a-4806-8a9a-68f7788ba182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:38.940536 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003b170-d00a-4806-8a9a-68f7788ba182 admin admin] PATH_INFO: `/v3/projects/98d2732d47d2485796a010db2db49b1d/users/9fc95ac1f21245a68a3a250138e92f7d/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:38.948927 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 935/1853] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:38 2022] PUT /identity/v3/projects/167c72dd46c24277abf808e48281f8e0/users/9099ffa379314992bffbf25a03b61c51/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:38.954765 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01d9ce-a975-46f6-8c14-a15a792b7802 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:38.964267 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003b170-d00a-4806-8a9a-68f7788ba182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d2732d47d2485796a010db2db49b1d, user_id=9fc95ac1f21245a68a3a250138e92f7d, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:38.966994 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8003b170-d00a-4806-8a9a-68f7788ba182 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:38.992395 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 919/1854] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:38 2022] PUT /identity/v3/projects/98d2732d47d2485796a010db2db49b1d/users/9fc95ac1f21245a68a3a250138e92f7d/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:38.992395 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec037ba-45a5-4b7d-a51e-f04740f8a54f None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:38.992395 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec037ba-45a5-4b7d-a51e-f04740f8a54f None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:38.992395 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec037ba-45a5-4b7d-a51e-f04740f8a54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:39.022152 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-2ec037ba-45a5-4b7d-a51e-f04740f8a54f None None] MFA Rules not processed for user `9099ffa379314992bffbf25a03b61c51`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:39.023563 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-2ec037ba-45a5-4b7d-a51e-f04740f8a54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:39.066945 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01d9ce-a975-46f6-8c14-a15a792b7802 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:39.101223 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 920/1855] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:39.102575 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035b214-936c-469d-bcfa-a610a1f37db0 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:39.102941 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035b214-936c-469d-bcfa-a610a1f37db0 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:39.103367 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035b214-936c-469d-bcfa-a610a1f37db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:39.128549 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cfc8a-2f26-46b0-9113-1dc22b205a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:39.129428 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cfc8a-2f26-46b0-9113-1dc22b205a2d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:39.129798 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cfc8a-2f26-46b0-9113-1dc22b205a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:39.130124 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7cfc8a-2f26-46b0-9113-1dc22b205a2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:39.130936 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7cfc8a-2f26-46b0-9113-1dc22b205a2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:39.131865 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-e035b214-936c-469d-bcfa-a610a1f37db0 None None] MFA Rules not processed for user `9fc95ac1f21245a68a3a250138e92f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:39.132734 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7cfc8a-2f26-46b0-9113-1dc22b205a2d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:39.133613 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-e035b214-936c-469d-bcfa-a610a1f37db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:39.145912 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 936/1856] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:39.147177 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cfc8a-2f26-46b0-9113-1dc22b205a2d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:39.157279 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7cfc8a-2f26-46b0-9113-1dc22b205a2d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:39.162809 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e35cf-0871-4ccd-8d8e-a9e1895a1819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:39.163160 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e35cf-0871-4ccd-8d8e-a9e1895a1819 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:39.163443 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e35cf-0871-4ccd-8d8e-a9e1895a1819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:39.163725 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e35cf-0871-4ccd-8d8e-a9e1895a1819 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:39.164419 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e35cf-0871-4ccd-8d8e-a9e1895a1819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:39.166347 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e35cf-0871-4ccd-8d8e-a9e1895a1819 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:39.199693 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 937/1857] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:40:39 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:39.201521 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc95a77-94f4-427a-a553-e151c3f9c69c None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:39.202077 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc95a77-94f4-427a-a553-e151c3f9c69c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:39.202562 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc95a77-94f4-427a-a553-e151c3f9c69c None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:39.205682 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 938/1858] 10.222.0.36 () {54 vars in 921 bytes} [Wed Feb 9 04:40:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:40:39.207185 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc95a77-94f4-427a-a553-e151c3f9c69c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:39.227366 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 921/1859] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:39.228192 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035b214-936c-469d-bcfa-a610a1f37db0 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:39.248712 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035b214-936c-469d-bcfa-a610a1f37db0 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:39.301936 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc95a77-94f4-427a-a553-e151c3f9c69c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:39.312425 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a53e2-d259-4c13-a21b-1eb866c760cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:39.313534 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a53e2-d259-4c13-a21b-1eb866c760cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:39.313892 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a53e2-d259-4c13-a21b-1eb866c760cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:39.314238 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a53e2-d259-4c13-a21b-1eb866c760cc admin admin] PATH_INFO: `/v3/projects/1c3eab7dc2c845d59cd7b81c0cedc94f/users/76384b08106b420183ae17be7cd2b91d/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:39.324055 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfaffb-58a9-4775-9c96-b1f80d7b5fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:39.324683 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfaffb-58a9-4775-9c96-b1f80d7b5fb3 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:39.324974 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfaffb-58a9-4775-9c96-b1f80d7b5fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:39.325280 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfaffb-58a9-4775-9c96-b1f80d7b5fb3 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:39.326007 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfaffb-58a9-4775-9c96-b1f80d7b5fb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:39.327977 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfaffb-58a9-4775-9c96-b1f80d7b5fb3 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:39.333163 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a53e2-d259-4c13-a21b-1eb866c760cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3eab7dc2c845d59cd7b81c0cedc94f, user_id=76384b08106b420183ae17be7cd2b91d, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:39.336667 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a53e2-d259-4c13-a21b-1eb866c760cc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:39.348368 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 922/1860] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:40:39 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:39.349798 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ef557-2ea1-4942-ade4-9385181af433 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:39.350089 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ef557-2ea1-4942-ade4-9385181af433 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:39.353083 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 939/1861] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:39 2022] PUT /identity/v3/projects/1c3eab7dc2c845d59cd7b81c0cedc94f/users/76384b08106b420183ae17be7cd2b91d/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:39.353214 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ef557-2ea1-4942-ade4-9385181af433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:39.353304 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a53e2-d259-4c13-a21b-1eb866c760cc admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:39.370814 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-e86ef557-2ea1-4942-ade4-9385181af433 None None] MFA Rules not processed for user `63fe98c10e974c019e05a2f68d012ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:39.372122 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-e86ef557-2ea1-4942-ade4-9385181af433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:39.414524 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a53e2-d259-4c13-a21b-1eb866c760cc admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:39.419211 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091316e-b133-4357-b4f6-a2100cbae86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:39.419870 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091316e-b133-4357-b4f6-a2100cbae86f admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:39.420153 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091316e-b133-4357-b4f6-a2100cbae86f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:39.420427 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091316e-b133-4357-b4f6-a2100cbae86f admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:39.421271 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091316e-b133-4357-b4f6-a2100cbae86f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:39.423187 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091316e-b133-4357-b4f6-a2100cbae86f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:39.438276 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 923/1862] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Feb 9 04:40:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:39.439388 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ef557-2ea1-4942-ade4-9385181af433 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:39.450291 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 940/1863] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:40:39 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:39.451435 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091316e-b133-4357-b4f6-a2100cbae86f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:39.453931 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ef557-2ea1-4942-ade4-9385181af433 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:39.508349 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1f5ed-4a62-4e10-9c9b-bca1f52bfb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:39.509628 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1f5ed-4a62-4e10-9c9b-bca1f52bfb3e admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:39.509989 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1f5ed-4a62-4e10-9c9b-bca1f52bfb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:39.510279 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee1f5ed-4a62-4e10-9c9b-bca1f52bfb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:39.511067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1f5ed-4a62-4e10-9c9b-bca1f52bfb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:39.511269 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091316e-b133-4357-b4f6-a2100cbae86f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:39.512704 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee1f5ed-4a62-4e10-9c9b-bca1f52bfb3e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:39.516216 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b155176-76f5-4acc-b90d-48d4060300a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:39.516882 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b155176-76f5-4acc-b90d-48d4060300a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:39.517194 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b155176-76f5-4acc-b90d-48d4060300a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:39.517473 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b155176-76f5-4acc-b90d-48d4060300a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:39.518222 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b155176-76f5-4acc-b90d-48d4060300a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:39.520392 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b155176-76f5-4acc-b90d-48d4060300a3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:39.527536 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 924/1864] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:39.527536 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1f5ed-4a62-4e10-9c9b-bca1f52bfb3e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:39.529268 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-3ee1f5ed-4a62-4e10-9c9b-bca1f52bfb3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:39.534374 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 941/1865] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:39.534374 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b155176-76f5-4acc-b90d-48d4060300a3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:39.542095 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b155176-76f5-4acc-b90d-48d4060300a3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:39.552135 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91bb38-61fe-4a91-8472-1ac1552ef87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:39.552852 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91bb38-61fe-4a91-8472-1ac1552ef87e admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:39.553183 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91bb38-61fe-4a91-8472-1ac1552ef87e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:39.553468 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91bb38-61fe-4a91-8472-1ac1552ef87e admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:39.554184 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91bb38-61fe-4a91-8472-1ac1552ef87e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:39.556185 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b91bb38-61fe-4a91-8472-1ac1552ef87e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:39.580290 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 942/1866] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:40:39 2022] POST /identity/v3/users => generated 296 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:39.581252 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91bb38-61fe-4a91-8472-1ac1552ef87e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:39.591940 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91bb38-61fe-4a91-8472-1ac1552ef87e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:39.596825 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0be4d2-7c63-4ece-8007-4a6da93b3171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:39.597566 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0be4d2-7c63-4ece-8007-4a6da93b3171 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:39.597854 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0be4d2-7c63-4ece-8007-4a6da93b3171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:39.598136 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0be4d2-7c63-4ece-8007-4a6da93b3171 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:39.598882 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0be4d2-7c63-4ece-8007-4a6da93b3171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:39.600501 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0be4d2-7c63-4ece-8007-4a6da93b3171 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:39.616581 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 943/1867] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:39.616581 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0be4d2-7c63-4ece-8007-4a6da93b3171 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:39.623816 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee1f5ed-4a62-4e10-9c9b-bca1f52bfb3e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:39.628126 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0be4d2-7c63-4ece-8007-4a6da93b3171 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:39.630502 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52d289-4b85-4ee3-a05a-324ea36f70fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:39.631157 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52d289-4b85-4ee3-a05a-324ea36f70fc service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:39.631549 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52d289-4b85-4ee3-a05a-324ea36f70fc service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:39.632532 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52d289-4b85-4ee3-a05a-324ea36f70fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:39.634777 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b936c70-082d-4cb8-bd3d-5e14420bc712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:39.635657 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b936c70-082d-4cb8-bd3d-5e14420bc712 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:39.635944 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b936c70-082d-4cb8-bd3d-5e14420bc712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:39.636226 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b936c70-082d-4cb8-bd3d-5e14420bc712 admin admin] PATH_INFO: `/v3/projects/1c3eab7dc2c845d59cd7b81c0cedc94f/users/76384b08106b420183ae17be7cd2b91d/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:39.638845 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b936c70-082d-4cb8-bd3d-5e14420bc712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3eab7dc2c845d59cd7b81c0cedc94f, user_id=76384b08106b420183ae17be7cd2b91d, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:39.641559 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52d289-4b85-4ee3-a05a-324ea36f70fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:39.642305 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b936c70-082d-4cb8-bd3d-5e14420bc712 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:39.643121 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf52d289-4b85-4ee3-a05a-324ea36f70fc service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:39.654208 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 944/1868] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:39 2022] PUT /identity/v3/projects/1c3eab7dc2c845d59cd7b81c0cedc94f/users/76384b08106b420183ae17be7cd2b91d/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:39.654746 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 925/1869] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:39.655178 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b936c70-082d-4cb8-bd3d-5e14420bc712 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:39.655560 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52d289-4b85-4ee3-a05a-324ea36f70fc service nova] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:39.668756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf52d289-4b85-4ee3-a05a-324ea36f70fc service nova] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:39.743139 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b936c70-082d-4cb8-bd3d-5e14420bc712 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:39.752357 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f28179-5541-4d83-ab8a-a5172cbeb931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:39.757110 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f28179-5541-4d83-ab8a-a5172cbeb931 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:39.757405 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f28179-5541-4d83-ab8a-a5172cbeb931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:39.757685 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f28179-5541-4d83-ab8a-a5172cbeb931 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:39.759151 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f28179-5541-4d83-ab8a-a5172cbeb931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:39.761732 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f28179-5541-4d83-ab8a-a5172cbeb931 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:39.766753 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2417c-c178-4b12-8291-a91584b7da6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:39.767885 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2417c-c178-4b12-8291-a91584b7da6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:39.768352 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2417c-c178-4b12-8291-a91584b7da6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:39.768795 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2417c-c178-4b12-8291-a91584b7da6c admin admin] PATH_INFO: `/v3/projects/cedcf2039f8f4618af9580076175ee53/users/3ad5a65f6a7545b4ab502775704a6cbd/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:39.782441 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 945/1870] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:39.783894 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16cbd6-c18e-4645-9fb7-e6614b4e9a89 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:39.784192 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16cbd6-c18e-4645-9fb7-e6614b4e9a89 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:39.784491 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16cbd6-c18e-4645-9fb7-e6614b4e9a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:39.786625 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2417c-c178-4b12-8291-a91584b7da6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cedcf2039f8f4618af9580076175ee53, user_id=3ad5a65f6a7545b4ab502775704a6cbd, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:39.789643 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2417c-c178-4b12-8291-a91584b7da6c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:39.815834 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 926/1871] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:39 2022] PUT /identity/v3/projects/cedcf2039f8f4618af9580076175ee53/users/3ad5a65f6a7545b4ab502775704a6cbd/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:39.818012 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2417c-c178-4b12-8291-a91584b7da6c admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:39.827943 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-6a16cbd6-c18e-4645-9fb7-e6614b4e9a89 None None] MFA Rules not processed for user `76384b08106b420183ae17be7cd2b91d`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:39.829366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6a16cbd6-c18e-4645-9fb7-e6614b4e9a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:39.906342 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 946/1872] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:39.908506 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2417c-c178-4b12-8291-a91584b7da6c admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:39.909946 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75de144-a92f-4f06-a613-90c0673c3b87 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:39.910826 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75de144-a92f-4f06-a613-90c0673c3b87 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:39.911504 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75de144-a92f-4f06-a613-90c0673c3b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:39.913920 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2b809-a76c-4481-b688-c2187e9f8b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:39.915342 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2b809-a76c-4481-b688-c2187e9f8b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:39.915626 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2b809-a76c-4481-b688-c2187e9f8b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:39.915958 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2b809-a76c-4481-b688-c2187e9f8b27 admin admin] PATH_INFO: `/v3/projects/0ad48dd3b18a4a60b67f270c1d7d3e5b/users/4c494ef798d74d12836e51e94e22887d/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:39.935789 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2b809-a76c-4481-b688-c2187e9f8b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ad48dd3b18a4a60b67f270c1d7d3e5b, user_id=4c494ef798d74d12836e51e94e22887d, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:39.941994 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2b809-a76c-4481-b688-c2187e9f8b27 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:39.948709 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d75de144-a92f-4f06-a613-90c0673c3b87 None None] MFA Rules not processed for user `3ad5a65f6a7545b4ab502775704a6cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:39.950357 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d75de144-a92f-4f06-a613-90c0673c3b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:39.961990 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 927/1873] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:39 2022] PUT /identity/v3/projects/0ad48dd3b18a4a60b67f270c1d7d3e5b/users/4c494ef798d74d12836e51e94e22887d/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:39.963392 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2b809-a76c-4481-b688-c2187e9f8b27 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:39.966178 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-b5b2b809-a76c-4481-b688-c2187e9f8b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:40.043356 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 947/1874] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:40.044449 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75de144-a92f-4f06-a613-90c0673c3b87 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:40.109415 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2b809-a76c-4481-b688-c2187e9f8b27 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:40.119776 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bac6bd-eea2-44e4-ad48-97f661455d88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:40.120464 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bac6bd-eea2-44e4-ad48-97f661455d88 service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:40.120751 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bac6bd-eea2-44e4-ad48-97f661455d88 service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:40.121190 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bac6bd-eea2-44e4-ad48-97f661455d88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:40.161382 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75de144-a92f-4f06-a613-90c0673c3b87 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:40.177441 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d7aaf-0a7c-425e-af3b-b09842d7829e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:40.178135 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d7aaf-0a7c-425e-af3b-b09842d7829e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:40.178596 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d7aaf-0a7c-425e-af3b-b09842d7829e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:40.178882 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5d7aaf-0a7c-425e-af3b-b09842d7829e admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:40.179778 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d7aaf-0a7c-425e-af3b-b09842d7829e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:40.181463 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5d7aaf-0a7c-425e-af3b-b09842d7829e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:40.205732 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 948/1875] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:40.206731 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d7aaf-0a7c-425e-af3b-b09842d7829e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:40.207871 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bac6bd-eea2-44e4-ad48-97f661455d88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:40.209898 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bac6bd-eea2-44e4-ad48-97f661455d88 service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:40.232432 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5d7aaf-0a7c-425e-af3b-b09842d7829e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:40.233449 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 928/1876] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:40.234464 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bac6bd-eea2-44e4-ad48-97f661455d88 service cinder] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:40.246987 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f22909-2434-4f7f-af15-e6fd4e964f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:40.247768 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f22909-2434-4f7f-af15-e6fd4e964f83 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:40.247992 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f22909-2434-4f7f-af15-e6fd4e964f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:40.248217 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f22909-2434-4f7f-af15-e6fd4e964f83 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:40.251842 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f22909-2434-4f7f-af15-e6fd4e964f83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:40.260474 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f22909-2434-4f7f-af15-e6fd4e964f83 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:40.262649 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bac6bd-eea2-44e4-ad48-97f661455d88 service cinder] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:40.276911 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d47da-38c8-491f-81b5-7e8007ee14e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:40.277917 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d47da-38c8-491f-81b5-7e8007ee14e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:40.278226 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d47da-38c8-491f-81b5-7e8007ee14e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:40.278472 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d47da-38c8-491f-81b5-7e8007ee14e4 admin admin] PATH_INFO: `/v3/projects/0ad48dd3b18a4a60b67f270c1d7d3e5b/users/4c494ef798d74d12836e51e94e22887d/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:40.283012 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d47da-38c8-491f-81b5-7e8007ee14e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ad48dd3b18a4a60b67f270c1d7d3e5b, user_id=4c494ef798d74d12836e51e94e22887d, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:40.286210 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d47da-38c8-491f-81b5-7e8007ee14e4 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:40.311422 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 929/1877] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:40 2022] PUT /identity/v3/projects/0ad48dd3b18a4a60b67f270c1d7d3e5b/users/4c494ef798d74d12836e51e94e22887d/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:40.322606 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 949/1878] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:40:40 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:40.327324 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d47da-38c8-491f-81b5-7e8007ee14e4 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:40.327806 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc909825-cb8c-4b3a-b331-23eb9f275ccc None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:40.328125 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc909825-cb8c-4b3a-b331-23eb9f275ccc None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:40.328402 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc909825-cb8c-4b3a-b331-23eb9f275ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:40.370146 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-cc909825-cb8c-4b3a-b331-23eb9f275ccc None None] MFA Rules not processed for user `4c494ef798d74d12836e51e94e22887d`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:40.372611 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-cc909825-cb8c-4b3a-b331-23eb9f275ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:40.411878 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d47da-38c8-491f-81b5-7e8007ee14e4 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:40.474923 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 950/1879] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:40.476597 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc909825-cb8c-4b3a-b331-23eb9f275ccc None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:40.497403 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec1e05-6129-4d0b-8260-ef881b73aac7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:40.498365 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec1e05-6129-4d0b-8260-ef881b73aac7 service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:40.499709 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec1e05-6129-4d0b-8260-ef881b73aac7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:40.499978 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec1e05-6129-4d0b-8260-ef881b73aac7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:40.580918 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc909825-cb8c-4b3a-b331-23eb9f275ccc None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:40.581941 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec1e05-6129-4d0b-8260-ef881b73aac7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:40.583566 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec1e05-6129-4d0b-8260-ef881b73aac7 service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:40.587480 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11302d9-6b7d-4abf-b197-ac04c4a26d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:40.588355 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11302d9-6b7d-4abf-b197-ac04c4a26d10 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:40.588715 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11302d9-6b7d-4abf-b197-ac04c4a26d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:40.589247 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11302d9-6b7d-4abf-b197-ac04c4a26d10 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:40.590438 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11302d9-6b7d-4abf-b197-ac04c4a26d10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:40.592576 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11302d9-6b7d-4abf-b197-ac04c4a26d10 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:40.593451 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 930/1880] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:40.594274 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec1e05-6129-4d0b-8260-ef881b73aac7 service cinder] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:40.602442 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec1e05-6129-4d0b-8260-ef881b73aac7 service cinder] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:40.606850 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698914a-64eb-4d2a-95f3-ba5736eb8bde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:40.607716 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698914a-64eb-4d2a-95f3-ba5736eb8bde service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:40.607990 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698914a-64eb-4d2a-95f3-ba5736eb8bde service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:40.608309 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698914a-64eb-4d2a-95f3-ba5736eb8bde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:40.614878 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 951/1881] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:40:40 2022] POST /identity/v3/users => generated 296 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:40.618609 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11302d9-6b7d-4abf-b197-ac04c4a26d10 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:40.621299 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698914a-64eb-4d2a-95f3-ba5736eb8bde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:40.622809 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698914a-64eb-4d2a-95f3-ba5736eb8bde service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:40.635444 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11302d9-6b7d-4abf-b197-ac04c4a26d10 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:40.636893 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 931/1882] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:40.640691 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee801774-2877-46b2-ad26-8474fcd1726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:40.641980 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee801774-2877-46b2-ad26-8474fcd1726b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:40.642264 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee801774-2877-46b2-ad26-8474fcd1726b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:40.642623 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee801774-2877-46b2-ad26-8474fcd1726b admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:40.643278 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee801774-2877-46b2-ad26-8474fcd1726b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:40.644965 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee801774-2877-46b2-ad26-8474fcd1726b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:40.656327 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 952/1883] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:40.660681 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698914a-64eb-4d2a-95f3-ba5736eb8bde service cinder] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:40.672156 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698914a-64eb-4d2a-95f3-ba5736eb8bde service cinder] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:40.677679 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686ac51-3dfc-4e08-8408-249e23c80a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:40.678571 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686ac51-3dfc-4e08-8408-249e23c80a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:40.679136 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686ac51-3dfc-4e08-8408-249e23c80a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:40.679136 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686ac51-3dfc-4e08-8408-249e23c80a03 admin admin] PATH_INFO: `/v3/projects/cf01ef00bca5447aa8af1fd18f01a21f/users/35d08b35f36b455aa20ad70c2cbe5a06/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:40.697163 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686ac51-3dfc-4e08-8408-249e23c80a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf01ef00bca5447aa8af1fd18f01a21f, user_id=35d08b35f36b455aa20ad70c2cbe5a06, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:40.700574 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686ac51-3dfc-4e08-8408-249e23c80a03 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:40.719060 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 932/1884] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:40 2022] PUT /identity/v3/projects/cf01ef00bca5447aa8af1fd18f01a21f/users/35d08b35f36b455aa20ad70c2cbe5a06/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:40.728063 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee801774-2877-46b2-ad26-8474fcd1726b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:40.734764 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee801774-2877-46b2-ad26-8474fcd1726b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:40.736376 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686ac51-3dfc-4e08-8408-249e23c80a03 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:40.817745 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca09b2-4f8c-4c35-b139-d4df39ead9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:40.818638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca09b2-4f8c-4c35-b139-d4df39ead9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:40.818997 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca09b2-4f8c-4c35-b139-d4df39ead9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:40.819103 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686ac51-3dfc-4e08-8408-249e23c80a03 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:40.819539 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca09b2-4f8c-4c35-b139-d4df39ead9b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:40.820743 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca09b2-4f8c-4c35-b139-d4df39ead9b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:40.822749 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca09b2-4f8c-4c35-b139-d4df39ead9b0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:40.824300 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381fa00-44eb-4564-8aa7-0b0a381ba637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:40.825476 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381fa00-44eb-4564-8aa7-0b0a381ba637 service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:40.825624 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381fa00-44eb-4564-8aa7-0b0a381ba637 service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:40.826027 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381fa00-44eb-4564-8aa7-0b0a381ba637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:40.838448 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 953/1885] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:40.842702 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca09b2-4f8c-4c35-b139-d4df39ead9b0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:40.857195 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca09b2-4f8c-4c35-b139-d4df39ead9b0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:40.864098 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a9b5b-5095-47aa-828c-6e89bbc6bd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:40.865394 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a9b5b-5095-47aa-828c-6e89bbc6bd69 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:40.866024 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a9b5b-5095-47aa-828c-6e89bbc6bd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:40.866731 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a9b5b-5095-47aa-828c-6e89bbc6bd69 admin admin] PATH_INFO: `/v3/projects/cf01ef00bca5447aa8af1fd18f01a21f/users/35d08b35f36b455aa20ad70c2cbe5a06/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:40.870858 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a9b5b-5095-47aa-828c-6e89bbc6bd69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf01ef00bca5447aa8af1fd18f01a21f, user_id=35d08b35f36b455aa20ad70c2cbe5a06, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:40.874194 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a9b5b-5095-47aa-828c-6e89bbc6bd69 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:40.891162 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 954/1886] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:40 2022] PUT /identity/v3/projects/cf01ef00bca5447aa8af1fd18f01a21f/users/35d08b35f36b455aa20ad70c2cbe5a06/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:40.905822 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037cf3e-2a88-4201-93cd-46a5a48c50e4 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:40.905822 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037cf3e-2a88-4201-93cd-46a5a48c50e4 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:40.905822 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037cf3e-2a88-4201-93cd-46a5a48c50e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:40.915804 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381fa00-44eb-4564-8aa7-0b0a381ba637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:40.917359 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381fa00-44eb-4564-8aa7-0b0a381ba637 service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:40.947391 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a037cf3e-2a88-4201-93cd-46a5a48c50e4 None None] MFA Rules not processed for user `35d08b35f36b455aa20ad70c2cbe5a06`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:40.950007 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a037cf3e-2a88-4201-93cd-46a5a48c50e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:40.950130 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 933/1887] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:41.065620 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 955/1888] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:41.078857 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381fa00-44eb-4564-8aa7-0b0a381ba637 service cinder] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:41.088983 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381fa00-44eb-4564-8aa7-0b0a381ba637 service cinder] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:41.142923 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb2fe9-ed8b-49c2-a7f5-b6179b6c2a9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:41.143573 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb2fe9-ed8b-49c2-a7f5-b6179b6c2a9b service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:41.144701 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb2fe9-ed8b-49c2-a7f5-b6179b6c2a9b service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:41.144988 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb2fe9-ed8b-49c2-a7f5-b6179b6c2a9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:41.155460 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb2fe9-ed8b-49c2-a7f5-b6179b6c2a9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:41.156884 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edb2fe9-ed8b-49c2-a7f5-b6179b6c2a9b service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:41.166306 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 934/1889] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:41.212489 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037cf3e-2a88-4201-93cd-46a5a48c50e4 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:41.223999 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037cf3e-2a88-4201-93cd-46a5a48c50e4 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:41.228572 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a192e75-fc1b-437d-bc1b-7f50a00d4bd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:41.229289 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a192e75-fc1b-437d-bc1b-7f50a00d4bd2 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:41.229585 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a192e75-fc1b-437d-bc1b-7f50a00d4bd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:41.229924 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a192e75-fc1b-437d-bc1b-7f50a00d4bd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:41.311293 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a192e75-fc1b-437d-bc1b-7f50a00d4bd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:41.313364 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a192e75-fc1b-437d-bc1b-7f50a00d4bd2 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:41.344038 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 956/1890] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:42.949762 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb2fe9-ed8b-49c2-a7f5-b6179b6c2a9b service cinder] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:42.958627 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb2fe9-ed8b-49c2-a7f5-b6179b6c2a9b service cinder] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:42.962355 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16744704-3824-420f-805d-c143edc88ea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:42.962996 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16744704-3824-420f-805d-c143edc88ea2 service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:42.963276 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16744704-3824-420f-805d-c143edc88ea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:42.963548 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16744704-3824-420f-805d-c143edc88ea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:42.965361 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-16744704-3824-420f-805d-c143edc88ea2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:43.029028 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16744704-3824-420f-805d-c143edc88ea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:43.030510 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16744704-3824-420f-805d-c143edc88ea2 service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:43.040298 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 935/1891] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:54.520441 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a192e75-fc1b-437d-bc1b-7f50a00d4bd2 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:54.594518 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a192e75-fc1b-437d-bc1b-7f50a00d4bd2 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:54.599839 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb7bad-bde7-4901-ae50-aa6d496c60ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:54.601085 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb7bad-bde7-4901-ae50-aa6d496c60ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:54.601440 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb7bad-bde7-4901-ae50-aa6d496c60ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:54.601807 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb7bad-bde7-4901-ae50-aa6d496c60ed admin admin] PATH_INFO: `/v3/users/cdb86c70c42a4030a155a7daa45ac92a` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:54.603400 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb7bad-bde7-4901-ae50-aa6d496c60ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdb86c70c42a4030a155a7daa45ac92a)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:54.605726 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb7bad-bde7-4901-ae50-aa6d496c60ed admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:54.664931 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-04eb7bad-bde7-4901-ae50-aa6d496c60ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdb86c70c42a4030a155a7daa45ac92a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:54.692505 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-04eb7bad-bde7-4901-ae50-aa6d496c60ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdb86c70c42a4030a155a7daa45ac92a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:54.692596 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-04eb7bad-bde7-4901-ae50-aa6d496c60ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdb86c70c42a4030a155a7daa45ac92a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:54.705283 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-04eb7bad-bde7-4901-ae50-aa6d496c60ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdb86c70c42a4030a155a7daa45ac92a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:54.715669 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-04eb7bad-bde7-4901-ae50-aa6d496c60ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdb86c70c42a4030a155a7daa45ac92a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:54.728160 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 957/1892] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:40:54 2022] DELETE /identity/v3/users/cdb86c70c42a4030a155a7daa45ac92a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:54.733571 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5bcf3-0739-4f98-aee5-2ffe02aa3e93 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:54.733989 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5bcf3-0739-4f98-aee5-2ffe02aa3e93 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:54.734073 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5bcf3-0739-4f98-aee5-2ffe02aa3e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:54.756721 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-54d5bcf3-0739-4f98-aee5-2ffe02aa3e93 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:54.758233 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-54d5bcf3-0739-4f98-aee5-2ffe02aa3e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:54.840622 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 936/1893] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:54.850438 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb7bad-bde7-4901-ae50-aa6d496c60ed admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:54.852204 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-04eb7bad-bde7-4901-ae50-aa6d496c60ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:54.918294 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb7bad-bde7-4901-ae50-aa6d496c60ed admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:54.922421 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35160a-f7f9-4c4f-87ea-362378e606ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:54.923207 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35160a-f7f9-4c4f-87ea-362378e606ff service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:54.923612 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35160a-f7f9-4c4f-87ea-362378e606ff service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:54.923967 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35160a-f7f9-4c4f-87ea-362378e606ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:54.938348 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35160a-f7f9-4c4f-87ea-362378e606ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:54.940423 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35160a-f7f9-4c4f-87ea-362378e606ff service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:54.957401 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 958/1894] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:55.246789 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5bcf3-0739-4f98-aee5-2ffe02aa3e93 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:55.248550 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-54d5bcf3-0739-4f98-aee5-2ffe02aa3e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:55.266719 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5bcf3-0739-4f98-aee5-2ffe02aa3e93 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:55.279390 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9916738-2dd1-4505-8108-5b55c8ab1bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:55.280222 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9916738-2dd1-4505-8108-5b55c8ab1bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:55.280500 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9916738-2dd1-4505-8108-5b55c8ab1bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:55.280770 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9916738-2dd1-4505-8108-5b55c8ab1bea admin admin] PATH_INFO: `/v3/projects/7fd147277bb0465a84c08988c3eae7e6` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:55.281998 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9916738-2dd1-4505-8108-5b55c8ab1bea admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fd147277bb0465a84c08988c3eae7e6)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:55.283908 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9916738-2dd1-4505-8108-5b55c8ab1bea admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:55.330157 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-c9916738-2dd1-4505-8108-5b55c8ab1bea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fd147277bb0465a84c08988c3eae7e6', 'request_id': 'req-c9916738-2dd1-4505-8108-5b55c8ab1bea'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:55.337736 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-c9916738-2dd1-4505-8108-5b55c8ab1bea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fd147277bb0465a84c08988c3eae7e6', 'request_id': 'req-c9916738-2dd1-4505-8108-5b55c8ab1bea'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:55.344152 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-c9916738-2dd1-4505-8108-5b55c8ab1bea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fd147277bb0465a84c08988c3eae7e6', 'request_id': 'req-c9916738-2dd1-4505-8108-5b55c8ab1bea'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:55.354184 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-c9916738-2dd1-4505-8108-5b55c8ab1bea admin admin] The token cache is being invalidate because project 7fd147277bb0465a84c08988c3eae7e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:40:55.354550 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-c9916738-2dd1-4505-8108-5b55c8ab1bea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:55.355202 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-c9916738-2dd1-4505-8108-5b55c8ab1bea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:55.356785 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 937/1895] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:40:55 2022] DELETE /identity/v3/projects/7fd147277bb0465a84c08988c3eae7e6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:55.360782 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35160a-f7f9-4c4f-87ea-362378e606ff service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:55.370178 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35160a-f7f9-4c4f-87ea-362378e606ff service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:55.425512 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab3d3f-2cf2-49c2-a4e1-794c9aec730c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:55.426374 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab3d3f-2cf2-49c2-a4e1-794c9aec730c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:55.426654 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab3d3f-2cf2-49c2-a4e1-794c9aec730c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:55.426926 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab3d3f-2cf2-49c2-a4e1-794c9aec730c admin admin] PATH_INFO: `/v3/users/76384b08106b420183ae17be7cd2b91d` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:55.428343 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab3d3f-2cf2-49c2-a4e1-794c9aec730c admin admin] RBAC: Authorizing `identity:delete_user(user_id=76384b08106b420183ae17be7cd2b91d)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:55.430316 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab3d3f-2cf2-49c2-a4e1-794c9aec730c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:55.472226 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-49ab3d3f-2cf2-49c2-a4e1-794c9aec730c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76384b08106b420183ae17be7cd2b91d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:55.478562 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-49ab3d3f-2cf2-49c2-a4e1-794c9aec730c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76384b08106b420183ae17be7cd2b91d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:55.479200 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-49ab3d3f-2cf2-49c2-a4e1-794c9aec730c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76384b08106b420183ae17be7cd2b91d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:55.490524 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-49ab3d3f-2cf2-49c2-a4e1-794c9aec730c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76384b08106b420183ae17be7cd2b91d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:55.497436 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-49ab3d3f-2cf2-49c2-a4e1-794c9aec730c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76384b08106b420183ae17be7cd2b91d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:55.503934 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 959/1896] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:40:55 2022] DELETE /identity/v3/users/76384b08106b420183ae17be7cd2b91d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:40:55.757805 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9916738-2dd1-4505-8108-5b55c8ab1bea admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:55.759250 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-c9916738-2dd1-4505-8108-5b55c8ab1bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:55.772485 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9916738-2dd1-4505-8108-5b55c8ab1bea admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:55.828801 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f7c12-a949-4ff6-8946-5251ff822975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:55.829720 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f7c12-a949-4ff6-8946-5251ff822975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:55.830036 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f7c12-a949-4ff6-8946-5251ff822975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:55.830313 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f7c12-a949-4ff6-8946-5251ff822975 admin admin] PATH_INFO: `/v3/projects/1c3eab7dc2c845d59cd7b81c0cedc94f` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:55.831550 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f7c12-a949-4ff6-8946-5251ff822975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c3eab7dc2c845d59cd7b81c0cedc94f)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:55.833506 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f7c12-a949-4ff6-8946-5251ff822975 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:55.895663 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6f8f7c12-a949-4ff6-8946-5251ff822975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c3eab7dc2c845d59cd7b81c0cedc94f', 'request_id': 'req-6f8f7c12-a949-4ff6-8946-5251ff822975'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:55.903211 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6f8f7c12-a949-4ff6-8946-5251ff822975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c3eab7dc2c845d59cd7b81c0cedc94f', 'request_id': 'req-6f8f7c12-a949-4ff6-8946-5251ff822975'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:55.909874 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6f8f7c12-a949-4ff6-8946-5251ff822975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c3eab7dc2c845d59cd7b81c0cedc94f', 'request_id': 'req-6f8f7c12-a949-4ff6-8946-5251ff822975'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:55.919656 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6f8f7c12-a949-4ff6-8946-5251ff822975 admin admin] The token cache is being invalidate because project 1c3eab7dc2c845d59cd7b81c0cedc94f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:40:55.919939 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6f8f7c12-a949-4ff6-8946-5251ff822975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:55.920552 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6f8f7c12-a949-4ff6-8946-5251ff822975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:55.922111 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 938/1897] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:40:55 2022] DELETE /identity/v3/projects/1c3eab7dc2c845d59cd7b81c0cedc94f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:55.928743 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde384c0-f656-4ffd-af06-4a32935adfea None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:55.929229 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde384c0-f656-4ffd-af06-4a32935adfea None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:55.929341 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde384c0-f656-4ffd-af06-4a32935adfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:55.947977 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-bde384c0-f656-4ffd-af06-4a32935adfea None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:55.949204 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-bde384c0-f656-4ffd-af06-4a32935adfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:56.006659 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 960/1898] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:56.014384 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f91ba-2833-4cd6-bef0-c1b989fd8751 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:56.014677 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f91ba-2833-4cd6-bef0-c1b989fd8751 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:56.014962 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f91ba-2833-4cd6-bef0-c1b989fd8751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:56.033550 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-000f91ba-2833-4cd6-bef0-c1b989fd8751 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:56.035178 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-000f91ba-2833-4cd6-bef0-c1b989fd8751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:56.043762 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 939/1899] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:56.048064 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde384c0-f656-4ffd-af06-4a32935adfea None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:56.058074 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde384c0-f656-4ffd-af06-4a32935adfea None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:56.062928 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f01531-bda4-4728-a2a4-13b5a7d94cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:56.063568 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f01531-bda4-4728-a2a4-13b5a7d94cee admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:56.063846 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f01531-bda4-4728-a2a4-13b5a7d94cee admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:56.064117 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f01531-bda4-4728-a2a4-13b5a7d94cee admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:56.064851 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f01531-bda4-4728-a2a4-13b5a7d94cee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:40:56.065183 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f01531-bda4-4728-a2a4-13b5a7d94cee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:56.066808 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f01531-bda4-4728-a2a4-13b5a7d94cee admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:56.077736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 961/1900] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:40:56.081800 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f91ba-2833-4cd6-bef0-c1b989fd8751 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:56.090695 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f91ba-2833-4cd6-bef0-c1b989fd8751 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:56.095337 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1471d23-103c-4372-ba4c-d99baa988c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:56.095972 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1471d23-103c-4372-ba4c-d99baa988c73 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:56.096253 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1471d23-103c-4372-ba4c-d99baa988c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:56.096525 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1471d23-103c-4372-ba4c-d99baa988c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:56.097790 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1471d23-103c-4372-ba4c-d99baa988c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:56.099660 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1471d23-103c-4372-ba4c-d99baa988c73 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:56.128631 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 940/1901] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:40:56 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:40:56.129853 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f01531-bda4-4728-a2a4-13b5a7d94cee admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:56.139626 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f01531-bda4-4728-a2a4-13b5a7d94cee admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:56.193526 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429129d4-1b33-4666-8655-f36ee6401c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:56.194193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429129d4-1b33-4666-8655-f36ee6401c6c admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:56.194478 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429129d4-1b33-4666-8655-f36ee6401c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:56.194759 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429129d4-1b33-4666-8655-f36ee6401c6c admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:56.195467 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429129d4-1b33-4666-8655-f36ee6401c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:56.197485 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429129d4-1b33-4666-8655-f36ee6401c6c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:56.217076 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 962/1902] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:40:56 2022] POST /identity/v3/users => generated 291 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:56.221324 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1471d23-103c-4372-ba4c-d99baa988c73 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:56.231946 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1471d23-103c-4372-ba4c-d99baa988c73 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:56.237155 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1b705-9bdb-43e7-a00a-19febd2b3152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:56.237869 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1b705-9bdb-43e7-a00a-19febd2b3152 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:56.238153 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1b705-9bdb-43e7-a00a-19febd2b3152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:56.238455 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1b705-9bdb-43e7-a00a-19febd2b3152 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:56.239273 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1b705-9bdb-43e7-a00a-19febd2b3152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:56.241056 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1b705-9bdb-43e7-a00a-19febd2b3152 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:56.251460 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 941/1903] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:56.256171 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429129d4-1b33-4666-8655-f36ee6401c6c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:56.268190 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429129d4-1b33-4666-8655-f36ee6401c6c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:56.273608 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb5613-9dff-4924-9160-5e403af9f72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:56.274594 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb5613-9dff-4924-9160-5e403af9f72a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:56.274881 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb5613-9dff-4924-9160-5e403af9f72a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:56.275199 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb5613-9dff-4924-9160-5e403af9f72a admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:56.275985 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb5613-9dff-4924-9160-5e403af9f72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:56.277713 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb5613-9dff-4924-9160-5e403af9f72a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:56.289226 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 963/1904] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:56.293205 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1b705-9bdb-43e7-a00a-19febd2b3152 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:56.303198 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1b705-9bdb-43e7-a00a-19febd2b3152 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:56.307759 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3b74c-9e39-4245-a11a-9057d7aa8050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:56.309268 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3b74c-9e39-4245-a11a-9057d7aa8050 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:56.309553 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3b74c-9e39-4245-a11a-9057d7aa8050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:56.309831 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3b74c-9e39-4245-a11a-9057d7aa8050 admin admin] PATH_INFO: `/v3/projects/a125c68e881846b5810c045d00dad3c7/users/c93e01df367c41f8ba7f297ce6b5faf0/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:56.325030 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3b74c-9e39-4245-a11a-9057d7aa8050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a125c68e881846b5810c045d00dad3c7, user_id=c93e01df367c41f8ba7f297ce6b5faf0, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:56.328073 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3b74c-9e39-4245-a11a-9057d7aa8050 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:56.342117 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 942/1905] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:56 2022] PUT /identity/v3/projects/a125c68e881846b5810c045d00dad3c7/users/c93e01df367c41f8ba7f297ce6b5faf0/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:56.353869 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650d800-fef9-4ffe-a194-275fa6d73a79 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:56.354376 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650d800-fef9-4ffe-a194-275fa6d73a79 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:56.354655 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650d800-fef9-4ffe-a194-275fa6d73a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:56.380279 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-b650d800-fef9-4ffe-a194-275fa6d73a79 None None] MFA Rules not processed for user `c93e01df367c41f8ba7f297ce6b5faf0`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:56.381552 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b650d800-fef9-4ffe-a194-275fa6d73a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:56.446695 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 964/1906] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:40:56.451166 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3b74c-9e39-4245-a11a-9057d7aa8050 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:56.510279 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3b74c-9e39-4245-a11a-9057d7aa8050 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:56.514851 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98a966-c8ca-4223-9cd6-f0da18b04dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:56.515529 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98a966-c8ca-4223-9cd6-f0da18b04dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:56.515811 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98a966-c8ca-4223-9cd6-f0da18b04dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:56.516089 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98a966-c8ca-4223-9cd6-f0da18b04dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:56.516795 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98a966-c8ca-4223-9cd6-f0da18b04dd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:56.519287 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98a966-c8ca-4223-9cd6-f0da18b04dd6 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:56.544792 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 943/1907] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:40:56 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:56.548807 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650d800-fef9-4ffe-a194-275fa6d73a79 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:56.561306 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650d800-fef9-4ffe-a194-275fa6d73a79 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:56.613869 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99613bbe-de8b-481f-8e0b-f8cd37612084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:56.614540 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99613bbe-de8b-481f-8e0b-f8cd37612084 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:56.614826 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99613bbe-de8b-481f-8e0b-f8cd37612084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:56.615105 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99613bbe-de8b-481f-8e0b-f8cd37612084 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:56.615819 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99613bbe-de8b-481f-8e0b-f8cd37612084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:56.617775 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99613bbe-de8b-481f-8e0b-f8cd37612084 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:56.637918 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 965/1908] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:40:56 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:40:56.642212 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98a966-c8ca-4223-9cd6-f0da18b04dd6 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:56.654322 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98a966-c8ca-4223-9cd6-f0da18b04dd6 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:56.658863 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e0dd3-d554-47d3-8e00-765fb2d98409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:56.660082 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e0dd3-d554-47d3-8e00-765fb2d98409 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:56.660372 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e0dd3-d554-47d3-8e00-765fb2d98409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:56.660649 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e0dd3-d554-47d3-8e00-765fb2d98409 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:56.661446 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e0dd3-d554-47d3-8e00-765fb2d98409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:56.663036 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e0dd3-d554-47d3-8e00-765fb2d98409 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:56.673162 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 944/1909] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:56.677669 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99613bbe-de8b-481f-8e0b-f8cd37612084 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:56.687326 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99613bbe-de8b-481f-8e0b-f8cd37612084 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:56.691901 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2e88a-901f-4174-80f9-e49bb6593c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:56.692765 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2e88a-901f-4174-80f9-e49bb6593c68 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:56.693071 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2e88a-901f-4174-80f9-e49bb6593c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:56.693347 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2e88a-901f-4174-80f9-e49bb6593c68 admin admin] PATH_INFO: `/v3/projects/55fbc0028f484b3491e0c33ac588fbd3/users/00967a5f09824c51acc6049299715a3c/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:56.707200 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2e88a-901f-4174-80f9-e49bb6593c68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55fbc0028f484b3491e0c33ac588fbd3, user_id=00967a5f09824c51acc6049299715a3c, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:56.709877 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2e88a-901f-4174-80f9-e49bb6593c68 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:56.722647 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 966/1910] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:56 2022] PUT /identity/v3/projects/55fbc0028f484b3491e0c33ac588fbd3/users/00967a5f09824c51acc6049299715a3c/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:56.726512 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e0dd3-d554-47d3-8e00-765fb2d98409 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:56.736153 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e0dd3-d554-47d3-8e00-765fb2d98409 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:56.790296 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aaad8c-f105-46d9-a622-52073157f727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:56.790954 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaad8c-f105-46d9-a622-52073157f727 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:56.791238 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaad8c-f105-46d9-a622-52073157f727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:56.791517 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aaad8c-f105-46d9-a622-52073157f727 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:56.792249 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aaad8c-f105-46d9-a622-52073157f727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:56.793869 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aaad8c-f105-46d9-a622-52073157f727 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:56.803857 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 945/1911] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:40:56.808010 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2e88a-901f-4174-80f9-e49bb6593c68 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:56.817863 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2e88a-901f-4174-80f9-e49bb6593c68 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:56.822403 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf291d18-917a-4bcf-8ed5-0e93072ec9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:56.823270 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf291d18-917a-4bcf-8ed5-0e93072ec9a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:56.823544 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf291d18-917a-4bcf-8ed5-0e93072ec9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:56.823812 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf291d18-917a-4bcf-8ed5-0e93072ec9a4 admin admin] PATH_INFO: `/v3/projects/55fbc0028f484b3491e0c33ac588fbd3/users/00967a5f09824c51acc6049299715a3c/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:56.825807 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf291d18-917a-4bcf-8ed5-0e93072ec9a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55fbc0028f484b3491e0c33ac588fbd3, user_id=00967a5f09824c51acc6049299715a3c, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:56.828479 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf291d18-917a-4bcf-8ed5-0e93072ec9a4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:56.838947 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 967/1912] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:56 2022] PUT /identity/v3/projects/55fbc0028f484b3491e0c33ac588fbd3/users/00967a5f09824c51acc6049299715a3c/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:56.849636 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5bb45-cbfb-42c7-a94a-f55f9544590d None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:56.849895 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5bb45-cbfb-42c7-a94a-f55f9544590d None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:56.850169 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5bb45-cbfb-42c7-a94a-f55f9544590d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:56.876796 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-70f5bb45-cbfb-42c7-a94a-f55f9544590d None None] MFA Rules not processed for user `00967a5f09824c51acc6049299715a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:56.878385 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-70f5bb45-cbfb-42c7-a94a-f55f9544590d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:56.952228 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 946/1913] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:56.962107 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf291d18-917a-4bcf-8ed5-0e93072ec9a4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:56.963940 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-bf291d18-917a-4bcf-8ed5-0e93072ec9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:57.021335 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf291d18-917a-4bcf-8ed5-0e93072ec9a4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:57.025163 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5619548-373d-42d2-9788-aacd8f3fdd5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:57.025810 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5619548-373d-42d2-9788-aacd8f3fdd5e service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:57.026090 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5619548-373d-42d2-9788-aacd8f3fdd5e service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:57.026366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5619548-373d-42d2-9788-aacd8f3fdd5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:57.035901 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5619548-373d-42d2-9788-aacd8f3fdd5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:57.037359 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5619548-373d-42d2-9788-aacd8f3fdd5e service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:57.046607 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 968/1914] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:56 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:57.413885 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5bb45-cbfb-42c7-a94a-f55f9544590d None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:57.475757 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5bb45-cbfb-42c7-a94a-f55f9544590d None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:57.480334 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e65b55-3b0a-4637-b352-85d37fe73418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:57.481225 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e65b55-3b0a-4637-b352-85d37fe73418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:57.481512 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e65b55-3b0a-4637-b352-85d37fe73418 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:57.481792 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e65b55-3b0a-4637-b352-85d37fe73418 admin admin] PATH_INFO: `/v3/users/c93e01df367c41f8ba7f297ce6b5faf0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:57.482997 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e65b55-3b0a-4637-b352-85d37fe73418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c93e01df367c41f8ba7f297ce6b5faf0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:57.484927 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e65b55-3b0a-4637-b352-85d37fe73418 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:57.533381 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-61e65b55-3b0a-4637-b352-85d37fe73418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c93e01df367c41f8ba7f297ce6b5faf0'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:57.540468 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-61e65b55-3b0a-4637-b352-85d37fe73418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c93e01df367c41f8ba7f297ce6b5faf0'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:57.541297 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-61e65b55-3b0a-4637-b352-85d37fe73418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c93e01df367c41f8ba7f297ce6b5faf0'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:57.562030 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-61e65b55-3b0a-4637-b352-85d37fe73418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c93e01df367c41f8ba7f297ce6b5faf0'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:57.579268 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-61e65b55-3b0a-4637-b352-85d37fe73418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c93e01df367c41f8ba7f297ce6b5faf0'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:57.585576 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 947/1915] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:40:57 2022] DELETE /identity/v3/users/c93e01df367c41f8ba7f297ce6b5faf0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:57.590034 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e87f48-a738-4665-af25-dec4a53245c6 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:57.590322 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e87f48-a738-4665-af25-dec4a53245c6 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:57.590600 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e87f48-a738-4665-af25-dec4a53245c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:57.608800 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-15e87f48-a738-4665-af25-dec4a53245c6 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:57.610050 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-15e87f48-a738-4665-af25-dec4a53245c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:57.666836 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 969/1916] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:57.677275 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e65b55-3b0a-4637-b352-85d37fe73418 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:57.679010 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-61e65b55-3b0a-4637-b352-85d37fe73418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:57.735734 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e65b55-3b0a-4637-b352-85d37fe73418 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:57.739830 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9322b-e096-4316-8b3a-2c6dad608b5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:57.740461 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9322b-e096-4316-8b3a-2c6dad608b5b service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:57.740742 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9322b-e096-4316-8b3a-2c6dad608b5b service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:57.741026 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9322b-e096-4316-8b3a-2c6dad608b5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:57.749672 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9322b-e096-4316-8b3a-2c6dad608b5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:57.751090 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac9322b-e096-4316-8b3a-2c6dad608b5b service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:57.761161 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 948/1917] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:58.028773 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e87f48-a738-4665-af25-dec4a53245c6 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:58.030335 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-15e87f48-a738-4665-af25-dec4a53245c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:58.042833 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e87f48-a738-4665-af25-dec4a53245c6 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:58.047767 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39185d0-9618-4b15-9821-2d3f3709e9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:58.048711 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39185d0-9618-4b15-9821-2d3f3709e9d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:58.049087 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39185d0-9618-4b15-9821-2d3f3709e9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:58.049438 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39185d0-9618-4b15-9821-2d3f3709e9d9 admin admin] PATH_INFO: `/v3/projects/a125c68e881846b5810c045d00dad3c7` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:58.051319 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39185d0-9618-4b15-9821-2d3f3709e9d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a125c68e881846b5810c045d00dad3c7)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:58.053286 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39185d0-9618-4b15-9821-2d3f3709e9d9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:58.099227 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b39185d0-9618-4b15-9821-2d3f3709e9d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a125c68e881846b5810c045d00dad3c7', 'request_id': 'req-b39185d0-9618-4b15-9821-2d3f3709e9d9'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:58.105157 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b39185d0-9618-4b15-9821-2d3f3709e9d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a125c68e881846b5810c045d00dad3c7', 'request_id': 'req-b39185d0-9618-4b15-9821-2d3f3709e9d9'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:58.111908 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b39185d0-9618-4b15-9821-2d3f3709e9d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a125c68e881846b5810c045d00dad3c7', 'request_id': 'req-b39185d0-9618-4b15-9821-2d3f3709e9d9'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:58.122292 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b39185d0-9618-4b15-9821-2d3f3709e9d9 admin admin] The token cache is being invalidate because project a125c68e881846b5810c045d00dad3c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:40:58.122584 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b39185d0-9618-4b15-9821-2d3f3709e9d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:58.123229 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b39185d0-9618-4b15-9821-2d3f3709e9d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:58.124804 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 970/1918] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:40:58 2022] DELETE /identity/v3/projects/a125c68e881846b5810c045d00dad3c7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:58.128922 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9322b-e096-4316-8b3a-2c6dad608b5b service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:58.138362 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac9322b-e096-4316-8b3a-2c6dad608b5b service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:58.191858 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098af13-6cdf-4563-a33c-53d38caca7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:58.192735 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098af13-6cdf-4563-a33c-53d38caca7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:58.193025 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098af13-6cdf-4563-a33c-53d38caca7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:58.193300 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098af13-6cdf-4563-a33c-53d38caca7a8 admin admin] PATH_INFO: `/v3/users/00967a5f09824c51acc6049299715a3c` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:58.194484 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098af13-6cdf-4563-a33c-53d38caca7a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00967a5f09824c51acc6049299715a3c)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:58.196405 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098af13-6cdf-4563-a33c-53d38caca7a8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:58.244648 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-2098af13-6cdf-4563-a33c-53d38caca7a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00967a5f09824c51acc6049299715a3c'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:58.251252 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-2098af13-6cdf-4563-a33c-53d38caca7a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00967a5f09824c51acc6049299715a3c'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:58.251930 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-2098af13-6cdf-4563-a33c-53d38caca7a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00967a5f09824c51acc6049299715a3c'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:58.266025 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-2098af13-6cdf-4563-a33c-53d38caca7a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00967a5f09824c51acc6049299715a3c'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:58.273410 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-2098af13-6cdf-4563-a33c-53d38caca7a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00967a5f09824c51acc6049299715a3c'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:58.280151 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 949/1919] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:40:58 2022] DELETE /identity/v3/users/00967a5f09824c51acc6049299715a3c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:58.637760 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39185d0-9618-4b15-9821-2d3f3709e9d9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:58.639268 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b39185d0-9618-4b15-9821-2d3f3709e9d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:58.653716 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39185d0-9618-4b15-9821-2d3f3709e9d9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:58.714204 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0eafd4-46b3-465f-ad9e-1dd7627cf32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:58.715069 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0eafd4-46b3-465f-ad9e-1dd7627cf32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:58.715348 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0eafd4-46b3-465f-ad9e-1dd7627cf32f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:58.715621 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0eafd4-46b3-465f-ad9e-1dd7627cf32f admin admin] PATH_INFO: `/v3/projects/55fbc0028f484b3491e0c33ac588fbd3` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:58.716943 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0eafd4-46b3-465f-ad9e-1dd7627cf32f admin admin] RBAC: Authorizing `identity:delete_project(project_id=55fbc0028f484b3491e0c33ac588fbd3)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:58.718910 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0eafd4-46b3-465f-ad9e-1dd7627cf32f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:58.766193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6d0eafd4-46b3-465f-ad9e-1dd7627cf32f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55fbc0028f484b3491e0c33ac588fbd3', 'request_id': 'req-6d0eafd4-46b3-465f-ad9e-1dd7627cf32f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:58.773151 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6d0eafd4-46b3-465f-ad9e-1dd7627cf32f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55fbc0028f484b3491e0c33ac588fbd3', 'request_id': 'req-6d0eafd4-46b3-465f-ad9e-1dd7627cf32f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:58.780518 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6d0eafd4-46b3-465f-ad9e-1dd7627cf32f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55fbc0028f484b3491e0c33ac588fbd3', 'request_id': 'req-6d0eafd4-46b3-465f-ad9e-1dd7627cf32f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:58.791402 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6d0eafd4-46b3-465f-ad9e-1dd7627cf32f admin admin] The token cache is being invalidate because project 55fbc0028f484b3491e0c33ac588fbd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:40:58.791762 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6d0eafd4-46b3-465f-ad9e-1dd7627cf32f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:58.792519 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6d0eafd4-46b3-465f-ad9e-1dd7627cf32f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:58.794185 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 971/1920] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:40:58 2022] DELETE /identity/v3/projects/55fbc0028f484b3491e0c33ac588fbd3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:58.799833 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab668ab-73a0-4a2e-b6bb-fef91146cdc0 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:58.800304 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab668ab-73a0-4a2e-b6bb-fef91146cdc0 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:58.801041 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab668ab-73a0-4a2e-b6bb-fef91146cdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:58.819244 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-fab668ab-73a0-4a2e-b6bb-fef91146cdc0 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:58.820425 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-fab668ab-73a0-4a2e-b6bb-fef91146cdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:58.877517 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 950/1921] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:58.886047 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69077d-05a9-49b4-839d-35a0e198008d None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:58.886343 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69077d-05a9-49b4-839d-35a0e198008d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:58.886627 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69077d-05a9-49b4-839d-35a0e198008d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:58.908225 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ed69077d-05a9-49b4-839d-35a0e198008d None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:58.909488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ed69077d-05a9-49b4-839d-35a0e198008d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:58.918271 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 972/1922] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:58.922750 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab668ab-73a0-4a2e-b6bb-fef91146cdc0 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:58.933371 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab668ab-73a0-4a2e-b6bb-fef91146cdc0 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:58.938123 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3fead-2c3c-4a87-9ad3-0f5d8c20cff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:58.938971 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3fead-2c3c-4a87-9ad3-0f5d8c20cff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:58.939398 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3fead-2c3c-4a87-9ad3-0f5d8c20cff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:58.939829 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3fead-2c3c-4a87-9ad3-0f5d8c20cff9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:58.941384 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3fead-2c3c-4a87-9ad3-0f5d8c20cff9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:40:58.941858 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3fead-2c3c-4a87-9ad3-0f5d8c20cff9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:58.944354 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3fead-2c3c-4a87-9ad3-0f5d8c20cff9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:58.960499 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 951/1923] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:40:58.961710 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69077d-05a9-49b4-839d-35a0e198008d None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:58.971167 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69077d-05a9-49b4-839d-35a0e198008d None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:58.976799 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd6288-40b0-4a1f-878b-a6212278226e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:58.977497 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd6288-40b0-4a1f-878b-a6212278226e admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:58.977781 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd6288-40b0-4a1f-878b-a6212278226e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:58.978056 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd6288-40b0-4a1f-878b-a6212278226e admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:58.978779 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd6288-40b0-4a1f-878b-a6212278226e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:58.980675 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edd6288-40b0-4a1f-878b-a6212278226e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:59.010520 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 973/1924] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:40:58 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:59.023588 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3fead-2c3c-4a87-9ad3-0f5d8c20cff9 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:59.036507 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3fead-2c3c-4a87-9ad3-0f5d8c20cff9 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:59.093261 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deeb641-0993-425e-a8a6-12df34a9439d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:59.094045 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deeb641-0993-425e-a8a6-12df34a9439d admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:59.094332 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deeb641-0993-425e-a8a6-12df34a9439d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:59.094609 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deeb641-0993-425e-a8a6-12df34a9439d admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:59.095355 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deeb641-0993-425e-a8a6-12df34a9439d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:59.097348 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deeb641-0993-425e-a8a6-12df34a9439d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:59.121039 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 952/1925] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:40:59 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:40:59.123628 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd6288-40b0-4a1f-878b-a6212278226e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:59.134386 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd6288-40b0-4a1f-878b-a6212278226e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:59.139489 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3a4a5-38b4-43cf-adb7-47c7604dd6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:59.140160 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3a4a5-38b4-43cf-adb7-47c7604dd6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:59.140451 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3a4a5-38b4-43cf-adb7-47c7604dd6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:59.140732 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3a4a5-38b4-43cf-adb7-47c7604dd6e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:59.141529 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3a4a5-38b4-43cf-adb7-47c7604dd6e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:59.143146 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3a4a5-38b4-43cf-adb7-47c7604dd6e3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:59.157045 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 974/1926] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:59.158968 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deeb641-0993-425e-a8a6-12df34a9439d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:59.168990 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deeb641-0993-425e-a8a6-12df34a9439d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:59.173572 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b97096-a67a-4f5b-881a-0368c67d4199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:59.174229 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b97096-a67a-4f5b-881a-0368c67d4199 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:59.174517 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b97096-a67a-4f5b-881a-0368c67d4199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:59.175337 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b97096-a67a-4f5b-881a-0368c67d4199 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:59.176203 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b97096-a67a-4f5b-881a-0368c67d4199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:59.177841 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b97096-a67a-4f5b-881a-0368c67d4199 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:59.187695 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 953/1927] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:40:59.192661 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3a4a5-38b4-43cf-adb7-47c7604dd6e3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:59.202351 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3a4a5-38b4-43cf-adb7-47c7604dd6e3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:59.206936 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ba8fb-8161-4837-9428-3069898e1dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:59.207820 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ba8fb-8161-4837-9428-3069898e1dff admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:59.208090 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ba8fb-8161-4837-9428-3069898e1dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:59.208367 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ba8fb-8161-4837-9428-3069898e1dff admin admin] PATH_INFO: `/v3/projects/78733a7485ba4506b30326b22498648f/users/91814d108d2b4051858ec2835b0059c0/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:59.222195 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ba8fb-8161-4837-9428-3069898e1dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=78733a7485ba4506b30326b22498648f, user_id=91814d108d2b4051858ec2835b0059c0, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:59.224854 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ba8fb-8161-4837-9428-3069898e1dff admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:59.238209 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 975/1928] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:40:59 2022] PUT /identity/v3/projects/78733a7485ba4506b30326b22498648f/users/91814d108d2b4051858ec2835b0059c0/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:59.249687 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a7e4b-0efd-4ed1-9d91-fa00aea3faed None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:59.249919 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a7e4b-0efd-4ed1-9d91-fa00aea3faed None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:59.250265 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a7e4b-0efd-4ed1-9d91-fa00aea3faed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:59.279819 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-612a7e4b-0efd-4ed1-9d91-fa00aea3faed None None] MFA Rules not processed for user `91814d108d2b4051858ec2835b0059c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:59.281271 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-612a7e4b-0efd-4ed1-9d91-fa00aea3faed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:59.361552 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 954/1929] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:59.372443 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ba8fb-8161-4837-9428-3069898e1dff admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:59.374166 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-495ba8fb-8161-4837-9428-3069898e1dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:59.430788 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ba8fb-8161-4837-9428-3069898e1dff admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:59.435395 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88118f-74cb-4e6e-ad39-90d46a6830c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:59.436085 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88118f-74cb-4e6e-ad39-90d46a6830c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:59.436451 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88118f-74cb-4e6e-ad39-90d46a6830c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:59.436890 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88118f-74cb-4e6e-ad39-90d46a6830c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:59.447730 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88118f-74cb-4e6e-ad39-90d46a6830c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:59.449364 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88118f-74cb-4e6e-ad39-90d46a6830c7 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:59.459823 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 976/1930] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:40:59.478440 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a7e4b-0efd-4ed1-9d91-fa00aea3faed None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:59.559875 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a7e4b-0efd-4ed1-9d91-fa00aea3faed None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:59.565323 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1c509-54e2-45fe-b98d-9048f00f6719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:59.566196 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1c509-54e2-45fe-b98d-9048f00f6719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:59.566478 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1c509-54e2-45fe-b98d-9048f00f6719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:59.566753 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1c509-54e2-45fe-b98d-9048f00f6719 admin admin] PATH_INFO: `/v3/users/91814d108d2b4051858ec2835b0059c0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:59.567971 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1c509-54e2-45fe-b98d-9048f00f6719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91814d108d2b4051858ec2835b0059c0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:59.569983 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f1c509-54e2-45fe-b98d-9048f00f6719 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:59.616675 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a0f1c509-54e2-45fe-b98d-9048f00f6719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91814d108d2b4051858ec2835b0059c0'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:59.623530 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a0f1c509-54e2-45fe-b98d-9048f00f6719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91814d108d2b4051858ec2835b0059c0'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:59.624212 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a0f1c509-54e2-45fe-b98d-9048f00f6719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91814d108d2b4051858ec2835b0059c0'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:59.636205 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a0f1c509-54e2-45fe-b98d-9048f00f6719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91814d108d2b4051858ec2835b0059c0'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:59.643725 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a0f1c509-54e2-45fe-b98d-9048f00f6719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91814d108d2b4051858ec2835b0059c0'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:40:59.653820 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 955/1931] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:40:59 2022] DELETE /identity/v3/users/91814d108d2b4051858ec2835b0059c0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:40:59.661559 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584ed4b-b8a0-4043-bfb6-05807ebee866 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:59.662063 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584ed4b-b8a0-4043-bfb6-05807ebee866 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:59.662601 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584ed4b-b8a0-4043-bfb6-05807ebee866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:59.686626 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a584ed4b-b8a0-4043-bfb6-05807ebee866 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:40:59.687792 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a584ed4b-b8a0-4043-bfb6-05807ebee866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:59.753930 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 977/1932] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:40:59.760293 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1c509-54e2-45fe-b98d-9048f00f6719 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:40:59.761716 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-a0f1c509-54e2-45fe-b98d-9048f00f6719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:40:59.819918 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1c509-54e2-45fe-b98d-9048f00f6719 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:40:59.823985 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3df7a-5a21-4aa2-ac52-211b788ef695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:40:59.824316 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3df7a-5a21-4aa2-ac52-211b788ef695 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:40:59.824599 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3df7a-5a21-4aa2-ac52-211b788ef695 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:40:59.824873 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3df7a-5a21-4aa2-ac52-211b788ef695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:40:59.834656 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3df7a-5a21-4aa2-ac52-211b788ef695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:40:59.836187 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3df7a-5a21-4aa2-ac52-211b788ef695 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:40:59.846193 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 956/1933] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:40:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:00.170113 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584ed4b-b8a0-4043-bfb6-05807ebee866 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:00.172784 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a584ed4b-b8a0-4043-bfb6-05807ebee866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:00.203844 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584ed4b-b8a0-4043-bfb6-05807ebee866 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:00.210155 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a110d6b-a74c-44af-bb9e-8f02e629ea7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:00.211046 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a110d6b-a74c-44af-bb9e-8f02e629ea7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:00.211340 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a110d6b-a74c-44af-bb9e-8f02e629ea7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:00.211613 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a110d6b-a74c-44af-bb9e-8f02e629ea7c admin admin] PATH_INFO: `/v3/projects/78733a7485ba4506b30326b22498648f` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:00.213076 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a110d6b-a74c-44af-bb9e-8f02e629ea7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=78733a7485ba4506b30326b22498648f)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:00.215244 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a110d6b-a74c-44af-bb9e-8f02e629ea7c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:00.271001 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4a110d6b-a74c-44af-bb9e-8f02e629ea7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78733a7485ba4506b30326b22498648f', 'request_id': 'req-4a110d6b-a74c-44af-bb9e-8f02e629ea7c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:00.278497 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4a110d6b-a74c-44af-bb9e-8f02e629ea7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78733a7485ba4506b30326b22498648f', 'request_id': 'req-4a110d6b-a74c-44af-bb9e-8f02e629ea7c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:00.285738 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4a110d6b-a74c-44af-bb9e-8f02e629ea7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78733a7485ba4506b30326b22498648f', 'request_id': 'req-4a110d6b-a74c-44af-bb9e-8f02e629ea7c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:00.296835 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4a110d6b-a74c-44af-bb9e-8f02e629ea7c admin admin] The token cache is being invalidate because project 78733a7485ba4506b30326b22498648f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:00.297191 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4a110d6b-a74c-44af-bb9e-8f02e629ea7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:00.297932 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4a110d6b-a74c-44af-bb9e-8f02e629ea7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:00.299444 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 978/1934] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:00 2022] DELETE /identity/v3/projects/78733a7485ba4506b30326b22498648f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:00.305859 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f4e08-177c-4c05-a14b-57aebef54fc4 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:00.306346 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f4e08-177c-4c05-a14b-57aebef54fc4 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:00.306473 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f4e08-177c-4c05-a14b-57aebef54fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:00.326729 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-8f5f4e08-177c-4c05-a14b-57aebef54fc4 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:00.328054 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-8f5f4e08-177c-4c05-a14b-57aebef54fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:00.394689 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a110d6b-a74c-44af-bb9e-8f02e629ea7c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:00.403676 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 957/1935] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:00.404200 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-4a110d6b-a74c-44af-bb9e-8f02e629ea7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:00.405322 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4358520-3b75-4371-98e8-bc7ea93cc271 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:00.405816 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4358520-3b75-4371-98e8-bc7ea93cc271 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:00.406358 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4358520-3b75-4371-98e8-bc7ea93cc271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:00.427051 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a110d6b-a74c-44af-bb9e-8f02e629ea7c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:00.432517 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4210fd-29c4-42c2-9c22-7e256ffe9399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:00.433405 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4210fd-29c4-42c2-9c22-7e256ffe9399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:00.433677 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4210fd-29c4-42c2-9c22-7e256ffe9399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:00.433996 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4210fd-29c4-42c2-9c22-7e256ffe9399 admin admin] PATH_INFO: `/v3/users/9099ffa379314992bffbf25a03b61c51` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:00.435490 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4210fd-29c4-42c2-9c22-7e256ffe9399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9099ffa379314992bffbf25a03b61c51)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:00.437807 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4210fd-29c4-42c2-9c22-7e256ffe9399 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:00.447407 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-d4358520-3b75-4371-98e8-bc7ea93cc271 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:00.448870 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-d4358520-3b75-4371-98e8-bc7ea93cc271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:00.461086 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 958/1936] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:00.465143 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4358520-3b75-4371-98e8-bc7ea93cc271 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:00.477504 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4358520-3b75-4371-98e8-bc7ea93cc271 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:00.491199 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367ca0a-761b-4175-875f-43367e14fcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:00.492029 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367ca0a-761b-4175-875f-43367e14fcc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:00.492145 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367ca0a-761b-4175-875f-43367e14fcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:00.492420 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367ca0a-761b-4175-875f-43367e14fcc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:00.493182 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367ca0a-761b-4175-875f-43367e14fcc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:41:00.493505 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367ca0a-761b-4175-875f-43367e14fcc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:00.495097 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367ca0a-761b-4175-875f-43367e14fcc9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:00.501133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9f4210fd-29c4-42c2-9c22-7e256ffe9399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9099ffa379314992bffbf25a03b61c51'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:00.509714 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9f4210fd-29c4-42c2-9c22-7e256ffe9399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9099ffa379314992bffbf25a03b61c51'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:00.510755 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9f4210fd-29c4-42c2-9c22-7e256ffe9399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9099ffa379314992bffbf25a03b61c51'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:00.516497 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 959/1937] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:41:00.522038 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367ca0a-761b-4175-875f-43367e14fcc9 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:00.525593 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9f4210fd-29c4-42c2-9c22-7e256ffe9399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9099ffa379314992bffbf25a03b61c51'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:00.536182 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9f4210fd-29c4-42c2-9c22-7e256ffe9399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9099ffa379314992bffbf25a03b61c51'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:00.540943 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367ca0a-761b-4175-875f-43367e14fcc9 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:00.544313 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 979/1938] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:00 2022] DELETE /identity/v3/users/9099ffa379314992bffbf25a03b61c51 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:41:00.559663 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45efd51-5fc2-43a5-92fa-4c8afbbc3812 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:00.560085 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45efd51-5fc2-43a5-92fa-4c8afbbc3812 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:00.560448 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45efd51-5fc2-43a5-92fa-4c8afbbc3812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:00.562165 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eab54c-2e6c-441d-98f0-ad7b5ddb0ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:00.562927 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eab54c-2e6c-441d-98f0-ad7b5ddb0ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:00.563165 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eab54c-2e6c-441d-98f0-ad7b5ddb0ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:00.563494 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eab54c-2e6c-441d-98f0-ad7b5ddb0ad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:00.564368 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eab54c-2e6c-441d-98f0-ad7b5ddb0ad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:00.568140 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eab54c-2e6c-441d-98f0-ad7b5ddb0ad8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:00.587509 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-c45efd51-5fc2-43a5-92fa-4c8afbbc3812 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:00.588804 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c45efd51-5fc2-43a5-92fa-4c8afbbc3812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:00.597777 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 960/1939] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:00 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:00.602485 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eab54c-2e6c-441d-98f0-ad7b5ddb0ad8 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:00.604470 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-b5eab54c-2e6c-441d-98f0-ad7b5ddb0ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:00.657226 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 980/1940] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:00.670081 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45efd51-5fc2-43a5-92fa-4c8afbbc3812 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:00.672216 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c45efd51-5fc2-43a5-92fa-4c8afbbc3812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:00.719637 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eab54c-2e6c-441d-98f0-ad7b5ddb0ad8 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:00.729525 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256ba0a-d902-480e-bb49-ce81a2ba8aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:00.730206 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256ba0a-d902-480e-bb49-ce81a2ba8aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:00.730506 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256ba0a-d902-480e-bb49-ce81a2ba8aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:00.730918 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256ba0a-d902-480e-bb49-ce81a2ba8aa3 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:00.731639 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256ba0a-d902-480e-bb49-ce81a2ba8aa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:00.733941 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256ba0a-d902-480e-bb49-ce81a2ba8aa3 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:00.740260 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45efd51-5fc2-43a5-92fa-4c8afbbc3812 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:00.767116 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 961/1941] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:00 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:00.768034 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256ba0a-d902-480e-bb49-ce81a2ba8aa3 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:00.781476 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256ba0a-d902-480e-bb49-ce81a2ba8aa3 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:00.786721 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a26be-4718-499b-bef3-df336fed308f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:00.787419 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a26be-4718-499b-bef3-df336fed308f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:00.787782 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a26be-4718-499b-bef3-df336fed308f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:00.788066 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a26be-4718-499b-bef3-df336fed308f admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:00.788838 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a26be-4718-499b-bef3-df336fed308f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:00.790703 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a26be-4718-499b-bef3-df336fed308f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:00.813923 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 962/1942] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:00.818333 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a26be-4718-499b-bef3-df336fed308f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:00.829591 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a26be-4718-499b-bef3-df336fed308f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:00.835444 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb106b7-1a39-45d5-af2d-b73a7b679a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:00.836295 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb106b7-1a39-45d5-af2d-b73a7b679a88 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:00.836851 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb106b7-1a39-45d5-af2d-b73a7b679a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:00.837508 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb106b7-1a39-45d5-af2d-b73a7b679a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:00.838555 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb106b7-1a39-45d5-af2d-b73a7b679a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:00.840721 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb106b7-1a39-45d5-af2d-b73a7b679a88 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:00.844638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee46d6d-d726-40f4-b5bf-74e23de86135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:00.845871 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee46d6d-d726-40f4-b5bf-74e23de86135 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:00.846456 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee46d6d-d726-40f4-b5bf-74e23de86135 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:00.847340 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee46d6d-d726-40f4-b5bf-74e23de86135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:00.860789 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee46d6d-d726-40f4-b5bf-74e23de86135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:00.861058 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 963/1943] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:00.862971 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee46d6d-d726-40f4-b5bf-74e23de86135 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:00.865923 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb106b7-1a39-45d5-af2d-b73a7b679a88 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:00.878280 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 981/1944] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:41:00.879907 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb106b7-1a39-45d5-af2d-b73a7b679a88 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:00.884804 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d6310-ca16-4856-ae5c-565212ce822a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:00.885650 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d6310-ca16-4856-ae5c-565212ce822a admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:00.885935 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d6310-ca16-4856-ae5c-565212ce822a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:00.886213 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d6310-ca16-4856-ae5c-565212ce822a admin admin] PATH_INFO: `/v3/projects/915012252b8646078a28c9423c2b1cc9/users/09901ed9b8144ec8a7ed015c21c329d2/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:00.904813 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d6310-ca16-4856-ae5c-565212ce822a admin admin] RBAC: Authorizing `identity:create_grant(project_id=915012252b8646078a28c9423c2b1cc9, user_id=09901ed9b8144ec8a7ed015c21c329d2, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:00.908876 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d6310-ca16-4856-ae5c-565212ce822a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:00.924145 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 964/1945] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:00 2022] PUT /identity/v3/projects/915012252b8646078a28c9423c2b1cc9/users/09901ed9b8144ec8a7ed015c21c329d2/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:41:00.935079 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11076050-c739-4d69-8dc4-94c8e00ce637 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:00.935370 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11076050-c739-4d69-8dc4-94c8e00ce637 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:00.935650 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11076050-c739-4d69-8dc4-94c8e00ce637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:00.963344 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-11076050-c739-4d69-8dc4-94c8e00ce637 None None] MFA Rules not processed for user `09901ed9b8144ec8a7ed015c21c329d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:00.964677 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-11076050-c739-4d69-8dc4-94c8e00ce637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:01.030291 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 982/1946] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:01.039397 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d6310-ca16-4856-ae5c-565212ce822a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:01.119383 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d6310-ca16-4856-ae5c-565212ce822a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:01.125022 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b48a3-7b24-49ee-8a7a-8dd18669d126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:01.125976 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b48a3-7b24-49ee-8a7a-8dd18669d126 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:01.126501 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b48a3-7b24-49ee-8a7a-8dd18669d126 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:01.126892 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b48a3-7b24-49ee-8a7a-8dd18669d126 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:01.127736 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b48a3-7b24-49ee-8a7a-8dd18669d126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:01.131969 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b48a3-7b24-49ee-8a7a-8dd18669d126 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:01.166620 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 965/1947] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:01 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:41:01.171296 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11076050-c739-4d69-8dc4-94c8e00ce637 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:01.187891 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11076050-c739-4d69-8dc4-94c8e00ce637 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:01.201442 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b48a3-7b24-49ee-8a7a-8dd18669d126 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:01.205836 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-617b48a3-7b24-49ee-8a7a-8dd18669d126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:01.271086 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8c127-d842-442b-9b8f-9296dbd47eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:01.272022 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8c127-d842-442b-9b8f-9296dbd47eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:01.272455 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8c127-d842-442b-9b8f-9296dbd47eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:01.273088 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8c127-d842-442b-9b8f-9296dbd47eb8 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:01.274604 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8c127-d842-442b-9b8f-9296dbd47eb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:01.277100 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8c127-d842-442b-9b8f-9296dbd47eb8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:01.302765 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b48a3-7b24-49ee-8a7a-8dd18669d126 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:01.308257 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d48ace-1a5c-48c8-8894-80079bf29445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:01.308875 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 983/1948] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:01 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:41:01.309990 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d48ace-1a5c-48c8-8894-80079bf29445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:01.310378 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d48ace-1a5c-48c8-8894-80079bf29445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:01.310665 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d48ace-1a5c-48c8-8894-80079bf29445 admin admin] PATH_INFO: `/v3/projects/167c72dd46c24277abf808e48281f8e0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:01.311881 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d48ace-1a5c-48c8-8894-80079bf29445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=167c72dd46c24277abf808e48281f8e0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:01.312800 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8c127-d842-442b-9b8f-9296dbd47eb8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:01.314168 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d48ace-1a5c-48c8-8894-80079bf29445 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:01.323520 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8c127-d842-442b-9b8f-9296dbd47eb8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:01.329286 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c615df-cd2e-40eb-9e31-cc5b0274e2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:01.330097 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c615df-cd2e-40eb-9e31-cc5b0274e2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:01.330334 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c615df-cd2e-40eb-9e31-cc5b0274e2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:01.331032 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c615df-cd2e-40eb-9e31-cc5b0274e2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:01.331861 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c615df-cd2e-40eb-9e31-cc5b0274e2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:01.334348 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c615df-cd2e-40eb-9e31-cc5b0274e2f6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:01.346292 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 984/1949] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:41:01.352517 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c615df-cd2e-40eb-9e31-cc5b0274e2f6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:01.363873 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c615df-cd2e-40eb-9e31-cc5b0274e2f6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:01.367573 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-e9d48ace-1a5c-48c8-8894-80079bf29445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '167c72dd46c24277abf808e48281f8e0', 'request_id': 'req-e9d48ace-1a5c-48c8-8894-80079bf29445'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:01.376826 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-e9d48ace-1a5c-48c8-8894-80079bf29445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '167c72dd46c24277abf808e48281f8e0', 'request_id': 'req-e9d48ace-1a5c-48c8-8894-80079bf29445'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:01.383898 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-e9d48ace-1a5c-48c8-8894-80079bf29445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '167c72dd46c24277abf808e48281f8e0', 'request_id': 'req-e9d48ace-1a5c-48c8-8894-80079bf29445'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:01.397575 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-e9d48ace-1a5c-48c8-8894-80079bf29445 admin admin] The token cache is being invalidate because project 167c72dd46c24277abf808e48281f8e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:01.398075 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-e9d48ace-1a5c-48c8-8894-80079bf29445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:01.398869 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-e9d48ace-1a5c-48c8-8894-80079bf29445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:01.400852 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 966/1950] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:01 2022] DELETE /identity/v3/projects/167c72dd46c24277abf808e48281f8e0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:01.404648 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d48ace-1a5c-48c8-8894-80079bf29445 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:01.406151 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-e9d48ace-1a5c-48c8-8894-80079bf29445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:01.434115 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19b9a0-1863-4170-b773-61e012b45fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:01.435017 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19b9a0-1863-4170-b773-61e012b45fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:01.435300 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19b9a0-1863-4170-b773-61e012b45fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:01.435577 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19b9a0-1863-4170-b773-61e012b45fe7 admin admin] PATH_INFO: `/v3/projects/ae15ebb18df34d78a085e7af450b7460/users/b66410c9dc714fe3a22b5b15aa5a8b0d/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:01.451994 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19b9a0-1863-4170-b773-61e012b45fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae15ebb18df34d78a085e7af450b7460, user_id=b66410c9dc714fe3a22b5b15aa5a8b0d, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:01.454751 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19b9a0-1863-4170-b773-61e012b45fe7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:01.468815 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 985/1951] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:01 2022] PUT /identity/v3/projects/ae15ebb18df34d78a085e7af450b7460/users/b66410c9dc714fe3a22b5b15aa5a8b0d/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:01.472258 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d48ace-1a5c-48c8-8894-80079bf29445 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:01.472727 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19b9a0-1863-4170-b773-61e012b45fe7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:01.474500 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2b19b9a0-1863-4170-b773-61e012b45fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:01.527979 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc06b2-b6b9-4a4c-9191-5205126ba2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:01.528852 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc06b2-b6b9-4a4c-9191-5205126ba2a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:01.529755 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc06b2-b6b9-4a4c-9191-5205126ba2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:01.530037 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc06b2-b6b9-4a4c-9191-5205126ba2a6 admin admin] PATH_INFO: `/v3/users/3ad5a65f6a7545b4ab502775704a6cbd` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:01.531347 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc06b2-b6b9-4a4c-9191-5205126ba2a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ad5a65f6a7545b4ab502775704a6cbd)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:01.533379 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc06b2-b6b9-4a4c-9191-5205126ba2a6 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:01.540335 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19b9a0-1863-4170-b773-61e012b45fe7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:01.550200 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0ef1c-e6b5-447e-966e-e451ca69314e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:01.551313 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0ef1c-e6b5-447e-966e-e451ca69314e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:01.551610 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0ef1c-e6b5-447e-966e-e451ca69314e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:01.553161 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0ef1c-e6b5-447e-966e-e451ca69314e admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:01.554925 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c0ef1c-e6b5-447e-966e-e451ca69314e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:01.556637 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c0ef1c-e6b5-447e-966e-e451ca69314e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:01.568150 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 986/1952] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:41:01.572782 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0ef1c-e6b5-447e-966e-e451ca69314e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:01.583496 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0ef1c-e6b5-447e-966e-e451ca69314e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:01.589188 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7e09a-b475-4560-a420-e8383bfe5469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:01.590210 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7e09a-b475-4560-a420-e8383bfe5469 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:01.590499 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7e09a-b475-4560-a420-e8383bfe5469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:01.590776 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7e09a-b475-4560-a420-e8383bfe5469 admin admin] PATH_INFO: `/v3/projects/ae15ebb18df34d78a085e7af450b7460/users/b66410c9dc714fe3a22b5b15aa5a8b0d/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:01.593566 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7e09a-b475-4560-a420-e8383bfe5469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae15ebb18df34d78a085e7af450b7460, user_id=b66410c9dc714fe3a22b5b15aa5a8b0d, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:01.597120 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7e09a-b475-4560-a420-e8383bfe5469 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:01.597700 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-abdc06b2-b6b9-4a4c-9191-5205126ba2a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ad5a65f6a7545b4ab502775704a6cbd'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:01.610465 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 987/1953] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:01 2022] PUT /identity/v3/projects/ae15ebb18df34d78a085e7af450b7460/users/b66410c9dc714fe3a22b5b15aa5a8b0d/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:01.613880 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-abdc06b2-b6b9-4a4c-9191-5205126ba2a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ad5a65f6a7545b4ab502775704a6cbd'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:01.614846 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-abdc06b2-b6b9-4a4c-9191-5205126ba2a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ad5a65f6a7545b4ab502775704a6cbd'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:01.623146 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894ae08-0a46-4954-8eab-143e65142ff9 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:01.623436 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894ae08-0a46-4954-8eab-143e65142ff9 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:01.623994 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894ae08-0a46-4954-8eab-143e65142ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:01.631448 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-abdc06b2-b6b9-4a4c-9191-5205126ba2a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ad5a65f6a7545b4ab502775704a6cbd'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:01.640428 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-abdc06b2-b6b9-4a4c-9191-5205126ba2a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ad5a65f6a7545b4ab502775704a6cbd'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:01.649758 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 967/1954] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:01 2022] DELETE /identity/v3/users/3ad5a65f6a7545b4ab502775704a6cbd => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:01.670136 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-6894ae08-0a46-4954-8eab-143e65142ff9 None None] MFA Rules not processed for user `b66410c9dc714fe3a22b5b15aa5a8b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:01.672166 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6894ae08-0a46-4954-8eab-143e65142ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:01.762476 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 988/1955] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:41:01.772793 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc06b2-b6b9-4a4c-9191-5205126ba2a6 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:01.774619 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-abdc06b2-b6b9-4a4c-9191-5205126ba2a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:01.843402 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc06b2-b6b9-4a4c-9191-5205126ba2a6 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:01.849147 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64b117-b108-4175-97db-bfd9ed7c04c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:01.850049 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64b117-b108-4175-97db-bfd9ed7c04c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:01.850335 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64b117-b108-4175-97db-bfd9ed7c04c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:01.850645 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64b117-b108-4175-97db-bfd9ed7c04c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:01.852473 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-cc64b117-b108-4175-97db-bfd9ed7c04c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:01.917765 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64b117-b108-4175-97db-bfd9ed7c04c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:01.919055 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64b117-b108-4175-97db-bfd9ed7c04c3 service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:01.931011 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 968/1956] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:01.963822 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894ae08-0a46-4954-8eab-143e65142ff9 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:01.965443 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6894ae08-0a46-4954-8eab-143e65142ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:02.066471 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894ae08-0a46-4954-8eab-143e65142ff9 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:02.077992 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caf25e-13be-45ea-aa3e-37fd62e94feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:02.077992 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caf25e-13be-45ea-aa3e-37fd62e94feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:02.077992 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caf25e-13be-45ea-aa3e-37fd62e94feb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:02.077992 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caf25e-13be-45ea-aa3e-37fd62e94feb admin admin] PATH_INFO: `/v3/projects/cedcf2039f8f4618af9580076175ee53` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:02.078397 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5caf25e-13be-45ea-aa3e-37fd62e94feb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cedcf2039f8f4618af9580076175ee53)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:02.078397 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5caf25e-13be-45ea-aa3e-37fd62e94feb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:02.132205 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c5caf25e-13be-45ea-aa3e-37fd62e94feb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cedcf2039f8f4618af9580076175ee53', 'request_id': 'req-c5caf25e-13be-45ea-aa3e-37fd62e94feb'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.138789 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c5caf25e-13be-45ea-aa3e-37fd62e94feb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cedcf2039f8f4618af9580076175ee53', 'request_id': 'req-c5caf25e-13be-45ea-aa3e-37fd62e94feb'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.147975 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c5caf25e-13be-45ea-aa3e-37fd62e94feb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cedcf2039f8f4618af9580076175ee53', 'request_id': 'req-c5caf25e-13be-45ea-aa3e-37fd62e94feb'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.167776 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c5caf25e-13be-45ea-aa3e-37fd62e94feb admin admin] The token cache is being invalidate because project cedcf2039f8f4618af9580076175ee53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:02.168237 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c5caf25e-13be-45ea-aa3e-37fd62e94feb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.169172 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c5caf25e-13be-45ea-aa3e-37fd62e94feb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.170783 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 989/1957] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:01 2022] DELETE /identity/v3/projects/cedcf2039f8f4618af9580076175ee53 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:02.175462 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64b117-b108-4175-97db-bfd9ed7c04c3 service cinder] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:02.189272 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64b117-b108-4175-97db-bfd9ed7c04c3 service cinder] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:02.271941 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43019669-c512-40da-a09f-425416cbf566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:02.272819 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43019669-c512-40da-a09f-425416cbf566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:02.273138 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43019669-c512-40da-a09f-425416cbf566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:02.273442 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43019669-c512-40da-a09f-425416cbf566 admin admin] PATH_INFO: `/v3/users/35d08b35f36b455aa20ad70c2cbe5a06` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:02.275524 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43019669-c512-40da-a09f-425416cbf566 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35d08b35f36b455aa20ad70c2cbe5a06)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:02.278483 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43019669-c512-40da-a09f-425416cbf566 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:02.341292 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-43019669-c512-40da-a09f-425416cbf566 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35d08b35f36b455aa20ad70c2cbe5a06'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.351925 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-43019669-c512-40da-a09f-425416cbf566 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35d08b35f36b455aa20ad70c2cbe5a06'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.352652 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-43019669-c512-40da-a09f-425416cbf566 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35d08b35f36b455aa20ad70c2cbe5a06'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.368280 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-43019669-c512-40da-a09f-425416cbf566 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35d08b35f36b455aa20ad70c2cbe5a06'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.377211 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-43019669-c512-40da-a09f-425416cbf566 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35d08b35f36b455aa20ad70c2cbe5a06'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.383863 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 969/1958] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:02 2022] DELETE /identity/v3/users/35d08b35f36b455aa20ad70c2cbe5a06 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:41:02.604637 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caf25e-13be-45ea-aa3e-37fd62e94feb admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:02.606120 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c5caf25e-13be-45ea-aa3e-37fd62e94feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:02.619238 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caf25e-13be-45ea-aa3e-37fd62e94feb admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:02.672307 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43019669-c512-40da-a09f-425416cbf566 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:02.673740 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-43019669-c512-40da-a09f-425416cbf566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:02.680783 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f8608-0239-4705-ad6c-0773f44470ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:02.681706 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f8608-0239-4705-ad6c-0773f44470ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:02.681991 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f8608-0239-4705-ad6c-0773f44470ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:02.682322 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f8608-0239-4705-ad6c-0773f44470ca admin admin] PATH_INFO: `/v3/users/9fc95ac1f21245a68a3a250138e92f7d` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:02.683623 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f8608-0239-4705-ad6c-0773f44470ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fc95ac1f21245a68a3a250138e92f7d)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:02.685833 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f8608-0239-4705-ad6c-0773f44470ca admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:02.689185 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43019669-c512-40da-a09f-425416cbf566 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:02.694424 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3b04d-e424-49a5-a711-541d43c790e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:02.695287 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3b04d-e424-49a5-a711-541d43c790e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:02.695566 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3b04d-e424-49a5-a711-541d43c790e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:02.695843 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3b04d-e424-49a5-a711-541d43c790e2 admin admin] PATH_INFO: `/v3/projects/cf01ef00bca5447aa8af1fd18f01a21f` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:02.697064 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3b04d-e424-49a5-a711-541d43c790e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf01ef00bca5447aa8af1fd18f01a21f)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:02.699262 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3b04d-e424-49a5-a711-541d43c790e2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:02.757134 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-7a7f8608-0239-4705-ad6c-0773f44470ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fc95ac1f21245a68a3a250138e92f7d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.765976 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-7a7f8608-0239-4705-ad6c-0773f44470ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fc95ac1f21245a68a3a250138e92f7d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.766847 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-7a7f8608-0239-4705-ad6c-0773f44470ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fc95ac1f21245a68a3a250138e92f7d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.770487 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-65f3b04d-e424-49a5-a711-541d43c790e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf01ef00bca5447aa8af1fd18f01a21f', 'request_id': 'req-65f3b04d-e424-49a5-a711-541d43c790e2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.778176 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-65f3b04d-e424-49a5-a711-541d43c790e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf01ef00bca5447aa8af1fd18f01a21f', 'request_id': 'req-65f3b04d-e424-49a5-a711-541d43c790e2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.780002 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-7a7f8608-0239-4705-ad6c-0773f44470ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fc95ac1f21245a68a3a250138e92f7d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.784972 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-65f3b04d-e424-49a5-a711-541d43c790e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf01ef00bca5447aa8af1fd18f01a21f', 'request_id': 'req-65f3b04d-e424-49a5-a711-541d43c790e2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.787992 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-7a7f8608-0239-4705-ad6c-0773f44470ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fc95ac1f21245a68a3a250138e92f7d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.794329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 990/1959] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:02 2022] DELETE /identity/v3/users/9fc95ac1f21245a68a3a250138e92f7d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:02.795067 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f8608-0239-4705-ad6c-0773f44470ca admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:02.798034 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7a7f8608-0239-4705-ad6c-0773f44470ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:02.798638 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-65f3b04d-e424-49a5-a711-541d43c790e2 admin admin] The token cache is being invalidate because project cf01ef00bca5447aa8af1fd18f01a21f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:02.798961 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-65f3b04d-e424-49a5-a711-541d43c790e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.800181 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-65f3b04d-e424-49a5-a711-541d43c790e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.801780 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 970/1960] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:02 2022] DELETE /identity/v3/projects/cf01ef00bca5447aa8af1fd18f01a21f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:41:02.803012 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e8302-ff4e-47c9-84b5-6b721d38395a None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:02.803427 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e8302-ff4e-47c9-84b5-6b721d38395a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:02.803785 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e8302-ff4e-47c9-84b5-6b721d38395a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:02.821221 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-255e8302-ff4e-47c9-84b5-6b721d38395a None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:02.822398 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-255e8302-ff4e-47c9-84b5-6b721d38395a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:02.860227 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f8608-0239-4705-ad6c-0773f44470ca admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:02.865804 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a835952-7692-4920-9cb0-ad51f6da31bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:02.866670 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a835952-7692-4920-9cb0-ad51f6da31bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:02.866952 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a835952-7692-4920-9cb0-ad51f6da31bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:02.867229 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a835952-7692-4920-9cb0-ad51f6da31bc admin admin] PATH_INFO: `/v3/users/23cb63fbab8343ebb3328436c4f85ef3` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:02.869102 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a835952-7692-4920-9cb0-ad51f6da31bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=23cb63fbab8343ebb3328436c4f85ef3)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:02.871035 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a835952-7692-4920-9cb0-ad51f6da31bc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:02.879607 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 971/1961] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:02.881101 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00de4bb-d2aa-4e4b-9022-865d9ffe5663 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:02.881392 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00de4bb-d2aa-4e4b-9022-865d9ffe5663 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:02.881673 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00de4bb-d2aa-4e4b-9022-865d9ffe5663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:02.900905 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-d00de4bb-d2aa-4e4b-9022-865d9ffe5663 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:02.902143 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-d00de4bb-d2aa-4e4b-9022-865d9ffe5663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:02.911763 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 972/1962] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:02.912490 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00de4bb-d2aa-4e4b-9022-865d9ffe5663 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:02.917762 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9a835952-7692-4920-9cb0-ad51f6da31bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23cb63fbab8343ebb3328436c4f85ef3'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.919870 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-d00de4bb-d2aa-4e4b-9022-865d9ffe5663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:02.924304 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9a835952-7692-4920-9cb0-ad51f6da31bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23cb63fbab8343ebb3328436c4f85ef3'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.925055 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9a835952-7692-4920-9cb0-ad51f6da31bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23cb63fbab8343ebb3328436c4f85ef3'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.936584 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9a835952-7692-4920-9cb0-ad51f6da31bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23cb63fbab8343ebb3328436c4f85ef3'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.943853 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9a835952-7692-4920-9cb0-ad51f6da31bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23cb63fbab8343ebb3328436c4f85ef3'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:02.953329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 991/1963] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:02 2022] DELETE /identity/v3/users/23cb63fbab8343ebb3328436c4f85ef3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:02.953329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c5bab-036d-4f5e-849f-50bb8162656d None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:02.953329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c5bab-036d-4f5e-849f-50bb8162656d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:02.953329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c5bab-036d-4f5e-849f-50bb8162656d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:02.975861 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-fa7c5bab-036d-4f5e-849f-50bb8162656d None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:02.977312 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fa7c5bab-036d-4f5e-849f-50bb8162656d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:02.980898 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00de4bb-d2aa-4e4b-9022-865d9ffe5663 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:03.033343 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59ef55-a4b8-4ef7-ab9e-7ce98c37d7d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:03.035387 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59ef55-a4b8-4ef7-ab9e-7ce98c37d7d7 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:03.035387 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59ef55-a4b8-4ef7-ab9e-7ce98c37d7d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:03.035387 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59ef55-a4b8-4ef7-ab9e-7ce98c37d7d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:03.039379 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-6a59ef55-a4b8-4ef7-ab9e-7ce98c37d7d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:03.045726 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 992/1964] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:03.046902 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae4707-f45e-4d0c-9a7e-4b94d2ee1618 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:03.047189 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae4707-f45e-4d0c-9a7e-4b94d2ee1618 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:03.047473 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae4707-f45e-4d0c-9a7e-4b94d2ee1618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:03.055734 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59ef55-a4b8-4ef7-ab9e-7ce98c37d7d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:03.057332 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59ef55-a4b8-4ef7-ab9e-7ce98c37d7d7 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:03.064901 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-0bae4707-f45e-4d0c-9a7e-4b94d2ee1618 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:03.066185 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0bae4707-f45e-4d0c-9a7e-4b94d2ee1618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:03.068926 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 973/1965] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:03.069776 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59ef55-a4b8-4ef7-ab9e-7ce98c37d7d7 service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:03.074133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 993/1966] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:03.081507 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59ef55-a4b8-4ef7-ab9e-7ce98c37d7d7 service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:03.084866 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae4707-f45e-4d0c-9a7e-4b94d2ee1618 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:03.086296 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0bae4707-f45e-4d0c-9a7e-4b94d2ee1618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:03.086404 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720dc85-bfe5-4d4c-b729-2b3c88697e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:03.086990 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720dc85-bfe5-4d4c-b729-2b3c88697e51 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:03.087240 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720dc85-bfe5-4d4c-b729-2b3c88697e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:03.087566 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720dc85-bfe5-4d4c-b729-2b3c88697e51 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:03.088311 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720dc85-bfe5-4d4c-b729-2b3c88697e51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:41:03.088617 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720dc85-bfe5-4d4c-b729-2b3c88697e51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:03.090231 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720dc85-bfe5-4d4c-b729-2b3c88697e51 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:03.099402 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae4707-f45e-4d0c-9a7e-4b94d2ee1618 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:03.106292 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 974/1967] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:41:03.107529 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15954b-ff26-430d-9fae-04363e1c1468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:03.108065 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720dc85-bfe5-4d4c-b729-2b3c88697e51 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:03.108409 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15954b-ff26-430d-9fae-04363e1c1468 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:03.108672 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15954b-ff26-430d-9fae-04363e1c1468 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:03.109039 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15954b-ff26-430d-9fae-04363e1c1468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:03.118655 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720dc85-bfe5-4d4c-b729-2b3c88697e51 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:03.119094 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15954b-ff26-430d-9fae-04363e1c1468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:03.120602 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15954b-ff26-430d-9fae-04363e1c1468 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:03.124936 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb402a91-50d7-4114-950f-03396864dc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:03.125627 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb402a91-50d7-4114-950f-03396864dc69 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:03.125907 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb402a91-50d7-4114-950f-03396864dc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:03.126428 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb402a91-50d7-4114-950f-03396864dc69 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:03.126940 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb402a91-50d7-4114-950f-03396864dc69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:03.129384 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb402a91-50d7-4114-950f-03396864dc69 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:03.130910 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 994/1968] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:41:03.166721 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 975/1969] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:03 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:41:03.171264 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15954b-ff26-430d-9fae-04363e1c1468 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:03.181056 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15954b-ff26-430d-9fae-04363e1c1468 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:03.276254 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a2ff4-3737-4747-b4a8-8ac1b912af16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:03.276952 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a2ff4-3737-4747-b4a8-8ac1b912af16 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:03.277263 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a2ff4-3737-4747-b4a8-8ac1b912af16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:03.277538 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a2ff4-3737-4747-b4a8-8ac1b912af16 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:03.278264 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a2ff4-3737-4747-b4a8-8ac1b912af16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:03.280198 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a2ff4-3737-4747-b4a8-8ac1b912af16 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:03.304981 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 995/1970] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:03 2022] POST /identity/v3/users => generated 286 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:03.309113 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb402a91-50d7-4114-950f-03396864dc69 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:03.324502 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb402a91-50d7-4114-950f-03396864dc69 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:03.341316 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028c5c0-5072-4fd0-9a90-d69b0d4f2471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:03.342028 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028c5c0-5072-4fd0-9a90-d69b0d4f2471 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:03.342315 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028c5c0-5072-4fd0-9a90-d69b0d4f2471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:03.342627 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028c5c0-5072-4fd0-9a90-d69b0d4f2471 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:03.343395 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028c5c0-5072-4fd0-9a90-d69b0d4f2471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:03.345298 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028c5c0-5072-4fd0-9a90-d69b0d4f2471 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:03.376911 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 976/1971] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:03.381889 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a2ff4-3737-4747-b4a8-8ac1b912af16 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:03.393073 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a2ff4-3737-4747-b4a8-8ac1b912af16 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:03.399546 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12945e-e8cd-423f-a3f3-42cb04a64bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:03.400455 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12945e-e8cd-423f-a3f3-42cb04a64bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:03.400913 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12945e-e8cd-423f-a3f3-42cb04a64bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:03.401638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12945e-e8cd-423f-a3f3-42cb04a64bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:03.402848 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12945e-e8cd-423f-a3f3-42cb04a64bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:03.404865 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12945e-e8cd-423f-a3f3-42cb04a64bd6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:03.437860 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 996/1972] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:41:03.443079 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028c5c0-5072-4fd0-9a90-d69b0d4f2471 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:03.460220 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028c5c0-5072-4fd0-9a90-d69b0d4f2471 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:03.465410 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12945e-e8cd-423f-a3f3-42cb04a64bd6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:03.468388 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ad12945e-e8cd-423f-a3f3-42cb04a64bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:03.472438 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4258f22-0c81-419e-8599-815a697a2c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:03.473515 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4258f22-0c81-419e-8599-815a697a2c4a admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:03.473820 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4258f22-0c81-419e-8599-815a697a2c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:03.474566 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4258f22-0c81-419e-8599-815a697a2c4a admin admin] PATH_INFO: `/v3/projects/13e3120e771e40bd9a549071e3f3f219/users/2e066246cbeb4e4b8d976f7475cfad76/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:03.496282 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12945e-e8cd-423f-a3f3-42cb04a64bd6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:03.498053 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4258f22-0c81-419e-8599-815a697a2c4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e3120e771e40bd9a549071e3f3f219, user_id=2e066246cbeb4e4b8d976f7475cfad76, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:03.503512 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4258f22-0c81-419e-8599-815a697a2c4a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:03.520470 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36054c-6317-4b31-8921-cd971b96d440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:03.521505 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36054c-6317-4b31-8921-cd971b96d440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:03.521822 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36054c-6317-4b31-8921-cd971b96d440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:03.522103 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36054c-6317-4b31-8921-cd971b96d440 admin admin] PATH_INFO: `/v3/projects/98d2732d47d2485796a010db2db49b1d` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:03.526051 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36054c-6317-4b31-8921-cd971b96d440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98d2732d47d2485796a010db2db49b1d)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:03.530426 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 977/1973] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:03 2022] PUT /identity/v3/projects/13e3120e771e40bd9a549071e3f3f219/users/2e066246cbeb4e4b8d976f7475cfad76/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:41:03.536207 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44926a35-b6fb-42eb-ba8c-6b93b78ec29f None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:03.536747 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44926a35-b6fb-42eb-ba8c-6b93b78ec29f None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:03.537139 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44926a35-b6fb-42eb-ba8c-6b93b78ec29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:03.542860 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d36054c-6317-4b31-8921-cd971b96d440 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:03.601196 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-44926a35-b6fb-42eb-ba8c-6b93b78ec29f None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:03.602512 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-44926a35-b6fb-42eb-ba8c-6b93b78ec29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:03.670466 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5d36054c-6317-4b31-8921-cd971b96d440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98d2732d47d2485796a010db2db49b1d', 'request_id': 'req-5d36054c-6317-4b31-8921-cd971b96d440'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:03.679594 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5d36054c-6317-4b31-8921-cd971b96d440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98d2732d47d2485796a010db2db49b1d', 'request_id': 'req-5d36054c-6317-4b31-8921-cd971b96d440'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:03.686808 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 978/1974] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:03.686808 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44926a35-b6fb-42eb-ba8c-6b93b78ec29f None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:03.688061 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-44926a35-b6fb-42eb-ba8c-6b93b78ec29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:03.693278 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5d36054c-6317-4b31-8921-cd971b96d440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98d2732d47d2485796a010db2db49b1d', 'request_id': 'req-5d36054c-6317-4b31-8921-cd971b96d440'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:03.712709 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44926a35-b6fb-42eb-ba8c-6b93b78ec29f None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:03.719391 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5d36054c-6317-4b31-8921-cd971b96d440 admin admin] The token cache is being invalidate because project 98d2732d47d2485796a010db2db49b1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:03.722370 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5d36054c-6317-4b31-8921-cd971b96d440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:03.724803 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5d36054c-6317-4b31-8921-cd971b96d440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:03.731721 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 997/1975] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:03 2022] DELETE /identity/v3/projects/98d2732d47d2485796a010db2db49b1d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:03.732432 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36054c-6317-4b31-8921-cd971b96d440 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:03.734050 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5d36054c-6317-4b31-8921-cd971b96d440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:03.813359 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf49d6-ff34-4308-b97c-903d8d18447e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:03.814077 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf49d6-ff34-4308-b97c-903d8d18447e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:03.814421 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf49d6-ff34-4308-b97c-903d8d18447e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:03.814765 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf49d6-ff34-4308-b97c-903d8d18447e admin admin] PATH_INFO: `/v3/projects/88ba48b41a314e9b8d94d922a768583c` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:03.816949 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf49d6-ff34-4308-b97c-903d8d18447e admin admin] RBAC: Authorizing `identity:delete_project(project_id=88ba48b41a314e9b8d94d922a768583c)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:03.819472 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf49d6-ff34-4308-b97c-903d8d18447e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:03.831940 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36054c-6317-4b31-8921-cd971b96d440 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:03.835539 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec67c6-c207-454b-b993-2f5c1358c776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:03.836228 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec67c6-c207-454b-b993-2f5c1358c776 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:03.836492 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec67c6-c207-454b-b993-2f5c1358c776 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:03.836762 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec67c6-c207-454b-b993-2f5c1358c776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:03.838595 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-20ec67c6-c207-454b-b993-2f5c1358c776 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:03.851064 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec67c6-c207-454b-b993-2f5c1358c776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:03.853214 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec67c6-c207-454b-b993-2f5c1358c776 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:03.864193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 998/1976] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:03.865178 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec67c6-c207-454b-b993-2f5c1358c776 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:03.866567 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-20ec67c6-c207-454b-b993-2f5c1358c776 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:03.869863 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-38bf49d6-ff34-4308-b97c-903d8d18447e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88ba48b41a314e9b8d94d922a768583c', 'request_id': 'req-38bf49d6-ff34-4308-b97c-903d8d18447e'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:03.878774 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-38bf49d6-ff34-4308-b97c-903d8d18447e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88ba48b41a314e9b8d94d922a768583c', 'request_id': 'req-38bf49d6-ff34-4308-b97c-903d8d18447e'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:03.879489 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec67c6-c207-454b-b993-2f5c1358c776 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:03.886107 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-38bf49d6-ff34-4308-b97c-903d8d18447e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88ba48b41a314e9b8d94d922a768583c', 'request_id': 'req-38bf49d6-ff34-4308-b97c-903d8d18447e'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:03.897543 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-38bf49d6-ff34-4308-b97c-903d8d18447e admin admin] The token cache is being invalidate because project 88ba48b41a314e9b8d94d922a768583c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:03.897835 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-38bf49d6-ff34-4308-b97c-903d8d18447e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:03.898793 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-38bf49d6-ff34-4308-b97c-903d8d18447e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:03.901688 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 979/1977] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:03 2022] DELETE /identity/v3/projects/88ba48b41a314e9b8d94d922a768583c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:03.905461 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf49d6-ff34-4308-b97c-903d8d18447e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:03.906786 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-38bf49d6-ff34-4308-b97c-903d8d18447e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:03.943033 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26a23a-5362-4603-85dd-6fe6308f2545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:03.943905 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26a23a-5362-4603-85dd-6fe6308f2545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:03.944191 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26a23a-5362-4603-85dd-6fe6308f2545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:03.944478 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26a23a-5362-4603-85dd-6fe6308f2545 admin admin] PATH_INFO: `/v3/users/4c494ef798d74d12836e51e94e22887d` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:03.945723 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26a23a-5362-4603-85dd-6fe6308f2545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c494ef798d74d12836e51e94e22887d)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:03.947712 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26a23a-5362-4603-85dd-6fe6308f2545 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:03.982950 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf49d6-ff34-4308-b97c-903d8d18447e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:03.989185 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcf2ab-0c4e-48ac-b09e-0e377770d63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:03.990052 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcf2ab-0c4e-48ac-b09e-0e377770d63e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:03.990328 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcf2ab-0c4e-48ac-b09e-0e377770d63e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:03.990672 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcf2ab-0c4e-48ac-b09e-0e377770d63e admin admin] PATH_INFO: `/v3/users/0cbf2de18b3f40fab6a499f90796e5a0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:03.992090 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcf2ab-0c4e-48ac-b09e-0e377770d63e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cbf2de18b3f40fab6a499f90796e5a0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:03.994116 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbcf2ab-0c4e-48ac-b09e-0e377770d63e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:03.997966 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-cd26a23a-5362-4603-85dd-6fe6308f2545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c494ef798d74d12836e51e94e22887d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.005704 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-cd26a23a-5362-4603-85dd-6fe6308f2545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c494ef798d74d12836e51e94e22887d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.006553 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-cd26a23a-5362-4603-85dd-6fe6308f2545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c494ef798d74d12836e51e94e22887d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.019728 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-cd26a23a-5362-4603-85dd-6fe6308f2545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c494ef798d74d12836e51e94e22887d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.038160 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-cd26a23a-5362-4603-85dd-6fe6308f2545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c494ef798d74d12836e51e94e22887d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.048458 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-4cbcf2ab-0c4e-48ac-b09e-0e377770d63e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cbf2de18b3f40fab6a499f90796e5a0'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.048614 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 999/1978] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:03 2022] DELETE /identity/v3/users/4c494ef798d74d12836e51e94e22887d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:04.057348 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-4cbcf2ab-0c4e-48ac-b09e-0e377770d63e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cbf2de18b3f40fab6a499f90796e5a0'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.058189 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-4cbcf2ab-0c4e-48ac-b09e-0e377770d63e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cbf2de18b3f40fab6a499f90796e5a0'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.071226 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-4cbcf2ab-0c4e-48ac-b09e-0e377770d63e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cbf2de18b3f40fab6a499f90796e5a0'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.079665 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-4cbcf2ab-0c4e-48ac-b09e-0e377770d63e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cbf2de18b3f40fab6a499f90796e5a0'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.092439 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 980/1979] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:03 2022] DELETE /identity/v3/users/0cbf2de18b3f40fab6a499f90796e5a0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:41:04.523488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26a23a-5362-4603-85dd-6fe6308f2545 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:04.526107 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-cd26a23a-5362-4603-85dd-6fe6308f2545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:04.540476 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcf2ab-0c4e-48ac-b09e-0e377770d63e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:04.542068 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-4cbcf2ab-0c4e-48ac-b09e-0e377770d63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:04.642689 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26a23a-5362-4603-85dd-6fe6308f2545 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:04.643938 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcf2ab-0c4e-48ac-b09e-0e377770d63e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:04.647839 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d785e-30da-48c0-8c86-f8b0d7e92088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:04.648670 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c78966-01da-4690-b44b-e9a99ac450f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:04.648789 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d785e-30da-48c0-8c86-f8b0d7e92088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:04.648979 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d785e-30da-48c0-8c86-f8b0d7e92088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:04.649592 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d785e-30da-48c0-8c86-f8b0d7e92088 admin admin] PATH_INFO: `/v3/projects/0ad48dd3b18a4a60b67f270c1d7d3e5b` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:04.649835 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c78966-01da-4690-b44b-e9a99ac450f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:04.650117 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c78966-01da-4690-b44b-e9a99ac450f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:04.650447 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c78966-01da-4690-b44b-e9a99ac450f4 admin admin] PATH_INFO: `/v3/projects/05309a1376b64d6283b83645d593f1d3` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:04.651073 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d785e-30da-48c0-8c86-f8b0d7e92088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ad48dd3b18a4a60b67f270c1d7d3e5b)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:04.651675 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c78966-01da-4690-b44b-e9a99ac450f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05309a1376b64d6283b83645d593f1d3)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:04.653276 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d785e-30da-48c0-8c86-f8b0d7e92088 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:04.653671 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c78966-01da-4690-b44b-e9a99ac450f4 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:04.708241 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-052d785e-30da-48c0-8c86-f8b0d7e92088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ad48dd3b18a4a60b67f270c1d7d3e5b', 'request_id': 'req-052d785e-30da-48c0-8c86-f8b0d7e92088'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.708777 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-58c78966-01da-4690-b44b-e9a99ac450f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05309a1376b64d6283b83645d593f1d3', 'request_id': 'req-58c78966-01da-4690-b44b-e9a99ac450f4'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.714915 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-052d785e-30da-48c0-8c86-f8b0d7e92088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ad48dd3b18a4a60b67f270c1d7d3e5b', 'request_id': 'req-052d785e-30da-48c0-8c86-f8b0d7e92088'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.718320 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-58c78966-01da-4690-b44b-e9a99ac450f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05309a1376b64d6283b83645d593f1d3', 'request_id': 'req-58c78966-01da-4690-b44b-e9a99ac450f4'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.724140 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-052d785e-30da-48c0-8c86-f8b0d7e92088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ad48dd3b18a4a60b67f270c1d7d3e5b', 'request_id': 'req-052d785e-30da-48c0-8c86-f8b0d7e92088'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.727495 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-58c78966-01da-4690-b44b-e9a99ac450f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05309a1376b64d6283b83645d593f1d3', 'request_id': 'req-58c78966-01da-4690-b44b-e9a99ac450f4'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.739376 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-052d785e-30da-48c0-8c86-f8b0d7e92088 admin admin] The token cache is being invalidate because project 0ad48dd3b18a4a60b67f270c1d7d3e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:04.739669 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-052d785e-30da-48c0-8c86-f8b0d7e92088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.740350 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-58c78966-01da-4690-b44b-e9a99ac450f4 admin admin] The token cache is being invalidate because project 05309a1376b64d6283b83645d593f1d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:04.740854 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-58c78966-01da-4690-b44b-e9a99ac450f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.741137 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-052d785e-30da-48c0-8c86-f8b0d7e92088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.741826 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-58c78966-01da-4690-b44b-e9a99ac450f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.747534 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1000/1980] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:04 2022] DELETE /identity/v3/projects/0ad48dd3b18a4a60b67f270c1d7d3e5b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:04.747720 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 981/1981] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:04 2022] DELETE /identity/v3/projects/05309a1376b64d6283b83645d593f1d3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:41:04.747720 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c78966-01da-4690-b44b-e9a99ac450f4 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:04.747890 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e9ecb-95be-4c76-b6b8-33f8a9cb361f None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:04.747890 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e9ecb-95be-4c76-b6b8-33f8a9cb361f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:04.747890 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e9ecb-95be-4c76-b6b8-33f8a9cb361f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:04.748130 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-58c78966-01da-4690-b44b-e9a99ac450f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:04.782506 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-f15e9ecb-95be-4c76-b6b8-33f8a9cb361f None None] MFA Rules not processed for user `2e066246cbeb4e4b8d976f7475cfad76`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:04.784521 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f15e9ecb-95be-4c76-b6b8-33f8a9cb361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:04.843428 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c78966-01da-4690-b44b-e9a99ac450f4 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:04.848730 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea41968-16b0-456d-a07c-bc7982453028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:04.849638 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea41968-16b0-456d-a07c-bc7982453028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:04.849922 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea41968-16b0-456d-a07c-bc7982453028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:04.850194 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea41968-16b0-456d-a07c-bc7982453028 admin admin] PATH_INFO: `/v3/users/09901ed9b8144ec8a7ed015c21c329d2` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:04.851431 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea41968-16b0-456d-a07c-bc7982453028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09901ed9b8144ec8a7ed015c21c329d2)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:04.853672 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea41968-16b0-456d-a07c-bc7982453028 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:04.888544 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1001/1982] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:04.888544 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42537b55-01c7-435a-a3be-09fb432cf48f None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:04.888544 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42537b55-01c7-435a-a3be-09fb432cf48f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:04.888544 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42537b55-01c7-435a-a3be-09fb432cf48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:04.918047 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-42537b55-01c7-435a-a3be-09fb432cf48f None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:04.919316 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-42537b55-01c7-435a-a3be-09fb432cf48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:04.920107 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6ea41968-16b0-456d-a07c-bc7982453028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09901ed9b8144ec8a7ed015c21c329d2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.928280 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6ea41968-16b0-456d-a07c-bc7982453028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09901ed9b8144ec8a7ed015c21c329d2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.929023 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6ea41968-16b0-456d-a07c-bc7982453028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09901ed9b8144ec8a7ed015c21c329d2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.933152 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1002/1983] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:04.934854 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172669f-fc84-448b-9104-912b1b4f10a0 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:04.936419 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172669f-fc84-448b-9104-912b1b4f10a0 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:04.936836 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d172669f-fc84-448b-9104-912b1b4f10a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:04.945292 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6ea41968-16b0-456d-a07c-bc7982453028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09901ed9b8144ec8a7ed015c21c329d2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.954227 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6ea41968-16b0-456d-a07c-bc7982453028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09901ed9b8144ec8a7ed015c21c329d2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:04.960127 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d172669f-fc84-448b-9104-912b1b4f10a0 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:04.961371 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d172669f-fc84-448b-9104-912b1b4f10a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:04.963236 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 982/1984] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:04 2022] DELETE /identity/v3/users/09901ed9b8144ec8a7ed015c21c329d2 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:04.964302 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea41968-16b0-456d-a07c-bc7982453028 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:04.966076 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-6ea41968-16b0-456d-a07c-bc7982453028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:05.043641 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea41968-16b0-456d-a07c-bc7982453028 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:05.048389 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb251d77-fa11-4097-bc0f-739a51cc867e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:05.049070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb251d77-fa11-4097-bc0f-739a51cc867e admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.049209 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1003/1985] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:05.049480 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb251d77-fa11-4097-bc0f-739a51cc867e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.050214 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb251d77-fa11-4097-bc0f-739a51cc867e admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.050919 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb251d77-fa11-4097-bc0f-739a51cc867e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:05.051932 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954153c-d91f-491b-87c4-116ff4244b75 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.052225 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954153c-d91f-491b-87c4-116ff4244b75 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.052643 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954153c-d91f-491b-87c4-116ff4244b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.052820 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb251d77-fa11-4097-bc0f-739a51cc867e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:05.071628 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a954153c-d91f-491b-87c4-116ff4244b75 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:05.073216 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a954153c-d91f-491b-87c4-116ff4244b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:05.082495 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1004/1986] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:05.084305 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbdb7d-ba56-493d-a551-809cbb485ebb None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.084692 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbdb7d-ba56-493d-a551-809cbb485ebb None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.085201 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fbdb7d-ba56-493d-a551-809cbb485ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.087411 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 983/1987] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:04 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:05.089282 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc9dbf-3e11-412a-9fc8-095ab22c0542 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.089923 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc9dbf-3e11-412a-9fc8-095ab22c0542 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.090358 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc9dbf-3e11-412a-9fc8-095ab22c0542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.106585 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-95fbdb7d-ba56-493d-a551-809cbb485ebb None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:05.107887 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-95fbdb7d-ba56-493d-a551-809cbb485ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:05.109234 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-88cc9dbf-3e11-412a-9fc8-095ab22c0542 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:05.110822 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-88cc9dbf-3e11-412a-9fc8-095ab22c0542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:05.172497 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 984/1988] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:05.173449 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc9dbf-3e11-412a-9fc8-095ab22c0542 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:05.174612 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1005/1989] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:05.175407 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fbdb7d-ba56-493d-a551-809cbb485ebb None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:05.183472 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc9dbf-3e11-412a-9fc8-095ab22c0542 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:05.184841 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fbdb7d-ba56-493d-a551-809cbb485ebb None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:05.188456 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f7306-b8d6-47b8-84bc-bc70614ccf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:05.189203 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f7306-b8d6-47b8-84bc-bc70614ccf8b admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.189508 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fb407-41b6-426e-a721-82de7bbbb718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:05.189633 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f7306-b8d6-47b8-84bc-bc70614ccf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.189941 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f7306-b8d6-47b8-84bc-bc70614ccf8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.190200 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fb407-41b6-426e-a721-82de7bbbb718 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.190487 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fb407-41b6-426e-a721-82de7bbbb718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.190767 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178fb407-41b6-426e-a721-82de7bbbb718 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.191015 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f7306-b8d6-47b8-84bc-bc70614ccf8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:41:05.191381 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f7306-b8d6-47b8-84bc-bc70614ccf8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:05.191578 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178fb407-41b6-426e-a721-82de7bbbb718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:05.193209 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f7306-b8d6-47b8-84bc-bc70614ccf8b admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:05.193533 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178fb407-41b6-426e-a721-82de7bbbb718 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:05.204953 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 985/1990] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:41:05.207674 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f7306-b8d6-47b8-84bc-bc70614ccf8b admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:05.215791 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f7306-b8d6-47b8-84bc-bc70614ccf8b admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:05.218719 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1006/1991] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:05 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:05.218719 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fb407-41b6-426e-a721-82de7bbbb718 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:05.218719 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-178fb407-41b6-426e-a721-82de7bbbb718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:05.220489 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed634b-8265-4022-8510-98d96cd29473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:05.221165 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed634b-8265-4022-8510-98d96cd29473 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.222024 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed634b-8265-4022-8510-98d96cd29473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.222306 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed634b-8265-4022-8510-98d96cd29473 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.223031 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed634b-8265-4022-8510-98d96cd29473 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:41:05.223333 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed634b-8265-4022-8510-98d96cd29473 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:05.224905 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed634b-8265-4022-8510-98d96cd29473 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:05.237113 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 986/1992] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:41:05.237989 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed634b-8265-4022-8510-98d96cd29473 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:05.247300 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed634b-8265-4022-8510-98d96cd29473 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:05.251891 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831b2b4-ee56-4be4-ae16-10786daff854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:05.252542 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831b2b4-ee56-4be4-ae16-10786daff854 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.252968 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831b2b4-ee56-4be4-ae16-10786daff854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.253276 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831b2b4-ee56-4be4-ae16-10786daff854 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.253998 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831b2b4-ee56-4be4-ae16-10786daff854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:05.256065 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831b2b4-ee56-4be4-ae16-10786daff854 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:05.275199 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178fb407-41b6-426e-a721-82de7bbbb718 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:05.279342 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3df9c8-2f60-4de1-96b5-8f15e948b31f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:05.279997 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3df9c8-2f60-4de1-96b5-8f15e948b31f service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.280271 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3df9c8-2f60-4de1-96b5-8f15e948b31f service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.280548 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3df9c8-2f60-4de1-96b5-8f15e948b31f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.288269 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 987/1993] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:05 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:05.288269 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831b2b4-ee56-4be4-ae16-10786daff854 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:05.290449 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3df9c8-2f60-4de1-96b5-8f15e948b31f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:05.291915 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3df9c8-2f60-4de1-96b5-8f15e948b31f service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:05.301197 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1007/1994] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:05.302018 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3df9c8-2f60-4de1-96b5-8f15e948b31f service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:05.311488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3df9c8-2f60-4de1-96b5-8f15e948b31f service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:05.348310 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831b2b4-ee56-4be4-ae16-10786daff854 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:05.354337 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58771ef2-e165-465c-b4c0-524b11f3d046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:05.355122 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58771ef2-e165-465c-b4c0-524b11f3d046 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.355368 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58771ef2-e165-465c-b4c0-524b11f3d046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.355623 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58771ef2-e165-465c-b4c0-524b11f3d046 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.356438 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58771ef2-e165-465c-b4c0-524b11f3d046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:05.358084 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58771ef2-e165-465c-b4c0-524b11f3d046 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:05.368792 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 988/1995] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:05.369466 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58771ef2-e165-465c-b4c0-524b11f3d046 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:05.373574 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c862902-60ab-4a29-ba6c-7d48866171e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:05.374296 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c862902-60ab-4a29-ba6c-7d48866171e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.374637 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c862902-60ab-4a29-ba6c-7d48866171e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.374944 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c862902-60ab-4a29-ba6c-7d48866171e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.375761 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c862902-60ab-4a29-ba6c-7d48866171e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:05.378039 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c862902-60ab-4a29-ba6c-7d48866171e8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:05.380093 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58771ef2-e165-465c-b4c0-524b11f3d046 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:05.386987 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c9e5f-1115-441a-a10c-a095142b15de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:05.387664 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c9e5f-1115-441a-a10c-a095142b15de admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.387942 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c9e5f-1115-441a-a10c-a095142b15de admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.388716 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c9e5f-1115-441a-a10c-a095142b15de admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.389488 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c9e5f-1115-441a-a10c-a095142b15de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:05.391508 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c9e5f-1115-441a-a10c-a095142b15de admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:05.406449 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1008/1996] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:05 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:05.407644 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c862902-60ab-4a29-ba6c-7d48866171e8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:05.416482 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 989/1997] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:05 2022] POST /identity/v3/users => generated 294 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:05.418025 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c9e5f-1115-441a-a10c-a095142b15de admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:05.428479 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c9e5f-1115-441a-a10c-a095142b15de admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:05.480374 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c862902-60ab-4a29-ba6c-7d48866171e8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:05.489720 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7fce1-222b-47d6-b629-c3ad4ad2b8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:05.490588 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7fce1-222b-47d6-b629-c3ad4ad2b8cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.490872 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7fce1-222b-47d6-b629-c3ad4ad2b8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.491190 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7fce1-222b-47d6-b629-c3ad4ad2b8cf admin admin] PATH_INFO: `/v3/projects/2d052ad078b94ae6a9e460493d45f890/users/49c46b03cf334810854dcc02c734ca54/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.500356 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e022041-c5cd-46ae-b744-c96065ecf886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:05.500698 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e022041-c5cd-46ae-b744-c96065ecf886 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.500984 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e022041-c5cd-46ae-b744-c96065ecf886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.501295 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e022041-c5cd-46ae-b744-c96065ecf886 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.501995 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e022041-c5cd-46ae-b744-c96065ecf886 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:05.504481 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e022041-c5cd-46ae-b744-c96065ecf886 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:05.508215 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7fce1-222b-47d6-b629-c3ad4ad2b8cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d052ad078b94ae6a9e460493d45f890, user_id=49c46b03cf334810854dcc02c734ca54, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:05.511047 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7fce1-222b-47d6-b629-c3ad4ad2b8cf admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:05.528608 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1009/1998] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:05 2022] PUT /identity/v3/projects/2d052ad078b94ae6a9e460493d45f890/users/49c46b03cf334810854dcc02c734ca54/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:05.528781 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 990/1999] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:05 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:05.529731 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e022041-c5cd-46ae-b744-c96065ecf886 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:05.529844 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7fce1-222b-47d6-b629-c3ad4ad2b8cf admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:05.540704 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e022041-c5cd-46ae-b744-c96065ecf886 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:05.603745 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60393fd5-6579-4885-ae3f-0ecf3c25771f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:05.604627 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7fce1-222b-47d6-b629-c3ad4ad2b8cf admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:05.604770 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60393fd5-6579-4885-ae3f-0ecf3c25771f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.605067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60393fd5-6579-4885-ae3f-0ecf3c25771f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.605459 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60393fd5-6579-4885-ae3f-0ecf3c25771f admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.606317 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60393fd5-6579-4885-ae3f-0ecf3c25771f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:05.608703 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60393fd5-6579-4885-ae3f-0ecf3c25771f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:05.610373 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864b326-5c2f-4317-90df-ce14bfd91519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:05.611137 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864b326-5c2f-4317-90df-ce14bfd91519 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.611369 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864b326-5c2f-4317-90df-ce14bfd91519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.611651 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864b326-5c2f-4317-90df-ce14bfd91519 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.612974 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864b326-5c2f-4317-90df-ce14bfd91519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:05.614657 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864b326-5c2f-4317-90df-ce14bfd91519 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:05.620582 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 991/2000] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:41:05.621723 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60393fd5-6579-4885-ae3f-0ecf3c25771f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:05.631128 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1010/2001] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:05.631128 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864b326-5c2f-4317-90df-ce14bfd91519 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:05.632654 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1864b326-5c2f-4317-90df-ce14bfd91519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:05.637811 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60393fd5-6579-4885-ae3f-0ecf3c25771f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:05.642493 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e1b3b-83bc-4b0a-8fcb-215c90a7f86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:05.643179 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e1b3b-83bc-4b0a-8fcb-215c90a7f86c admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.643464 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e1b3b-83bc-4b0a-8fcb-215c90a7f86c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.643737 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e1b3b-83bc-4b0a-8fcb-215c90a7f86c admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.644467 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e1b3b-83bc-4b0a-8fcb-215c90a7f86c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:05.645578 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864b326-5c2f-4317-90df-ce14bfd91519 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:05.646068 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e1b3b-83bc-4b0a-8fcb-215c90a7f86c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:05.650500 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6327389-23eb-4f53-81c8-494e98501aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:05.651346 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6327389-23eb-4f53-81c8-494e98501aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.651625 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6327389-23eb-4f53-81c8-494e98501aef admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.651899 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6327389-23eb-4f53-81c8-494e98501aef admin admin] PATH_INFO: `/v3/projects/915012252b8646078a28c9423c2b1cc9` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.653115 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6327389-23eb-4f53-81c8-494e98501aef admin admin] RBAC: Authorizing `identity:delete_project(project_id=915012252b8646078a28c9423c2b1cc9)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:05.655088 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6327389-23eb-4f53-81c8-494e98501aef admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:05.656299 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 992/2002] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:05.657418 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e1b3b-83bc-4b0a-8fcb-215c90a7f86c admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:05.667860 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e1b3b-83bc-4b0a-8fcb-215c90a7f86c admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:05.672493 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdd5f4-02d2-4de6-9841-a6511106bdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:05.673391 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdd5f4-02d2-4de6-9841-a6511106bdc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.673670 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdd5f4-02d2-4de6-9841-a6511106bdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.673942 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdd5f4-02d2-4de6-9841-a6511106bdc4 admin admin] PATH_INFO: `/v3/projects/2d052ad078b94ae6a9e460493d45f890/users/49c46b03cf334810854dcc02c734ca54/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.676452 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bdd5f4-02d2-4de6-9841-a6511106bdc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d052ad078b94ae6a9e460493d45f890, user_id=49c46b03cf334810854dcc02c734ca54, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:05.679113 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bdd5f4-02d2-4de6-9841-a6511106bdc4 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:05.690567 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 993/2003] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:05 2022] PUT /identity/v3/projects/2d052ad078b94ae6a9e460493d45f890/users/49c46b03cf334810854dcc02c734ca54/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:05.693873 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdd5f4-02d2-4de6-9841-a6511106bdc4 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:05.704445 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e6327389-23eb-4f53-81c8-494e98501aef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '915012252b8646078a28c9423c2b1cc9', 'request_id': 'req-e6327389-23eb-4f53-81c8-494e98501aef'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:05.710835 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e6327389-23eb-4f53-81c8-494e98501aef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '915012252b8646078a28c9423c2b1cc9', 'request_id': 'req-e6327389-23eb-4f53-81c8-494e98501aef'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:05.718707 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e6327389-23eb-4f53-81c8-494e98501aef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '915012252b8646078a28c9423c2b1cc9', 'request_id': 'req-e6327389-23eb-4f53-81c8-494e98501aef'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:05.729656 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e6327389-23eb-4f53-81c8-494e98501aef admin admin] The token cache is being invalidate because project 915012252b8646078a28c9423c2b1cc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:05.729971 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e6327389-23eb-4f53-81c8-494e98501aef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:05.730649 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e6327389-23eb-4f53-81c8-494e98501aef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:05.732262 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1011/2004] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:05 2022] DELETE /identity/v3/projects/915012252b8646078a28c9423c2b1cc9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:05.735535 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6327389-23eb-4f53-81c8-494e98501aef admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:05.735535 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e6327389-23eb-4f53-81c8-494e98501aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:05.762687 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdd5f4-02d2-4de6-9841-a6511106bdc4 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:05.802821 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6327389-23eb-4f53-81c8-494e98501aef admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:05.808312 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1908e86-8dd4-4b37-9200-f2ad42ebb32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:05.808985 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1908e86-8dd4-4b37-9200-f2ad42ebb32b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.809841 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1908e86-8dd4-4b37-9200-f2ad42ebb32b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.809841 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1908e86-8dd4-4b37-9200-f2ad42ebb32b admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.810350 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1908e86-8dd4-4b37-9200-f2ad42ebb32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:05.812038 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1908e86-8dd4-4b37-9200-f2ad42ebb32b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:05.822531 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1012/2005] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:05.823203 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1908e86-8dd4-4b37-9200-f2ad42ebb32b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:05.825185 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b1908e86-8dd4-4b37-9200-f2ad42ebb32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:05.827112 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee541d-2967-418a-a9dc-f4fad58015fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:05.827986 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee541d-2967-418a-a9dc-f4fad58015fe admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.828413 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee541d-2967-418a-a9dc-f4fad58015fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.828694 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee541d-2967-418a-a9dc-f4fad58015fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.829544 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee541d-2967-418a-a9dc-f4fad58015fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:05.831208 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee541d-2967-418a-a9dc-f4fad58015fe admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:05.839998 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1908e86-8dd4-4b37-9200-f2ad42ebb32b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:05.842146 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 994/2006] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:05.842947 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee541d-2967-418a-a9dc-f4fad58015fe admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:05.850780 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d78ef-dc94-4fdd-9071-491734931a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:05.851841 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d78ef-dc94-4fdd-9071-491734931a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.852066 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d78ef-dc94-4fdd-9071-491734931a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.852337 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d78ef-dc94-4fdd-9071-491734931a25 admin admin] PATH_INFO: `/v3/users/b66410c9dc714fe3a22b5b15aa5a8b0d` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.854784 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d78ef-dc94-4fdd-9071-491734931a25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b66410c9dc714fe3a22b5b15aa5a8b0d)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:05.857069 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d78ef-dc94-4fdd-9071-491734931a25 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:05.858970 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee541d-2967-418a-a9dc-f4fad58015fe admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:05.864646 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04b5be-51ec-4042-94cd-426dab75b80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:05.865596 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04b5be-51ec-4042-94cd-426dab75b80f admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.866013 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04b5be-51ec-4042-94cd-426dab75b80f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.866157 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a04b5be-51ec-4042-94cd-426dab75b80f admin admin] PATH_INFO: `/v3/projects/11842d8563464d73932aa00ec7cb473c/users/45f22fa15a1d44fb8a2a3e687d28d306/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.887705 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04b5be-51ec-4042-94cd-426dab75b80f admin admin] RBAC: Authorizing `identity:create_grant(project_id=11842d8563464d73932aa00ec7cb473c, user_id=45f22fa15a1d44fb8a2a3e687d28d306, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:05.890482 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a04b5be-51ec-4042-94cd-426dab75b80f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:05.906306 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 995/2007] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:05 2022] PUT /identity/v3/projects/11842d8563464d73932aa00ec7cb473c/users/45f22fa15a1d44fb8a2a3e687d28d306/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:05.907127 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04b5be-51ec-4042-94cd-426dab75b80f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:05.909735 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-0a04b5be-51ec-4042-94cd-426dab75b80f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:05.924032 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ce7d78ef-dc94-4fdd-9071-491734931a25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b66410c9dc714fe3a22b5b15aa5a8b0d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:05.933985 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ce7d78ef-dc94-4fdd-9071-491734931a25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b66410c9dc714fe3a22b5b15aa5a8b0d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:05.934491 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ce7d78ef-dc94-4fdd-9071-491734931a25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b66410c9dc714fe3a22b5b15aa5a8b0d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:05.947596 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ce7d78ef-dc94-4fdd-9071-491734931a25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b66410c9dc714fe3a22b5b15aa5a8b0d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:05.956947 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-ce7d78ef-dc94-4fdd-9071-491734931a25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b66410c9dc714fe3a22b5b15aa5a8b0d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:05.967284 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1013/2008] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:05 2022] DELETE /identity/v3/users/b66410c9dc714fe3a22b5b15aa5a8b0d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:05.967284 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0cf8c-8532-4b0e-9339-66ce7a8d5347 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:05.976471 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0cf8c-8532-4b0e-9339-66ce7a8d5347 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:05.976748 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0cf8c-8532-4b0e-9339-66ce7a8d5347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:05.985153 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a04b5be-51ec-4042-94cd-426dab75b80f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:06.006089 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-57d0cf8c-8532-4b0e-9339-66ce7a8d5347 None None] MFA Rules not processed for user `45f22fa15a1d44fb8a2a3e687d28d306`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:06.007426 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-57d0cf8c-8532-4b0e-9339-66ce7a8d5347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:06.060862 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca2fa4-e4b8-491a-a2d7-e7920d567af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:06.062154 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca2fa4-e4b8-491a-a2d7-e7920d567af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:06.062406 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca2fa4-e4b8-491a-a2d7-e7920d567af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:06.062684 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca2fa4-e4b8-491a-a2d7-e7920d567af8 admin admin] PATH_INFO: `/v3/projects/2278253199944f17bad265482c42298f/users/d205800622fe4f13b03f2ff06a62ec7f/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:06.082215 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca2fa4-e4b8-491a-a2d7-e7920d567af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2278253199944f17bad265482c42298f, user_id=d205800622fe4f13b03f2ff06a62ec7f, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:06.092556 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca2fa4-e4b8-491a-a2d7-e7920d567af8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:06.125299 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 996/2009] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:05 2022] PUT /identity/v3/projects/2278253199944f17bad265482c42298f/users/d205800622fe4f13b03f2ff06a62ec7f/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:06.134249 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b2757-8dee-44f7-a3af-270761f2e39f None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:06.134694 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b2757-8dee-44f7-a3af-270761f2e39f None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:06.135077 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b2757-8dee-44f7-a3af-270761f2e39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:06.177128 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-0d1b2757-8dee-44f7-a3af-270761f2e39f None None] MFA Rules not processed for user `d205800622fe4f13b03f2ff06a62ec7f`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:06.178748 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-0d1b2757-8dee-44f7-a3af-270761f2e39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:06.180190 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1014/2010] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:06.192901 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0cf8c-8532-4b0e-9339-66ce7a8d5347 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:06.194314 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-57d0cf8c-8532-4b0e-9339-66ce7a8d5347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:06.259723 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 997/2011] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:06.263235 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0cf8c-8532-4b0e-9339-66ce7a8d5347 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:06.265837 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b2757-8dee-44f7-a3af-270761f2e39f None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:06.267650 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-0d1b2757-8dee-44f7-a3af-270761f2e39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:06.326957 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a594ab-7426-44ce-a751-cc0147e08293 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6940472eb8e544c8aa3409328c804282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:06.327768 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a594ab-7426-44ce-a751-cc0147e08293 service glance] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:06.328424 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a594ab-7426-44ce-a751-cc0147e08293 service glance] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:06.328635 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a594ab-7426-44ce-a751-cc0147e08293 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:06.340664 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b2757-8dee-44f7-a3af-270761f2e39f None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:06.345903 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aaf7ef-2c10-4447-9572-24cc533b4d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:06.346755 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaf7ef-2c10-4447-9572-24cc533b4d03 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:06.347041 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaf7ef-2c10-4447-9572-24cc533b4d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:06.347318 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaf7ef-2c10-4447-9572-24cc533b4d03 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:06.348031 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aaf7ef-2c10-4447-9572-24cc533b4d03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:06.350038 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aaf7ef-2c10-4447-9572-24cc533b4d03 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:06.382373 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 998/2012] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:06 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:06.383684 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aaf7ef-2c10-4447-9572-24cc533b4d03 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:06.390350 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a594ab-7426-44ce-a751-cc0147e08293 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:06.392300 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a594ab-7426-44ce-a751-cc0147e08293 service glance] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:06.401824 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1015/2013] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:41:06.455209 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aaf7ef-2c10-4447-9572-24cc533b4d03 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:06.461894 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff499c-901c-4167-b3ba-8cfaa099125d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:06.462585 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff499c-901c-4167-b3ba-8cfaa099125d admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:06.462869 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff499c-901c-4167-b3ba-8cfaa099125d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:06.463147 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff499c-901c-4167-b3ba-8cfaa099125d admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:06.463885 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff499c-901c-4167-b3ba-8cfaa099125d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:06.465880 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff499c-901c-4167-b3ba-8cfaa099125d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:06.487868 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 999/2014] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:06 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:06.491979 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a594ab-7426-44ce-a751-cc0147e08293 service glance] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:06.506134 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a594ab-7426-44ce-a751-cc0147e08293 service glance] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:06.511271 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6827466-283e-4836-908a-2a365219900f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:06.511857 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6827466-283e-4836-908a-2a365219900f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:06.512126 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6827466-283e-4836-908a-2a365219900f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:06.512405 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6827466-283e-4836-908a-2a365219900f admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:06.513200 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6827466-283e-4836-908a-2a365219900f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:06.515016 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6827466-283e-4836-908a-2a365219900f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:06.529061 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1016/2015] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:41:06.531517 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff499c-901c-4167-b3ba-8cfaa099125d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:06.542945 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff499c-901c-4167-b3ba-8cfaa099125d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:06.548326 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3b737-0b9c-4a13-8217-45aeca283ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:06.549504 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3b737-0b9c-4a13-8217-45aeca283ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:06.550059 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3b737-0b9c-4a13-8217-45aeca283ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:06.550432 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3b737-0b9c-4a13-8217-45aeca283ea9 admin admin] PATH_INFO: `/v3/projects/701d76b667164b039373b275486b3abb/users/8c82ab28c0ed4d9faf0ae28c1465be09/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:06.569874 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3b737-0b9c-4a13-8217-45aeca283ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=701d76b667164b039373b275486b3abb, user_id=8c82ab28c0ed4d9faf0ae28c1465be09, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:06.572924 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3b737-0b9c-4a13-8217-45aeca283ea9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:06.589598 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1000/2016] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:06 2022] PUT /identity/v3/projects/701d76b667164b039373b275486b3abb/users/8c82ab28c0ed4d9faf0ae28c1465be09/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:06.593356 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6827466-283e-4836-908a-2a365219900f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:06.603810 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6827466-283e-4836-908a-2a365219900f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:06.668684 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce372365-127b-46c4-a6a2-6f8905330cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:06.669401 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce372365-127b-46c4-a6a2-6f8905330cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:06.669703 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce372365-127b-46c4-a6a2-6f8905330cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:06.669971 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce372365-127b-46c4-a6a2-6f8905330cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:06.670984 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce372365-127b-46c4-a6a2-6f8905330cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:06.672624 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce372365-127b-46c4-a6a2-6f8905330cc4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:06.683846 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1017/2017] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:06.688108 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3b737-0b9c-4a13-8217-45aeca283ea9 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:06.699160 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3b737-0b9c-4a13-8217-45aeca283ea9 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:06.705197 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebec8b1-856d-4bd1-97bd-d1f014deb9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:06.706627 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebec8b1-856d-4bd1-97bd-d1f014deb9b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:06.706911 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebec8b1-856d-4bd1-97bd-d1f014deb9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:06.707594 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebec8b1-856d-4bd1-97bd-d1f014deb9b9 admin admin] PATH_INFO: `/v3/projects/701d76b667164b039373b275486b3abb/users/8c82ab28c0ed4d9faf0ae28c1465be09/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:06.709239 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebec8b1-856d-4bd1-97bd-d1f014deb9b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=701d76b667164b039373b275486b3abb, user_id=8c82ab28c0ed4d9faf0ae28c1465be09, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:06.712473 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebec8b1-856d-4bd1-97bd-d1f014deb9b9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:06.725314 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1001/2018] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:06 2022] PUT /identity/v3/projects/701d76b667164b039373b275486b3abb/users/8c82ab28c0ed4d9faf0ae28c1465be09/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:41:06.737456 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7314f5-d64e-414e-91b7-d918788d713a None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:06.737998 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7314f5-d64e-414e-91b7-d918788d713a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:06.737998 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7314f5-d64e-414e-91b7-d918788d713a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:06.772877 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebec8b1-856d-4bd1-97bd-d1f014deb9b9 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:06.775265 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-aebec8b1-856d-4bd1-97bd-d1f014deb9b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:06.787278 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-cd7314f5-d64e-414e-91b7-d918788d713a None None] MFA Rules not processed for user `8c82ab28c0ed4d9faf0ae28c1465be09`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:06.799169 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-cd7314f5-d64e-414e-91b7-d918788d713a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:06.870382 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebec8b1-856d-4bd1-97bd-d1f014deb9b9 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:06.875632 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64804fe-ad68-4562-95ef-64e13a21865e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:06.876495 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64804fe-ad68-4562-95ef-64e13a21865e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:06.876944 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64804fe-ad68-4562-95ef-64e13a21865e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:06.877106 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64804fe-ad68-4562-95ef-64e13a21865e admin admin] PATH_INFO: `/v3/projects/ae15ebb18df34d78a085e7af450b7460` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:06.878536 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64804fe-ad68-4562-95ef-64e13a21865e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae15ebb18df34d78a085e7af450b7460)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:06.880547 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64804fe-ad68-4562-95ef-64e13a21865e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:06.918469 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1018/2019] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:06.923939 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348f5dc-cef3-4e77-9482-caf47e4d29c0 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:06.924515 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348f5dc-cef3-4e77-9482-caf47e4d29c0 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:06.924852 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348f5dc-cef3-4e77-9482-caf47e4d29c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:06.952857 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a64804fe-ad68-4562-95ef-64e13a21865e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae15ebb18df34d78a085e7af450b7460', 'request_id': 'req-a64804fe-ad68-4562-95ef-64e13a21865e'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:06.954995 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2348f5dc-cef3-4e77-9482-caf47e4d29c0 None None] MFA Rules not processed for user `49c46b03cf334810854dcc02c734ca54`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:06.957661 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2348f5dc-cef3-4e77-9482-caf47e4d29c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:06.970485 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a64804fe-ad68-4562-95ef-64e13a21865e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae15ebb18df34d78a085e7af450b7460', 'request_id': 'req-a64804fe-ad68-4562-95ef-64e13a21865e'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:06.982246 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a64804fe-ad68-4562-95ef-64e13a21865e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae15ebb18df34d78a085e7af450b7460', 'request_id': 'req-a64804fe-ad68-4562-95ef-64e13a21865e'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:06.994318 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a64804fe-ad68-4562-95ef-64e13a21865e admin admin] The token cache is being invalidate because project ae15ebb18df34d78a085e7af450b7460 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:06.994936 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a64804fe-ad68-4562-95ef-64e13a21865e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:06.995984 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a64804fe-ad68-4562-95ef-64e13a21865e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:07.002398 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1002/2020] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:06 2022] DELETE /identity/v3/projects/ae15ebb18df34d78a085e7af450b7460 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:07.004018 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64804fe-ad68-4562-95ef-64e13a21865e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:07.006289 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-a64804fe-ad68-4562-95ef-64e13a21865e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:07.068783 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1019/2021] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:06 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:07.068783 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46050b-f8d4-47ed-97d3-4598b79241b3 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:07.068783 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46050b-f8d4-47ed-97d3-4598b79241b3 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:07.068783 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46050b-f8d4-47ed-97d3-4598b79241b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:07.079383 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64804fe-ad68-4562-95ef-64e13a21865e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:07.083920 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef1ccb-de95-4ec3-bc02-ad5f0af58d6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:07.084666 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef1ccb-de95-4ec3-bc02-ad5f0af58d6d service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:07.084968 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef1ccb-de95-4ec3-bc02-ad5f0af58d6d service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:07.085315 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef1ccb-de95-4ec3-bc02-ad5f0af58d6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:07.087393 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-63ef1ccb-de95-4ec3-bc02-ad5f0af58d6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:07.091133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ae46050b-f8d4-47ed-97d3-4598b79241b3 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:07.092329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ae46050b-f8d4-47ed-97d3-4598b79241b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:07.149404 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1020/2022] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:07.149840 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef1ccb-de95-4ec3-bc02-ad5f0af58d6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:07.150161 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46050b-f8d4-47ed-97d3-4598b79241b3 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:07.151437 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ae46050b-f8d4-47ed-97d3-4598b79241b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:07.151575 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef1ccb-de95-4ec3-bc02-ad5f0af58d6d service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:07.162015 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1003/2023] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:07.162906 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46050b-f8d4-47ed-97d3-4598b79241b3 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:07.163443 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60240b58-dd03-45eb-aeb1-9c4ba43f11ae None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:07.163732 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60240b58-dd03-45eb-aeb1-9c4ba43f11ae None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:07.164007 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60240b58-dd03-45eb-aeb1-9c4ba43f11ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:07.167021 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fd7dc-6d3c-4196-8cf8-2d9f7746c02b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:07.167661 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fd7dc-6d3c-4196-8cf8-2d9f7746c02b service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:07.167940 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fd7dc-6d3c-4196-8cf8-2d9f7746c02b service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:07.168272 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fd7dc-6d3c-4196-8cf8-2d9f7746c02b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:07.170243 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2f6fd7dc-6d3c-4196-8cf8-2d9f7746c02b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:07.182673 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-60240b58-dd03-45eb-aeb1-9c4ba43f11ae None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:07.184336 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-60240b58-dd03-45eb-aeb1-9c4ba43f11ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:07.193047 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1004/2024] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:07.197423 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60240b58-dd03-45eb-aeb1-9c4ba43f11ae None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:07.207700 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60240b58-dd03-45eb-aeb1-9c4ba43f11ae None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:07.213518 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54ab80-5619-49bc-8069-0a1b85e3bb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:07.215849 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54ab80-5619-49bc-8069-0a1b85e3bb15 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:07.216300 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54ab80-5619-49bc-8069-0a1b85e3bb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:07.216629 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54ab80-5619-49bc-8069-0a1b85e3bb15 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:07.217548 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54ab80-5619-49bc-8069-0a1b85e3bb15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:41:07.221304 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54ab80-5619-49bc-8069-0a1b85e3bb15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:07.221304 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54ab80-5619-49bc-8069-0a1b85e3bb15 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:07.233866 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1005/2025] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:41:07.238063 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54ab80-5619-49bc-8069-0a1b85e3bb15 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:07.241689 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6fd7dc-6d3c-4196-8cf8-2d9f7746c02b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:07.243144 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6fd7dc-6d3c-4196-8cf8-2d9f7746c02b service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:07.248246 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54ab80-5619-49bc-8069-0a1b85e3bb15 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:07.253631 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc30c25-3132-40cd-8800-03285264f691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:07.254475 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc30c25-3132-40cd-8800-03285264f691 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:07.254761 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc30c25-3132-40cd-8800-03285264f691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:07.255057 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc30c25-3132-40cd-8800-03285264f691 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:07.255353 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1021/2026] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:07.255753 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc30c25-3132-40cd-8800-03285264f691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:07.257977 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc30c25-3132-40cd-8800-03285264f691 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:07.291280 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1006/2027] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:07 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:41:07.294759 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fd7dc-6d3c-4196-8cf8-2d9f7746c02b service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:07.295535 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc30c25-3132-40cd-8800-03285264f691 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:07.296296 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2f6fd7dc-6d3c-4196-8cf8-2d9f7746c02b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:07.310080 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fd7dc-6d3c-4196-8cf8-2d9f7746c02b service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:07.368096 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc30c25-3132-40cd-8800-03285264f691 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:07.372006 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688197d-df35-431f-b38d-056a5b83c666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:07.372881 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688197d-df35-431f-b38d-056a5b83c666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:07.373104 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a5055-4ec7-484e-b488-3e8845b12c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:07.373256 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688197d-df35-431f-b38d-056a5b83c666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:07.373460 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688197d-df35-431f-b38d-056a5b83c666 admin admin] PATH_INFO: `/v3/users/d205800622fe4f13b03f2ff06a62ec7f` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:07.373771 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a5055-4ec7-484e-b488-3e8845b12c52 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:07.374171 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a5055-4ec7-484e-b488-3e8845b12c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:07.374455 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a5055-4ec7-484e-b488-3e8845b12c52 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:07.374659 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688197d-df35-431f-b38d-056a5b83c666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d205800622fe4f13b03f2ff06a62ec7f)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:07.375190 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a5055-4ec7-484e-b488-3e8845b12c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:07.376630 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688197d-df35-431f-b38d-056a5b83c666 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:07.377145 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a5055-4ec7-484e-b488-3e8845b12c52 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:07.401621 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1007/2028] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:07 2022] POST /identity/v3/users => generated 283 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:07.405661 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a5055-4ec7-484e-b488-3e8845b12c52 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:07.416344 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a5055-4ec7-484e-b488-3e8845b12c52 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:07.422094 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25feacc-e96c-48f4-ad1f-a6a779ccbce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:07.422923 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25feacc-e96c-48f4-ad1f-a6a779ccbce1 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:07.423388 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25feacc-e96c-48f4-ad1f-a6a779ccbce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:07.423812 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25feacc-e96c-48f4-ad1f-a6a779ccbce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:07.425400 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25feacc-e96c-48f4-ad1f-a6a779ccbce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:07.427151 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25feacc-e96c-48f4-ad1f-a6a779ccbce1 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:07.428919 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4688197d-df35-431f-b38d-056a5b83c666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd205800622fe4f13b03f2ff06a62ec7f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:07.436955 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4688197d-df35-431f-b38d-056a5b83c666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd205800622fe4f13b03f2ff06a62ec7f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:07.437840 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1008/2029] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:41:07.441354 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4688197d-df35-431f-b38d-056a5b83c666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd205800622fe4f13b03f2ff06a62ec7f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:07.443630 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25feacc-e96c-48f4-ad1f-a6a779ccbce1 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:07.456623 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4688197d-df35-431f-b38d-056a5b83c666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd205800622fe4f13b03f2ff06a62ec7f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:07.456883 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25feacc-e96c-48f4-ad1f-a6a779ccbce1 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:07.464439 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd65d9f-dcdf-47f7-a334-e1398782cbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:07.466098 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd65d9f-dcdf-47f7-a334-e1398782cbd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:07.466729 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-4688197d-df35-431f-b38d-056a5b83c666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd205800622fe4f13b03f2ff06a62ec7f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:07.467302 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd65d9f-dcdf-47f7-a334-e1398782cbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:07.468579 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd65d9f-dcdf-47f7-a334-e1398782cbd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:07.469480 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd65d9f-dcdf-47f7-a334-e1398782cbd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:07.471216 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd65d9f-dcdf-47f7-a334-e1398782cbd2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:07.477105 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1022/2030] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:07 2022] DELETE /identity/v3/users/d205800622fe4f13b03f2ff06a62ec7f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:07.481527 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f35425-bc91-4320-bad5-eca510e6aec6 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:07.482861 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f35425-bc91-4320-bad5-eca510e6aec6 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:07.483210 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f35425-bc91-4320-bad5-eca510e6aec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:07.488305 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1009/2031] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:07.493442 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd65d9f-dcdf-47f7-a334-e1398782cbd2 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:07.498768 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-9dd65d9f-dcdf-47f7-a334-e1398782cbd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:07.506170 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-e5f35425-bc91-4320-bad5-eca510e6aec6 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:07.507711 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e5f35425-bc91-4320-bad5-eca510e6aec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:07.520072 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd65d9f-dcdf-47f7-a334-e1398782cbd2 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:07.587987 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1023/2032] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:41:07.599333 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f35425-bc91-4320-bad5-eca510e6aec6 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:07.600708 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e5f35425-bc91-4320-bad5-eca510e6aec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:07.603420 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d45a9-8cd1-4a25-861d-077904b85845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:07.605089 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d45a9-8cd1-4a25-861d-077904b85845 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:07.605595 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d45a9-8cd1-4a25-861d-077904b85845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:07.606063 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d45a9-8cd1-4a25-861d-077904b85845 admin admin] PATH_INFO: `/v3/projects/8cf1796cc0cd429a95ea76e90e54192c/users/bd79b87279bf4fe28e8010c9a7a1fb6a/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:07.628714 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d45a9-8cd1-4a25-861d-077904b85845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cf1796cc0cd429a95ea76e90e54192c, user_id=bd79b87279bf4fe28e8010c9a7a1fb6a, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:07.631799 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d45a9-8cd1-4a25-861d-077904b85845 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:07.656872 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1010/2033] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:07 2022] PUT /identity/v3/projects/8cf1796cc0cd429a95ea76e90e54192c/users/bd79b87279bf4fe28e8010c9a7a1fb6a/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:07.659763 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df33e4-632b-4376-86fd-211857a63106 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:07.660704 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df33e4-632b-4376-86fd-211857a63106 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:07.660704 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df33e4-632b-4376-86fd-211857a63106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:07.666871 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f35425-bc91-4320-bad5-eca510e6aec6 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:07.690540 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-51df33e4-632b-4376-86fd-211857a63106 None None] MFA Rules not processed for user `bd79b87279bf4fe28e8010c9a7a1fb6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:07.691775 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-51df33e4-632b-4376-86fd-211857a63106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:07.718070 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901f050-314e-454c-80b3-a46e2d20cf31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:07.718724 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901f050-314e-454c-80b3-a46e2d20cf31 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:07.719006 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901f050-314e-454c-80b3-a46e2d20cf31 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:07.719281 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901f050-314e-454c-80b3-a46e2d20cf31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:07.753847 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1011/2034] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:07.763625 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df33e4-632b-4376-86fd-211857a63106 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:07.764965 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-51df33e4-632b-4376-86fd-211857a63106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:07.778318 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901f050-314e-454c-80b3-a46e2d20cf31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:07.779767 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901f050-314e-454c-80b3-a46e2d20cf31 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:07.790071 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1024/2035] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:41:07.823451 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df33e4-632b-4376-86fd-211857a63106 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:07.827076 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140e17b-4f06-4cf9-83ea-95bb5e6aeed8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:07.827713 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140e17b-4f06-4cf9-83ea-95bb5e6aeed8 service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:07.827994 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140e17b-4f06-4cf9-83ea-95bb5e6aeed8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:07.828267 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140e17b-4f06-4cf9-83ea-95bb5e6aeed8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:07.836548 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140e17b-4f06-4cf9-83ea-95bb5e6aeed8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:07.837995 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140e17b-4f06-4cf9-83ea-95bb5e6aeed8 service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:07.847226 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1012/2036] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:07 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:41:08.066173 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901f050-314e-454c-80b3-a46e2d20cf31 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:08.067665 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2901f050-314e-454c-80b3-a46e2d20cf31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:08.083754 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901f050-314e-454c-80b3-a46e2d20cf31 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:08.095749 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fcdfd-321c-498f-ae85-1883f56d9c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:08.097252 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fcdfd-321c-498f-ae85-1883f56d9c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:08.097589 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fcdfd-321c-498f-ae85-1883f56d9c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:08.098290 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fcdfd-321c-498f-ae85-1883f56d9c49 admin admin] PATH_INFO: `/v3/projects/2278253199944f17bad265482c42298f` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:08.100132 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fcdfd-321c-498f-ae85-1883f56d9c49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2278253199944f17bad265482c42298f)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:08.102332 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fcdfd-321c-498f-ae85-1883f56d9c49 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:08.168933 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-167fcdfd-321c-498f-ae85-1883f56d9c49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2278253199944f17bad265482c42298f', 'request_id': 'req-167fcdfd-321c-498f-ae85-1883f56d9c49'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:08.175073 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-167fcdfd-321c-498f-ae85-1883f56d9c49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2278253199944f17bad265482c42298f', 'request_id': 'req-167fcdfd-321c-498f-ae85-1883f56d9c49'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:08.182564 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-167fcdfd-321c-498f-ae85-1883f56d9c49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2278253199944f17bad265482c42298f', 'request_id': 'req-167fcdfd-321c-498f-ae85-1883f56d9c49'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:08.192886 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-167fcdfd-321c-498f-ae85-1883f56d9c49 admin admin] The token cache is being invalidate because project 2278253199944f17bad265482c42298f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:08.193204 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-167fcdfd-321c-498f-ae85-1883f56d9c49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:08.193827 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-167fcdfd-321c-498f-ae85-1883f56d9c49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:08.195352 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1025/2037] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:08 2022] DELETE /identity/v3/projects/2278253199944f17bad265482c42298f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:08.199241 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140e17b-4f06-4cf9-83ea-95bb5e6aeed8 service cinder] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:08.210086 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140e17b-4f06-4cf9-83ea-95bb5e6aeed8 service cinder] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:08.266083 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af69c421-2b48-4b93-885b-8b44a1392058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:08.266971 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69c421-2b48-4b93-885b-8b44a1392058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:08.267245 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69c421-2b48-4b93-885b-8b44a1392058 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:08.267512 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af69c421-2b48-4b93-885b-8b44a1392058 admin admin] PATH_INFO: `/v3/users/8c82ab28c0ed4d9faf0ae28c1465be09` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:08.269247 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69c421-2b48-4b93-885b-8b44a1392058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c82ab28c0ed4d9faf0ae28c1465be09)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:08.271197 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af69c421-2b48-4b93-885b-8b44a1392058 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:08.315182 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-af69c421-2b48-4b93-885b-8b44a1392058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c82ab28c0ed4d9faf0ae28c1465be09'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:08.321944 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-af69c421-2b48-4b93-885b-8b44a1392058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c82ab28c0ed4d9faf0ae28c1465be09'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:08.322629 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-af69c421-2b48-4b93-885b-8b44a1392058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c82ab28c0ed4d9faf0ae28c1465be09'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:08.334453 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-af69c421-2b48-4b93-885b-8b44a1392058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c82ab28c0ed4d9faf0ae28c1465be09'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:08.341514 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-af69c421-2b48-4b93-885b-8b44a1392058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c82ab28c0ed4d9faf0ae28c1465be09'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:08.347968 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1013/2038] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:08 2022] DELETE /identity/v3/users/8c82ab28c0ed4d9faf0ae28c1465be09 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:41:08.612305 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fcdfd-321c-498f-ae85-1883f56d9c49 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:08.613846 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-167fcdfd-321c-498f-ae85-1883f56d9c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:08.627143 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fcdfd-321c-498f-ae85-1883f56d9c49 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:08.685897 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0076aca-0b2c-443c-aa42-c228ff81e133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:08.686781 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0076aca-0b2c-443c-aa42-c228ff81e133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:08.687068 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0076aca-0b2c-443c-aa42-c228ff81e133 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:08.687348 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0076aca-0b2c-443c-aa42-c228ff81e133 admin admin] PATH_INFO: `/v3/projects/701d76b667164b039373b275486b3abb` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:08.688573 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0076aca-0b2c-443c-aa42-c228ff81e133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=701d76b667164b039373b275486b3abb)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:08.691090 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0076aca-0b2c-443c-aa42-c228ff81e133 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:08.736785 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b0076aca-0b2c-443c-aa42-c228ff81e133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '701d76b667164b039373b275486b3abb', 'request_id': 'req-b0076aca-0b2c-443c-aa42-c228ff81e133'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:08.742876 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b0076aca-0b2c-443c-aa42-c228ff81e133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '701d76b667164b039373b275486b3abb', 'request_id': 'req-b0076aca-0b2c-443c-aa42-c228ff81e133'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:08.750756 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b0076aca-0b2c-443c-aa42-c228ff81e133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '701d76b667164b039373b275486b3abb', 'request_id': 'req-b0076aca-0b2c-443c-aa42-c228ff81e133'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:08.762048 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b0076aca-0b2c-443c-aa42-c228ff81e133 admin admin] The token cache is being invalidate because project 701d76b667164b039373b275486b3abb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:08.762341 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b0076aca-0b2c-443c-aa42-c228ff81e133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:08.763033 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b0076aca-0b2c-443c-aa42-c228ff81e133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:08.764618 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1026/2039] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:08 2022] DELETE /identity/v3/projects/701d76b667164b039373b275486b3abb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:08.771191 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d4efd-0bb3-43a8-a9c7-e6ee87ad92db None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:08.771673 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d4efd-0bb3-43a8-a9c7-e6ee87ad92db None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:08.771792 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d4efd-0bb3-43a8-a9c7-e6ee87ad92db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:08.789421 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-368d4efd-0bb3-43a8-a9c7-e6ee87ad92db None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:08.790623 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-368d4efd-0bb3-43a8-a9c7-e6ee87ad92db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:08.850214 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1014/2040] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:08.857910 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b21278-26b3-45c8-823a-33c7c860336f None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:08.858381 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b21278-26b3-45c8-823a-33c7c860336f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:08.858476 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b21278-26b3-45c8-823a-33c7c860336f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:08.876305 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-01b21278-26b3-45c8-823a-33c7c860336f None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:08.878053 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-01b21278-26b3-45c8-823a-33c7c860336f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:08.885804 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1027/2041] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:08.889801 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d4efd-0bb3-43a8-a9c7-e6ee87ad92db None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:08.900075 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d4efd-0bb3-43a8-a9c7-e6ee87ad92db None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:08.904617 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110befb1-1c3d-4e93-a4b5-a09e8aa55c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:08.905327 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110befb1-1c3d-4e93-a4b5-a09e8aa55c7c admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:08.905607 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110befb1-1c3d-4e93-a4b5-a09e8aa55c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:08.905878 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110befb1-1c3d-4e93-a4b5-a09e8aa55c7c admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:08.906604 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110befb1-1c3d-4e93-a4b5-a09e8aa55c7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:41:08.906904 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110befb1-1c3d-4e93-a4b5-a09e8aa55c7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:08.908470 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110befb1-1c3d-4e93-a4b5-a09e8aa55c7c admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:08.919447 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1015/2042] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:41:08.923574 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b21278-26b3-45c8-823a-33c7c860336f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:08.932870 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b21278-26b3-45c8-823a-33c7c860336f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:08.937420 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3c234-48e6-41c9-8f8e-a912b229becc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:08.938055 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3c234-48e6-41c9-8f8e-a912b229becc admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:08.938334 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3c234-48e6-41c9-8f8e-a912b229becc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:08.938607 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3c234-48e6-41c9-8f8e-a912b229becc admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:08.939311 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3c234-48e6-41c9-8f8e-a912b229becc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:08.941881 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3c234-48e6-41c9-8f8e-a912b229becc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:08.966201 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1028/2043] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:08 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:08.970167 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110befb1-1c3d-4e93-a4b5-a09e8aa55c7c admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:08.980021 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110befb1-1c3d-4e93-a4b5-a09e8aa55c7c admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:09.033438 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49c9c1-9a09-47ff-b107-ed8a3d80054b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:09.034098 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49c9c1-9a09-47ff-b107-ed8a3d80054b admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:09.034381 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49c9c1-9a09-47ff-b107-ed8a3d80054b admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:09.034655 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49c9c1-9a09-47ff-b107-ed8a3d80054b admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:09.035360 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49c9c1-9a09-47ff-b107-ed8a3d80054b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:09.037437 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49c9c1-9a09-47ff-b107-ed8a3d80054b admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:09.057495 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1016/2044] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:08 2022] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:09.061757 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3c234-48e6-41c9-8f8e-a912b229becc admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:09.072615 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3c234-48e6-41c9-8f8e-a912b229becc admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:09.077177 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c48920-61f3-484f-9269-63a8162e8fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:09.077831 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c48920-61f3-484f-9269-63a8162e8fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:09.078112 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c48920-61f3-484f-9269-63a8162e8fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:09.078387 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c48920-61f3-484f-9269-63a8162e8fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:09.079121 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c48920-61f3-484f-9269-63a8162e8fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:09.080708 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c48920-61f3-484f-9269-63a8162e8fa6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:09.091404 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1029/2045] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:41:09.095441 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49c9c1-9a09-47ff-b107-ed8a3d80054b admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:09.108649 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49c9c1-9a09-47ff-b107-ed8a3d80054b admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:09.113709 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99c999-ea02-443e-b30e-fce64d5a9bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:09.114356 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99c999-ea02-443e-b30e-fce64d5a9bda admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:09.114634 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99c999-ea02-443e-b30e-fce64d5a9bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:09.114907 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99c999-ea02-443e-b30e-fce64d5a9bda admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:09.115636 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99c999-ea02-443e-b30e-fce64d5a9bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:09.117234 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99c999-ea02-443e-b30e-fce64d5a9bda admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:09.126668 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1017/2046] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:09.131344 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c48920-61f3-484f-9269-63a8162e8fa6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:09.142409 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c48920-61f3-484f-9269-63a8162e8fa6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:09.154586 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0029f-49a7-4a54-bcec-3dc7d67786e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:09.155555 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0029f-49a7-4a54-bcec-3dc7d67786e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:09.155923 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0029f-49a7-4a54-bcec-3dc7d67786e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:09.156269 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0029f-49a7-4a54-bcec-3dc7d67786e0 admin admin] PATH_INFO: `/v3/projects/7ea5232dff7b4000abebac816f666b07/users/d5f46e529ad14bdea508a5aef82a4cc4/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:09.172906 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0029f-49a7-4a54-bcec-3dc7d67786e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ea5232dff7b4000abebac816f666b07, user_id=d5f46e529ad14bdea508a5aef82a4cc4, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:09.181626 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac0029f-49a7-4a54-bcec-3dc7d67786e0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:09.195309 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1030/2047] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:09 2022] PUT /identity/v3/projects/7ea5232dff7b4000abebac816f666b07/users/d5f46e529ad14bdea508a5aef82a4cc4/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:09.205262 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44091a7d-8477-47c9-95ce-9a624954ed69 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:09.205553 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44091a7d-8477-47c9-95ce-9a624954ed69 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:09.205831 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44091a7d-8477-47c9-95ce-9a624954ed69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:09.231728 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-44091a7d-8477-47c9-95ce-9a624954ed69 None None] MFA Rules not processed for user `d5f46e529ad14bdea508a5aef82a4cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:09.232924 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-44091a7d-8477-47c9-95ce-9a624954ed69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:09.296029 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1018/2048] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:09.300435 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0029f-49a7-4a54-bcec-3dc7d67786e0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:09.359347 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0029f-49a7-4a54-bcec-3dc7d67786e0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:09.364836 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e06489-a788-42cc-a1ca-a47e4d467242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:09.365690 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e06489-a788-42cc-a1ca-a47e4d467242 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:09.365971 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e06489-a788-42cc-a1ca-a47e4d467242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:09.366252 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e06489-a788-42cc-a1ca-a47e4d467242 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:09.366963 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e06489-a788-42cc-a1ca-a47e4d467242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:09.369060 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e06489-a788-42cc-a1ca-a47e4d467242 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:09.394534 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1031/2049] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:09 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:09.398718 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44091a7d-8477-47c9-95ce-9a624954ed69 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:09.410220 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44091a7d-8477-47c9-95ce-9a624954ed69 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:09.465899 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92c14b-1b29-4783-8686-f6bd105a402f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:09.466700 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92c14b-1b29-4783-8686-f6bd105a402f admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:09.466983 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92c14b-1b29-4783-8686-f6bd105a402f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:09.467325 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92c14b-1b29-4783-8686-f6bd105a402f admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:09.468462 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92c14b-1b29-4783-8686-f6bd105a402f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:09.470445 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92c14b-1b29-4783-8686-f6bd105a402f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:09.490987 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1019/2050] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:09 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:41:09.495001 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e06489-a788-42cc-a1ca-a47e4d467242 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:09.505172 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e06489-a788-42cc-a1ca-a47e4d467242 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:09.509665 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e6bc9-d78b-4467-80f4-298623dab366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:09.510314 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e6bc9-d78b-4467-80f4-298623dab366 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:09.510595 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e6bc9-d78b-4467-80f4-298623dab366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:09.510869 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e6bc9-d78b-4467-80f4-298623dab366 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:09.511605 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e6bc9-d78b-4467-80f4-298623dab366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:09.513274 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e6bc9-d78b-4467-80f4-298623dab366 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:09.523518 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1032/2051] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:09.527414 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92c14b-1b29-4783-8686-f6bd105a402f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:09.537391 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92c14b-1b29-4783-8686-f6bd105a402f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:09.541859 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe14f7a-e47a-4c36-9224-b6b9e8d806c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:09.542493 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe14f7a-e47a-4c36-9224-b6b9e8d806c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:09.542770 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe14f7a-e47a-4c36-9224-b6b9e8d806c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:09.543041 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe14f7a-e47a-4c36-9224-b6b9e8d806c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:09.543775 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe14f7a-e47a-4c36-9224-b6b9e8d806c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:09.545386 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe14f7a-e47a-4c36-9224-b6b9e8d806c7 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:09.555029 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1020/2052] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:41:09.559206 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e6bc9-d78b-4467-80f4-298623dab366 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:09.569736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e6bc9-d78b-4467-80f4-298623dab366 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:09.574335 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bee35c-ff7b-4c95-bc4a-38a9ec6dffc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:09.575212 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bee35c-ff7b-4c95-bc4a-38a9ec6dffc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:09.575497 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bee35c-ff7b-4c95-bc4a-38a9ec6dffc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:09.575804 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bee35c-ff7b-4c95-bc4a-38a9ec6dffc9 admin admin] PATH_INFO: `/v3/projects/720c71a58fb44f29876ece20ba327e72/users/4d5a123c8d8c46cbab1b7880dd83bfc1/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:09.590846 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bee35c-ff7b-4c95-bc4a-38a9ec6dffc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=720c71a58fb44f29876ece20ba327e72, user_id=4d5a123c8d8c46cbab1b7880dd83bfc1, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:09.593565 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bee35c-ff7b-4c95-bc4a-38a9ec6dffc9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:09.606000 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1033/2053] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:09 2022] PUT /identity/v3/projects/720c71a58fb44f29876ece20ba327e72/users/4d5a123c8d8c46cbab1b7880dd83bfc1/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:09.617407 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63d61f-3bb0-466c-86d5-a5cf569e5e15 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:09.617696 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63d61f-3bb0-466c-86d5-a5cf569e5e15 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:09.617998 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63d61f-3bb0-466c-86d5-a5cf569e5e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:09.643598 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-ac63d61f-3bb0-466c-86d5-a5cf569e5e15 None None] MFA Rules not processed for user `4d5a123c8d8c46cbab1b7880dd83bfc1`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:09.644776 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-ac63d61f-3bb0-466c-86d5-a5cf569e5e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:09.707039 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1021/2054] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:09.711361 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bee35c-ff7b-4c95-bc4a-38a9ec6dffc9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:09.771545 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bee35c-ff7b-4c95-bc4a-38a9ec6dffc9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:09.776497 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37debda-16cf-427f-8bbd-9c081410bc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:09.777163 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37debda-16cf-427f-8bbd-9c081410bc5e admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:09.777446 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37debda-16cf-427f-8bbd-9c081410bc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:09.777721 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37debda-16cf-427f-8bbd-9c081410bc5e admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:09.778421 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37debda-16cf-427f-8bbd-9c081410bc5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:09.780330 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37debda-16cf-427f-8bbd-9c081410bc5e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:09.804907 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1034/2055] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:09 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:09.809181 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63d61f-3bb0-466c-86d5-a5cf569e5e15 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:09.821663 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63d61f-3bb0-466c-86d5-a5cf569e5e15 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:09.876559 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6ea78-d0a0-452b-a896-b8ee429b1619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:09.877373 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6ea78-d0a0-452b-a896-b8ee429b1619 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:09.877734 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6ea78-d0a0-452b-a896-b8ee429b1619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:09.878035 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6ea78-d0a0-452b-a896-b8ee429b1619 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:09.879337 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6ea78-d0a0-452b-a896-b8ee429b1619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:09.881750 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6ea78-d0a0-452b-a896-b8ee429b1619 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:09.908468 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1022/2056] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:09 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:41:09.909822 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37debda-16cf-427f-8bbd-9c081410bc5e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:09.920204 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37debda-16cf-427f-8bbd-9c081410bc5e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:09.925061 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fa615-e09b-43c7-9b5f-1ca05397577a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:09.926380 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fa615-e09b-43c7-9b5f-1ca05397577a admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:09.926671 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fa615-e09b-43c7-9b5f-1ca05397577a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:09.926947 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108fa615-e09b-43c7-9b5f-1ca05397577a admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:09.927702 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108fa615-e09b-43c7-9b5f-1ca05397577a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:09.929341 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108fa615-e09b-43c7-9b5f-1ca05397577a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:09.948999 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1035/2057] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:09.950376 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6ea78-d0a0-452b-a896-b8ee429b1619 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:09.962350 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6ea78-d0a0-452b-a896-b8ee429b1619 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:09.967894 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee80116-4080-4057-bde6-9a86a9043087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:09.968860 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee80116-4080-4057-bde6-9a86a9043087 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:09.969177 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee80116-4080-4057-bde6-9a86a9043087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:09.969454 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee80116-4080-4057-bde6-9a86a9043087 admin admin] PATH_INFO: `/v3/projects/abfca0cb107d411ba62851c280a48d6a/users/c37218598d23475286690b91646b01b2/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:09.986619 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee80116-4080-4057-bde6-9a86a9043087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abfca0cb107d411ba62851c280a48d6a, user_id=c37218598d23475286690b91646b01b2, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:09.990556 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee80116-4080-4057-bde6-9a86a9043087 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:10.006298 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1023/2058] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:09 2022] PUT /identity/v3/projects/abfca0cb107d411ba62851c280a48d6a/users/c37218598d23475286690b91646b01b2/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:10.010850 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fa615-e09b-43c7-9b5f-1ca05397577a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:10.022419 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108fa615-e09b-43c7-9b5f-1ca05397577a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:10.078285 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f3563-8ca9-46c5-a27e-5bc32cfcf0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:10.078946 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f3563-8ca9-46c5-a27e-5bc32cfcf0db admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:10.079225 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f3563-8ca9-46c5-a27e-5bc32cfcf0db admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:10.079518 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f3563-8ca9-46c5-a27e-5bc32cfcf0db admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:10.080230 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f3563-8ca9-46c5-a27e-5bc32cfcf0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:10.081879 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f3563-8ca9-46c5-a27e-5bc32cfcf0db admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:10.091294 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1036/2059] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:10.095411 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee80116-4080-4057-bde6-9a86a9043087 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:10.106018 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee80116-4080-4057-bde6-9a86a9043087 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:10.110867 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb201f3a-66b0-4722-9889-1437d38f733f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:10.111748 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb201f3a-66b0-4722-9889-1437d38f733f admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:10.112025 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb201f3a-66b0-4722-9889-1437d38f733f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:10.112299 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb201f3a-66b0-4722-9889-1437d38f733f admin admin] PATH_INFO: `/v3/projects/abfca0cb107d411ba62851c280a48d6a/users/c37218598d23475286690b91646b01b2/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:10.115093 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb201f3a-66b0-4722-9889-1437d38f733f admin admin] RBAC: Authorizing `identity:create_grant(project_id=abfca0cb107d411ba62851c280a48d6a, user_id=c37218598d23475286690b91646b01b2, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:10.117644 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb201f3a-66b0-4722-9889-1437d38f733f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:10.130088 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1024/2060] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:10 2022] PUT /identity/v3/projects/abfca0cb107d411ba62851c280a48d6a/users/c37218598d23475286690b91646b01b2/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:10.141847 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0732e-67ac-4897-b970-2252e9dc3f3a None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:10.142280 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0732e-67ac-4897-b970-2252e9dc3f3a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:10.142846 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0732e-67ac-4897-b970-2252e9dc3f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:10.172064 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d9f0732e-67ac-4897-b970-2252e9dc3f3a None None] MFA Rules not processed for user `c37218598d23475286690b91646b01b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:10.173452 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d9f0732e-67ac-4897-b970-2252e9dc3f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:10.273320 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1037/2061] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:10.285115 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb201f3a-66b0-4722-9889-1437d38f733f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:10.286915 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-cb201f3a-66b0-4722-9889-1437d38f733f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:10.350665 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb201f3a-66b0-4722-9889-1437d38f733f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:10.354987 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c4f13-e8e2-4f81-8c72-21930abf67f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:10.355642 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c4f13-e8e2-4f81-8c72-21930abf67f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:10.355928 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c4f13-e8e2-4f81-8c72-21930abf67f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:10.356204 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c4f13-e8e2-4f81-8c72-21930abf67f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:10.367557 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c4f13-e8e2-4f81-8c72-21930abf67f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:10.368988 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c4f13-e8e2-4f81-8c72-21930abf67f8 service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:10.378471 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1025/2062] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:10.888458 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0732e-67ac-4897-b970-2252e9dc3f3a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:10.889905 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d9f0732e-67ac-4897-b970-2252e9dc3f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:10.902207 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0732e-67ac-4897-b970-2252e9dc3f3a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:10.905827 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0427bb9-c663-45eb-81aa-8e4d672a916b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:10.906461 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0427bb9-c663-45eb-81aa-8e4d672a916b service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:10.906746 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0427bb9-c663-45eb-81aa-8e4d672a916b service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:10.907046 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0427bb9-c663-45eb-81aa-8e4d672a916b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:10.962641 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0427bb9-c663-45eb-81aa-8e4d672a916b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:10.964099 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0427bb9-c663-45eb-81aa-8e4d672a916b service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:10.973614 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1038/2063] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:11.827692 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c4f13-e8e2-4f81-8c72-21930abf67f8 service cinder] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:11.836690 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c4f13-e8e2-4f81-8c72-21930abf67f8 service cinder] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:11.840496 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d0aa7-635f-4655-b230-21838dc5357e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:11.841238 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d0aa7-635f-4655-b230-21838dc5357e service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:11.841581 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d0aa7-635f-4655-b230-21838dc5357e service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:11.841861 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d0aa7-635f-4655-b230-21838dc5357e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:11.843867 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-302d0aa7-635f-4655-b230-21838dc5357e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:11.917681 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d0aa7-635f-4655-b230-21838dc5357e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:11.919158 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d0aa7-635f-4655-b230-21838dc5357e service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:11.929500 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1026/2064] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:11 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:12.523034 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b5614-b718-4b70-8dc7-18239799cddf None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:12.523557 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b5614-b718-4b70-8dc7-18239799cddf None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:12.523649 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b5614-b718-4b70-8dc7-18239799cddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:12.551671 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-069b5614-b718-4b70-8dc7-18239799cddf None None] MFA Rules not processed for user `a7d55c38bc5e4545aa175151a75e9bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:12.551671 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-069b5614-b718-4b70-8dc7-18239799cddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:12.604928 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1039/2065] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:14.508760 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d0aa7-635f-4655-b230-21838dc5357e service cinder] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:14.511374 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-302d0aa7-635f-4655-b230-21838dc5357e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:14.580939 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d0aa7-635f-4655-b230-21838dc5357e service cinder] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:14.585559 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9763943-1690-46b2-97d3-cdb2c56adde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:14.586453 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9763943-1690-46b2-97d3-cdb2c56adde0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:14.586734 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9763943-1690-46b2-97d3-cdb2c56adde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:14.587018 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9763943-1690-46b2-97d3-cdb2c56adde0 admin admin] PATH_INFO: `/v3/users/874dc6da6298415ba99a027a72fa09cd` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:14.588494 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9763943-1690-46b2-97d3-cdb2c56adde0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=874dc6da6298415ba99a027a72fa09cd)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:14.590913 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9763943-1690-46b2-97d3-cdb2c56adde0 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:14.641541 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-f9763943-1690-46b2-97d3-cdb2c56adde0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '874dc6da6298415ba99a027a72fa09cd'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:14.649382 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-f9763943-1690-46b2-97d3-cdb2c56adde0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '874dc6da6298415ba99a027a72fa09cd'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:14.650122 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-f9763943-1690-46b2-97d3-cdb2c56adde0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '874dc6da6298415ba99a027a72fa09cd'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:14.663260 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-f9763943-1690-46b2-97d3-cdb2c56adde0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '874dc6da6298415ba99a027a72fa09cd'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:14.674500 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-f9763943-1690-46b2-97d3-cdb2c56adde0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '874dc6da6298415ba99a027a72fa09cd'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:14.683766 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1027/2066] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:14 2022] DELETE /identity/v3/users/874dc6da6298415ba99a027a72fa09cd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:14.688240 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec89a4-4d25-427f-acd2-758fd90e734f None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:14.688761 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec89a4-4d25-427f-acd2-758fd90e734f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:14.689144 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec89a4-4d25-427f-acd2-758fd90e734f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:14.728000 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-afec89a4-4d25-427f-acd2-758fd90e734f None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:14.729663 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-afec89a4-4d25-427f-acd2-758fd90e734f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:14.855920 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1040/2067] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:41:14.866209 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9763943-1690-46b2-97d3-cdb2c56adde0 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:14.867750 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-f9763943-1690-46b2-97d3-cdb2c56adde0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:14.970482 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9763943-1690-46b2-97d3-cdb2c56adde0 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:14.976596 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe23483-f595-4c9d-9800-220cc3deb690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:14.977409 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe23483-f595-4c9d-9800-220cc3deb690 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:14.977685 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe23483-f595-4c9d-9800-220cc3deb690 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:14.977955 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe23483-f595-4c9d-9800-220cc3deb690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:14.988017 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe23483-f595-4c9d-9800-220cc3deb690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:14.989648 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe23483-f595-4c9d-9800-220cc3deb690 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:14.999113 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1028/2068] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:15.399906 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec89a4-4d25-427f-acd2-758fd90e734f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:15.401554 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-afec89a4-4d25-427f-acd2-758fd90e734f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:15.416302 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec89a4-4d25-427f-acd2-758fd90e734f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:15.421325 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2eee2-71ba-462b-8fff-fd63d1c62e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:15.422449 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2eee2-71ba-462b-8fff-fd63d1c62e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:15.422921 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2eee2-71ba-462b-8fff-fd63d1c62e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:15.423405 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2eee2-71ba-462b-8fff-fd63d1c62e6d admin admin] PATH_INFO: `/v3/projects/77c37e9cf5e3494f8cba1437f22a7a72` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:15.424897 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2eee2-71ba-462b-8fff-fd63d1c62e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=77c37e9cf5e3494f8cba1437f22a7a72)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:15.427732 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2eee2-71ba-462b-8fff-fd63d1c62e6d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:15.482472 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bbd2eee2-71ba-462b-8fff-fd63d1c62e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77c37e9cf5e3494f8cba1437f22a7a72', 'request_id': 'req-bbd2eee2-71ba-462b-8fff-fd63d1c62e6d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:15.490900 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bbd2eee2-71ba-462b-8fff-fd63d1c62e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77c37e9cf5e3494f8cba1437f22a7a72', 'request_id': 'req-bbd2eee2-71ba-462b-8fff-fd63d1c62e6d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:15.500173 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bbd2eee2-71ba-462b-8fff-fd63d1c62e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77c37e9cf5e3494f8cba1437f22a7a72', 'request_id': 'req-bbd2eee2-71ba-462b-8fff-fd63d1c62e6d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:15.513098 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bbd2eee2-71ba-462b-8fff-fd63d1c62e6d admin admin] The token cache is being invalidate because project 77c37e9cf5e3494f8cba1437f22a7a72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:15.513390 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bbd2eee2-71ba-462b-8fff-fd63d1c62e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:15.514479 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bbd2eee2-71ba-462b-8fff-fd63d1c62e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:15.516288 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1041/2069] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:15 2022] DELETE /identity/v3/projects/77c37e9cf5e3494f8cba1437f22a7a72 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:15.520528 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe23483-f595-4c9d-9800-220cc3deb690 service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:15.530956 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe23483-f595-4c9d-9800-220cc3deb690 service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:15.591761 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910d17e-b992-4d1e-bc10-4e0a89a16d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:15.592661 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910d17e-b992-4d1e-bc10-4e0a89a16d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:15.592946 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910d17e-b992-4d1e-bc10-4e0a89a16d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:15.593305 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910d17e-b992-4d1e-bc10-4e0a89a16d42 admin admin] PATH_INFO: `/v3/users/4518041fb8b648a7bd485a8ab2f56a68` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:15.594516 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910d17e-b992-4d1e-bc10-4e0a89a16d42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4518041fb8b648a7bd485a8ab2f56a68)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:15.596498 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910d17e-b992-4d1e-bc10-4e0a89a16d42 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:15.653564 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-f910d17e-b992-4d1e-bc10-4e0a89a16d42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4518041fb8b648a7bd485a8ab2f56a68'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:15.661088 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-f910d17e-b992-4d1e-bc10-4e0a89a16d42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4518041fb8b648a7bd485a8ab2f56a68'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:15.661809 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-f910d17e-b992-4d1e-bc10-4e0a89a16d42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4518041fb8b648a7bd485a8ab2f56a68'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:15.674755 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-f910d17e-b992-4d1e-bc10-4e0a89a16d42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4518041fb8b648a7bd485a8ab2f56a68'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:15.683721 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-f910d17e-b992-4d1e-bc10-4e0a89a16d42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4518041fb8b648a7bd485a8ab2f56a68'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:15.693149 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1029/2070] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:15 2022] DELETE /identity/v3/users/4518041fb8b648a7bd485a8ab2f56a68 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:16.076409 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2eee2-71ba-462b-8fff-fd63d1c62e6d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:16.078532 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-bbd2eee2-71ba-462b-8fff-fd63d1c62e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:16.108089 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2eee2-71ba-462b-8fff-fd63d1c62e6d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:16.246049 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e418e17-b55b-474e-9888-5a76e5e02e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:16.247371 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e418e17-b55b-474e-9888-5a76e5e02e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:16.247812 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e418e17-b55b-474e-9888-5a76e5e02e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:16.248235 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e418e17-b55b-474e-9888-5a76e5e02e90 admin admin] PATH_INFO: `/v3/projects/68538ca073b8467a8045fece4ca77566` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:16.249688 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e418e17-b55b-474e-9888-5a76e5e02e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68538ca073b8467a8045fece4ca77566)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:16.251828 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e418e17-b55b-474e-9888-5a76e5e02e90 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:16.329840 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9e418e17-b55b-474e-9888-5a76e5e02e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68538ca073b8467a8045fece4ca77566', 'request_id': 'req-9e418e17-b55b-474e-9888-5a76e5e02e90'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:16.340403 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9e418e17-b55b-474e-9888-5a76e5e02e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68538ca073b8467a8045fece4ca77566', 'request_id': 'req-9e418e17-b55b-474e-9888-5a76e5e02e90'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:16.355030 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9e418e17-b55b-474e-9888-5a76e5e02e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68538ca073b8467a8045fece4ca77566', 'request_id': 'req-9e418e17-b55b-474e-9888-5a76e5e02e90'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:16.385045 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9e418e17-b55b-474e-9888-5a76e5e02e90 admin admin] The token cache is being invalidate because project 68538ca073b8467a8045fece4ca77566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:16.385414 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9e418e17-b55b-474e-9888-5a76e5e02e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:16.386193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9e418e17-b55b-474e-9888-5a76e5e02e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:16.391960 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1042/2071] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:16 2022] DELETE /identity/v3/projects/68538ca073b8467a8045fece4ca77566 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:16.394785 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79c6eb-51f1-4f3c-870c-46e260810b9e None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:16.395321 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79c6eb-51f1-4f3c-870c-46e260810b9e None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:16.395767 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79c6eb-51f1-4f3c-870c-46e260810b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:16.420533 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-2d79c6eb-51f1-4f3c-870c-46e260810b9e None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:16.423168 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-2d79c6eb-51f1-4f3c-870c-46e260810b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:16.511777 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1030/2072] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:16.533260 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180d1ec-f9a2-457e-a028-7d49de22e568 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:16.533557 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180d1ec-f9a2-457e-a028-7d49de22e568 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:16.533821 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180d1ec-f9a2-457e-a028-7d49de22e568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:16.565484 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-7180d1ec-f9a2-457e-a028-7d49de22e568 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:16.567193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7180d1ec-f9a2-457e-a028-7d49de22e568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:16.587279 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1043/2073] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:16.591626 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79c6eb-51f1-4f3c-870c-46e260810b9e None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:16.605956 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79c6eb-51f1-4f3c-870c-46e260810b9e None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:16.621945 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad8c7d-1013-4a4d-949d-037a695d2b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:16.622616 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad8c7d-1013-4a4d-949d-037a695d2b11 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:16.623099 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad8c7d-1013-4a4d-949d-037a695d2b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:16.623713 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad8c7d-1013-4a4d-949d-037a695d2b11 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:16.624627 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad8c7d-1013-4a4d-949d-037a695d2b11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:41:16.625119 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad8c7d-1013-4a4d-949d-037a695d2b11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:16.626903 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad8c7d-1013-4a4d-949d-037a695d2b11 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:16.629699 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180d1ec-f9a2-457e-a028-7d49de22e568 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:16.631704 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7180d1ec-f9a2-457e-a028-7d49de22e568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:16.642081 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1031/2074] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:41:16.647105 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad8c7d-1013-4a4d-949d-037a695d2b11 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:16.665485 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad8c7d-1013-4a4d-949d-037a695d2b11 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:16.672811 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffa03d-0612-46a8-8339-3fb0a90d62a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:16.673738 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffa03d-0612-46a8-8339-3fb0a90d62a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:16.675164 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffa03d-0612-46a8-8339-3fb0a90d62a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:16.675603 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffa03d-0612-46a8-8339-3fb0a90d62a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:16.676482 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffa03d-0612-46a8-8339-3fb0a90d62a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:16.678639 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffa03d-0612-46a8-8339-3fb0a90d62a9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:16.723189 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180d1ec-f9a2-457e-a028-7d49de22e568 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:16.731786 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18f40a-8f80-4712-8f0b-eb07b208df19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:16.732706 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18f40a-8f80-4712-8f0b-eb07b208df19 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:16.734027 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18f40a-8f80-4712-8f0b-eb07b208df19 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:16.736477 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18f40a-8f80-4712-8f0b-eb07b208df19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:16.740390 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1032/2075] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:16 2022] POST /identity/v3/projects => generated 365 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:41:16.741532 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffa03d-0612-46a8-8339-3fb0a90d62a9 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:16.741940 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9a18f40a-8f80-4712-8f0b-eb07b208df19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:16.837481 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18f40a-8f80-4712-8f0b-eb07b208df19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:16.840467 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18f40a-8f80-4712-8f0b-eb07b208df19 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:16.844709 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffa03d-0612-46a8-8339-3fb0a90d62a9 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:16.850235 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59ddc0-8c19-4f2f-b08e-c78e255bf865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:16.850983 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59ddc0-8c19-4f2f-b08e-c78e255bf865 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:16.851269 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59ddc0-8c19-4f2f-b08e-c78e255bf865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:16.851647 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59ddc0-8c19-4f2f-b08e-c78e255bf865 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:16.852431 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59ddc0-8c19-4f2f-b08e-c78e255bf865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:16.854618 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59ddc0-8c19-4f2f-b08e-c78e255bf865 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:16.862085 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1044/2076] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:41:16.887854 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1033/2077] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:16 2022] POST /identity/v3/users => generated 283 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:16.889111 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18f40a-8f80-4712-8f0b-eb07b208df19 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:16.904037 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18f40a-8f80-4712-8f0b-eb07b208df19 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:16.911411 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6069c-f81a-4b0e-96d5-3c3292e1f48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:16.912543 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6069c-f81a-4b0e-96d5-3c3292e1f48d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:16.912827 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6069c-f81a-4b0e-96d5-3c3292e1f48d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:16.913199 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6069c-f81a-4b0e-96d5-3c3292e1f48d admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:16.914096 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6069c-f81a-4b0e-96d5-3c3292e1f48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:16.916118 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6069c-f81a-4b0e-96d5-3c3292e1f48d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:16.934167 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1045/2078] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:16.936408 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59ddc0-8c19-4f2f-b08e-c78e255bf865 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:16.948841 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59ddc0-8c19-4f2f-b08e-c78e255bf865 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:16.955667 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999065d3-6e2c-4e91-9c2a-84cd5d8e7fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:16.956908 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999065d3-6e2c-4e91-9c2a-84cd5d8e7fad admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:16.957287 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999065d3-6e2c-4e91-9c2a-84cd5d8e7fad admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:16.957674 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999065d3-6e2c-4e91-9c2a-84cd5d8e7fad admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:16.958529 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999065d3-6e2c-4e91-9c2a-84cd5d8e7fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:16.960257 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999065d3-6e2c-4e91-9c2a-84cd5d8e7fad admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:16.975015 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1034/2079] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:41:16.977170 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6069c-f81a-4b0e-96d5-3c3292e1f48d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:16.988109 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6069c-f81a-4b0e-96d5-3c3292e1f48d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:16.994547 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c04304-87b9-4dba-9f2b-302c0bd4ea1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:16.995442 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c04304-87b9-4dba-9f2b-302c0bd4ea1a admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:16.995724 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c04304-87b9-4dba-9f2b-302c0bd4ea1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:16.995996 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c04304-87b9-4dba-9f2b-302c0bd4ea1a admin admin] PATH_INFO: `/v3/projects/9d969dfc322e4b83b5ccdb0899d24bae/users/c963b0786d21444987bc60c3440fd432/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:17.013851 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c04304-87b9-4dba-9f2b-302c0bd4ea1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d969dfc322e4b83b5ccdb0899d24bae, user_id=c963b0786d21444987bc60c3440fd432, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:17.016878 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c04304-87b9-4dba-9f2b-302c0bd4ea1a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:17.034376 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1046/2080] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:16 2022] PUT /identity/v3/projects/9d969dfc322e4b83b5ccdb0899d24bae/users/c963b0786d21444987bc60c3440fd432/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:17.045114 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854561d-dfdb-4708-8225-4ab02ad3ef52 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:17.045527 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854561d-dfdb-4708-8225-4ab02ad3ef52 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:17.045897 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854561d-dfdb-4708-8225-4ab02ad3ef52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:17.074691 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-0854561d-dfdb-4708-8225-4ab02ad3ef52 None None] MFA Rules not processed for user `c963b0786d21444987bc60c3440fd432`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:17.076096 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-0854561d-dfdb-4708-8225-4ab02ad3ef52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:17.148437 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1035/2081] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:17.153597 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c04304-87b9-4dba-9f2b-302c0bd4ea1a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:17.223859 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c04304-87b9-4dba-9f2b-302c0bd4ea1a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:17.228743 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ff211-a09a-4957-a902-abf24d7e5804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:17.229523 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ff211-a09a-4957-a902-abf24d7e5804 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:17.229894 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ff211-a09a-4957-a902-abf24d7e5804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:17.230195 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ff211-a09a-4957-a902-abf24d7e5804 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:17.230873 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ff211-a09a-4957-a902-abf24d7e5804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:17.232860 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ff211-a09a-4957-a902-abf24d7e5804 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:17.264283 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1047/2082] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:17 2022] POST /identity/v3/projects => generated 361 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:17.267944 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854561d-dfdb-4708-8225-4ab02ad3ef52 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:17.280717 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854561d-dfdb-4708-8225-4ab02ad3ef52 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:17.341793 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fefe07-a2b3-4307-a384-87bff361b48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:17.342635 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fefe07-a2b3-4307-a384-87bff361b48e admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:17.342986 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fefe07-a2b3-4307-a384-87bff361b48e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:17.343331 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fefe07-a2b3-4307-a384-87bff361b48e admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:17.344126 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fefe07-a2b3-4307-a384-87bff361b48e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:17.347412 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fefe07-a2b3-4307-a384-87bff361b48e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:17.375725 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1036/2083] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:17 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:17.380900 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ff211-a09a-4957-a902-abf24d7e5804 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:17.396635 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ff211-a09a-4957-a902-abf24d7e5804 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:17.402579 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aba1ba-b3e6-48bb-85cd-fe3d615461c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:17.403463 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aba1ba-b3e6-48bb-85cd-fe3d615461c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:17.403897 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aba1ba-b3e6-48bb-85cd-fe3d615461c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:17.404340 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aba1ba-b3e6-48bb-85cd-fe3d615461c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:17.405311 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aba1ba-b3e6-48bb-85cd-fe3d615461c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:17.407077 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aba1ba-b3e6-48bb-85cd-fe3d615461c8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:17.421271 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1048/2084] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:17.426117 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fefe07-a2b3-4307-a384-87bff361b48e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:17.439477 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fefe07-a2b3-4307-a384-87bff361b48e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:17.446185 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e356c1-4db1-4a7e-9420-ab1f64843849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:17.447091 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e356c1-4db1-4a7e-9420-ab1f64843849 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:17.447372 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e356c1-4db1-4a7e-9420-ab1f64843849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:17.447652 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e356c1-4db1-4a7e-9420-ab1f64843849 admin admin] PATH_INFO: `/v3/projects/241db0e4b5b240bd86145d4dbabbed92/users/8512ff12d3f740a7b1f94fd5850ff287/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:17.473827 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e356c1-4db1-4a7e-9420-ab1f64843849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=241db0e4b5b240bd86145d4dbabbed92, user_id=8512ff12d3f740a7b1f94fd5850ff287, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:17.476115 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e356c1-4db1-4a7e-9420-ab1f64843849 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:17.499901 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1037/2085] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:17 2022] PUT /identity/v3/projects/241db0e4b5b240bd86145d4dbabbed92/users/8512ff12d3f740a7b1f94fd5850ff287/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:41:17.504344 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aba1ba-b3e6-48bb-85cd-fe3d615461c8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:17.515629 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aba1ba-b3e6-48bb-85cd-fe3d615461c8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:17.600960 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ef038-b5f4-4a74-bc93-7947f3fb14ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:17.601807 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ef038-b5f4-4a74-bc93-7947f3fb14ca admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:17.602169 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ef038-b5f4-4a74-bc93-7947f3fb14ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:17.602453 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ef038-b5f4-4a74-bc93-7947f3fb14ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:17.603223 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ef038-b5f4-4a74-bc93-7947f3fb14ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:17.604889 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436ef038-b5f4-4a74-bc93-7947f3fb14ca admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:17.616114 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1049/2086] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:17.621219 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e356c1-4db1-4a7e-9420-ab1f64843849 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:17.655093 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e356c1-4db1-4a7e-9420-ab1f64843849 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:17.660399 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de057a-d43d-467c-a093-f4c4646f3529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:17.661319 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de057a-d43d-467c-a093-f4c4646f3529 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:17.661602 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de057a-d43d-467c-a093-f4c4646f3529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:17.662012 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de057a-d43d-467c-a093-f4c4646f3529 admin admin] PATH_INFO: `/v3/projects/241db0e4b5b240bd86145d4dbabbed92/users/8512ff12d3f740a7b1f94fd5850ff287/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:17.665140 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de057a-d43d-467c-a093-f4c4646f3529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=241db0e4b5b240bd86145d4dbabbed92, user_id=8512ff12d3f740a7b1f94fd5850ff287, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:17.671695 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de057a-d43d-467c-a093-f4c4646f3529 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:17.684060 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1038/2087] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:17 2022] PUT /identity/v3/projects/241db0e4b5b240bd86145d4dbabbed92/users/8512ff12d3f740a7b1f94fd5850ff287/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:17.701906 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d282ac-8395-4f59-86ae-48e8182bc34b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:17.702205 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d282ac-8395-4f59-86ae-48e8182bc34b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:17.702488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d282ac-8395-4f59-86ae-48e8182bc34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:17.729348 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-45d282ac-8395-4f59-86ae-48e8182bc34b None None] MFA Rules not processed for user `8512ff12d3f740a7b1f94fd5850ff287`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:17.730546 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-45d282ac-8395-4f59-86ae-48e8182bc34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:17.801805 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1050/2088] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:17 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:17.811506 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de057a-d43d-467c-a093-f4c4646f3529 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:17.813264 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-e6de057a-d43d-467c-a093-f4c4646f3529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:17.867922 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de057a-d43d-467c-a093-f4c4646f3529 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:17.871567 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956668f0-692a-40bf-9a1b-5305a9c77cfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:17.872201 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956668f0-692a-40bf-9a1b-5305a9c77cfe service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:17.872482 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956668f0-692a-40bf-9a1b-5305a9c77cfe service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:17.872753 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956668f0-692a-40bf-9a1b-5305a9c77cfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:17.881454 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956668f0-692a-40bf-9a1b-5305a9c77cfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:17.882855 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956668f0-692a-40bf-9a1b-5305a9c77cfe service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:17.892060 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1039/2089] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:17 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:17.960954 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d282ac-8395-4f59-86ae-48e8182bc34b None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:17.970712 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d282ac-8395-4f59-86ae-48e8182bc34b None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:17.975594 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c9757-fe22-47c6-b9f8-42c67565e066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:17.976326 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c9757-fe22-47c6-b9f8-42c67565e066 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:17.976677 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c9757-fe22-47c6-b9f8-42c67565e066 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:17.977051 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c9757-fe22-47c6-b9f8-42c67565e066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:18.037023 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c9757-fe22-47c6-b9f8-42c67565e066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:18.038519 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c9757-fe22-47c6-b9f8-42c67565e066 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:18.047437 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1051/2090] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:19.244142 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956668f0-692a-40bf-9a1b-5305a9c77cfe service cinder] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:19.246141 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-956668f0-692a-40bf-9a1b-5305a9c77cfe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:19.320045 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956668f0-692a-40bf-9a1b-5305a9c77cfe service cinder] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:19.325226 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488071a-b65d-49c6-a3d8-f9a54be46b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:19.326091 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488071a-b65d-49c6-a3d8-f9a54be46b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:19.326562 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488071a-b65d-49c6-a3d8-f9a54be46b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:19.326996 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488071a-b65d-49c6-a3d8-f9a54be46b2d admin admin] PATH_INFO: `/v3/users/d5f46e529ad14bdea508a5aef82a4cc4` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:19.328206 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488071a-b65d-49c6-a3d8-f9a54be46b2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5f46e529ad14bdea508a5aef82a4cc4)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:19.330270 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488071a-b65d-49c6-a3d8-f9a54be46b2d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:19.379827 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3488071a-b65d-49c6-a3d8-f9a54be46b2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5f46e529ad14bdea508a5aef82a4cc4'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:19.388508 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3488071a-b65d-49c6-a3d8-f9a54be46b2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5f46e529ad14bdea508a5aef82a4cc4'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:19.389640 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3488071a-b65d-49c6-a3d8-f9a54be46b2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5f46e529ad14bdea508a5aef82a4cc4'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:19.403082 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3488071a-b65d-49c6-a3d8-f9a54be46b2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5f46e529ad14bdea508a5aef82a4cc4'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:19.411034 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3488071a-b65d-49c6-a3d8-f9a54be46b2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5f46e529ad14bdea508a5aef82a4cc4'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:19.418701 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1040/2091] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:19 2022] DELETE /identity/v3/users/d5f46e529ad14bdea508a5aef82a4cc4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:41:19.423388 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e78962-83ce-44b8-8558-8824eeddbc4f None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:19.423909 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e78962-83ce-44b8-8558-8824eeddbc4f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:19.423999 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e78962-83ce-44b8-8558-8824eeddbc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:19.447936 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-98e78962-83ce-44b8-8558-8824eeddbc4f None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:19.449196 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-98e78962-83ce-44b8-8558-8824eeddbc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:19.512870 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1052/2092] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:41:19.522430 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488071a-b65d-49c6-a3d8-f9a54be46b2d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:19.524220 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-3488071a-b65d-49c6-a3d8-f9a54be46b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:19.598484 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488071a-b65d-49c6-a3d8-f9a54be46b2d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:19.603175 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1583405-5357-47d6-b01a-cd4b7c4bb97b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:19.603909 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1583405-5357-47d6-b01a-cd4b7c4bb97b service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:19.604281 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1583405-5357-47d6-b01a-cd4b7c4bb97b service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:19.604628 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1583405-5357-47d6-b01a-cd4b7c4bb97b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:19.614890 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1583405-5357-47d6-b01a-cd4b7c4bb97b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:19.616394 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1583405-5357-47d6-b01a-cd4b7c4bb97b service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:19.626151 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1041/2093] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:19.929340 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e78962-83ce-44b8-8558-8824eeddbc4f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:19.931184 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-98e78962-83ce-44b8-8558-8824eeddbc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:19.958783 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e78962-83ce-44b8-8558-8824eeddbc4f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:19.964130 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cd65a-fb43-48e1-8ed9-b63d06ffe653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:19.965035 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cd65a-fb43-48e1-8ed9-b63d06ffe653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:19.965310 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cd65a-fb43-48e1-8ed9-b63d06ffe653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:19.965786 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512cd65a-fb43-48e1-8ed9-b63d06ffe653 admin admin] PATH_INFO: `/v3/projects/7ea5232dff7b4000abebac816f666b07` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:19.966985 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cd65a-fb43-48e1-8ed9-b63d06ffe653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ea5232dff7b4000abebac816f666b07)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:19.969251 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512cd65a-fb43-48e1-8ed9-b63d06ffe653 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:20.027578 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-512cd65a-fb43-48e1-8ed9-b63d06ffe653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ea5232dff7b4000abebac816f666b07', 'request_id': 'req-512cd65a-fb43-48e1-8ed9-b63d06ffe653'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:20.033770 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-512cd65a-fb43-48e1-8ed9-b63d06ffe653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ea5232dff7b4000abebac816f666b07', 'request_id': 'req-512cd65a-fb43-48e1-8ed9-b63d06ffe653'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:20.043912 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-512cd65a-fb43-48e1-8ed9-b63d06ffe653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ea5232dff7b4000abebac816f666b07', 'request_id': 'req-512cd65a-fb43-48e1-8ed9-b63d06ffe653'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:20.060474 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-512cd65a-fb43-48e1-8ed9-b63d06ffe653 admin admin] The token cache is being invalidate because project 7ea5232dff7b4000abebac816f666b07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:20.060911 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-512cd65a-fb43-48e1-8ed9-b63d06ffe653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:20.061597 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-512cd65a-fb43-48e1-8ed9-b63d06ffe653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:20.063333 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1053/2094] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:19 2022] DELETE /identity/v3/projects/7ea5232dff7b4000abebac816f666b07 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:20.067113 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1583405-5357-47d6-b01a-cd4b7c4bb97b service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:20.077351 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1583405-5357-47d6-b01a-cd4b7c4bb97b service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:20.132748 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83972184-7eca-4771-8ed3-b2f7acfdf323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:20.133582 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83972184-7eca-4771-8ed3-b2f7acfdf323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:20.133860 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83972184-7eca-4771-8ed3-b2f7acfdf323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:20.134132 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83972184-7eca-4771-8ed3-b2f7acfdf323 admin admin] PATH_INFO: `/v3/users/4d5a123c8d8c46cbab1b7880dd83bfc1` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:20.135340 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83972184-7eca-4771-8ed3-b2f7acfdf323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d5a123c8d8c46cbab1b7880dd83bfc1)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:20.137303 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83972184-7eca-4771-8ed3-b2f7acfdf323 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:20.196227 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-83972184-7eca-4771-8ed3-b2f7acfdf323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d5a123c8d8c46cbab1b7880dd83bfc1'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:20.203430 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-83972184-7eca-4771-8ed3-b2f7acfdf323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d5a123c8d8c46cbab1b7880dd83bfc1'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:20.204132 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-83972184-7eca-4771-8ed3-b2f7acfdf323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d5a123c8d8c46cbab1b7880dd83bfc1'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:20.230721 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-83972184-7eca-4771-8ed3-b2f7acfdf323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d5a123c8d8c46cbab1b7880dd83bfc1'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:20.234407 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-83972184-7eca-4771-8ed3-b2f7acfdf323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d5a123c8d8c46cbab1b7880dd83bfc1'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:20.241122 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1042/2095] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:20 2022] DELETE /identity/v3/users/4d5a123c8d8c46cbab1b7880dd83bfc1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:20.707145 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cd65a-fb43-48e1-8ed9-b63d06ffe653 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:20.708747 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-512cd65a-fb43-48e1-8ed9-b63d06ffe653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:20.722831 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512cd65a-fb43-48e1-8ed9-b63d06ffe653 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:20.781700 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb321ef-b88c-44bc-9dd3-63a1cd643d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:20.782550 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb321ef-b88c-44bc-9dd3-63a1cd643d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:20.782829 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb321ef-b88c-44bc-9dd3-63a1cd643d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:20.783104 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb321ef-b88c-44bc-9dd3-63a1cd643d51 admin admin] PATH_INFO: `/v3/projects/720c71a58fb44f29876ece20ba327e72` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:20.784302 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb321ef-b88c-44bc-9dd3-63a1cd643d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=720c71a58fb44f29876ece20ba327e72)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:20.786258 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb321ef-b88c-44bc-9dd3-63a1cd643d51 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:20.828542 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-efb321ef-b88c-44bc-9dd3-63a1cd643d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '720c71a58fb44f29876ece20ba327e72', 'request_id': 'req-efb321ef-b88c-44bc-9dd3-63a1cd643d51'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:20.834850 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-efb321ef-b88c-44bc-9dd3-63a1cd643d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '720c71a58fb44f29876ece20ba327e72', 'request_id': 'req-efb321ef-b88c-44bc-9dd3-63a1cd643d51'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:20.841808 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-efb321ef-b88c-44bc-9dd3-63a1cd643d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '720c71a58fb44f29876ece20ba327e72', 'request_id': 'req-efb321ef-b88c-44bc-9dd3-63a1cd643d51'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:20.851566 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-efb321ef-b88c-44bc-9dd3-63a1cd643d51 admin admin] The token cache is being invalidate because project 720c71a58fb44f29876ece20ba327e72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:20.851856 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-efb321ef-b88c-44bc-9dd3-63a1cd643d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:20.852501 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-efb321ef-b88c-44bc-9dd3-63a1cd643d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:20.854038 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1054/2096] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:20 2022] DELETE /identity/v3/projects/720c71a58fb44f29876ece20ba327e72 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:20.857950 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83972184-7eca-4771-8ed3-b2f7acfdf323 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:20.859357 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-83972184-7eca-4771-8ed3-b2f7acfdf323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:20.872138 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83972184-7eca-4771-8ed3-b2f7acfdf323 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:20.931849 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598028db-f865-446d-a40c-087b36ff4231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:20.932713 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598028db-f865-446d-a40c-087b36ff4231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:20.932989 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598028db-f865-446d-a40c-087b36ff4231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:20.933290 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598028db-f865-446d-a40c-087b36ff4231 admin admin] PATH_INFO: `/v3/users/c37218598d23475286690b91646b01b2` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:20.934475 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598028db-f865-446d-a40c-087b36ff4231 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c37218598d23475286690b91646b01b2)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:20.936390 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598028db-f865-446d-a40c-087b36ff4231 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:20.981179 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-598028db-f865-446d-a40c-087b36ff4231 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c37218598d23475286690b91646b01b2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:20.988537 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-598028db-f865-446d-a40c-087b36ff4231 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c37218598d23475286690b91646b01b2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:20.989279 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-598028db-f865-446d-a40c-087b36ff4231 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c37218598d23475286690b91646b01b2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:21.002242 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-598028db-f865-446d-a40c-087b36ff4231 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c37218598d23475286690b91646b01b2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:21.012245 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-598028db-f865-446d-a40c-087b36ff4231 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c37218598d23475286690b91646b01b2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:21.021791 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1043/2097] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:20 2022] DELETE /identity/v3/users/c37218598d23475286690b91646b01b2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:21.298294 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb321ef-b88c-44bc-9dd3-63a1cd643d51 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:21.299723 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-efb321ef-b88c-44bc-9dd3-63a1cd643d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:21.312772 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb321ef-b88c-44bc-9dd3-63a1cd643d51 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:21.368481 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86ed4e-aacf-4291-8a6c-6aad592c2ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:21.369369 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86ed4e-aacf-4291-8a6c-6aad592c2ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:21.369659 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86ed4e-aacf-4291-8a6c-6aad592c2ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:21.369936 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86ed4e-aacf-4291-8a6c-6aad592c2ba1 admin admin] PATH_INFO: `/v3/projects/abfca0cb107d411ba62851c280a48d6a` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:21.371127 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86ed4e-aacf-4291-8a6c-6aad592c2ba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abfca0cb107d411ba62851c280a48d6a)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:21.373086 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86ed4e-aacf-4291-8a6c-6aad592c2ba1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:21.416352 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9a86ed4e-aacf-4291-8a6c-6aad592c2ba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abfca0cb107d411ba62851c280a48d6a', 'request_id': 'req-9a86ed4e-aacf-4291-8a6c-6aad592c2ba1'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:21.422299 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9a86ed4e-aacf-4291-8a6c-6aad592c2ba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abfca0cb107d411ba62851c280a48d6a', 'request_id': 'req-9a86ed4e-aacf-4291-8a6c-6aad592c2ba1'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:21.430347 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9a86ed4e-aacf-4291-8a6c-6aad592c2ba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abfca0cb107d411ba62851c280a48d6a', 'request_id': 'req-9a86ed4e-aacf-4291-8a6c-6aad592c2ba1'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:21.440171 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9a86ed4e-aacf-4291-8a6c-6aad592c2ba1 admin admin] The token cache is being invalidate because project abfca0cb107d411ba62851c280a48d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:21.440462 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9a86ed4e-aacf-4291-8a6c-6aad592c2ba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:21.441111 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9a86ed4e-aacf-4291-8a6c-6aad592c2ba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:21.442620 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1055/2098] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:21 2022] DELETE /identity/v3/projects/abfca0cb107d411ba62851c280a48d6a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:21.451087 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6ee47-f383-45ec-8c1b-d95aca66a4a0 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:21.451383 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6ee47-f383-45ec-8c1b-d95aca66a4a0 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:21.451662 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6ee47-f383-45ec-8c1b-d95aca66a4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:21.468652 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-91e6ee47-f383-45ec-8c1b-d95aca66a4a0 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:21.469878 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-91e6ee47-f383-45ec-8c1b-d95aca66a4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:21.526256 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1044/2099] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:21.536281 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ca68b-9768-4522-a23e-fb3de83b849b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:21.536570 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ca68b-9768-4522-a23e-fb3de83b849b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:21.536850 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2ca68b-9768-4522-a23e-fb3de83b849b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:21.555496 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-6e2ca68b-9768-4522-a23e-fb3de83b849b None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:21.556709 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6e2ca68b-9768-4522-a23e-fb3de83b849b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:21.564474 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1056/2100] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:41:21.569282 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6ee47-f383-45ec-8c1b-d95aca66a4a0 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:21.578966 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6ee47-f383-45ec-8c1b-d95aca66a4a0 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:21.583593 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbe509-a93b-44b9-afe8-c100d62169a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:21.584242 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbe509-a93b-44b9-afe8-c100d62169a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:21.584522 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbe509-a93b-44b9-afe8-c100d62169a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:21.584799 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbe509-a93b-44b9-afe8-c100d62169a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:21.585578 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbe509-a93b-44b9-afe8-c100d62169a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:41:21.585885 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbe509-a93b-44b9-afe8-c100d62169a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:21.587499 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dbe509-a93b-44b9-afe8-c100d62169a8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:21.599268 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1045/2101] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:41:21.603543 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ca68b-9768-4522-a23e-fb3de83b849b None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:21.613133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2ca68b-9768-4522-a23e-fb3de83b849b None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:21.617686 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff464a-73ad-4c45-9026-1d8ffb9adfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:21.618326 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff464a-73ad-4c45-9026-1d8ffb9adfdc admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:21.618607 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff464a-73ad-4c45-9026-1d8ffb9adfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:21.618879 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff464a-73ad-4c45-9026-1d8ffb9adfdc admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:21.619880 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff464a-73ad-4c45-9026-1d8ffb9adfdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:21.621796 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff464a-73ad-4c45-9026-1d8ffb9adfdc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:21.651440 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1057/2102] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:21 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:21.652499 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbe509-a93b-44b9-afe8-c100d62169a8 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:21.662823 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbe509-a93b-44b9-afe8-c100d62169a8 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:21.718600 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df59a4-cc7e-480c-8383-7423190f2393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:21.719323 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df59a4-cc7e-480c-8383-7423190f2393 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:21.719615 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df59a4-cc7e-480c-8383-7423190f2393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:21.719889 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df59a4-cc7e-480c-8383-7423190f2393 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:21.720599 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df59a4-cc7e-480c-8383-7423190f2393 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:21.723973 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df59a4-cc7e-480c-8383-7423190f2393 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:21.746085 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1046/2103] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:21 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:41:21.751044 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff464a-73ad-4c45-9026-1d8ffb9adfdc admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:21.762193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff464a-73ad-4c45-9026-1d8ffb9adfdc admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:21.776483 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dc368-fc95-480d-9d8b-0d0b9b9dad65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:21.777226 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dc368-fc95-480d-9d8b-0d0b9b9dad65 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:21.777517 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dc368-fc95-480d-9d8b-0d0b9b9dad65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:21.777799 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dc368-fc95-480d-9d8b-0d0b9b9dad65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:21.778615 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7dc368-fc95-480d-9d8b-0d0b9b9dad65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:21.780792 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7dc368-fc95-480d-9d8b-0d0b9b9dad65 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:21.793816 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1058/2104] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:21.797646 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df59a4-cc7e-480c-8383-7423190f2393 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:21.808282 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df59a4-cc7e-480c-8383-7423190f2393 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:21.812890 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904528ef-9dcf-4677-99ab-3068979d6452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:21.813593 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904528ef-9dcf-4677-99ab-3068979d6452 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:21.813850 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904528ef-9dcf-4677-99ab-3068979d6452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:21.814124 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904528ef-9dcf-4677-99ab-3068979d6452 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:21.814981 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904528ef-9dcf-4677-99ab-3068979d6452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:21.816655 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904528ef-9dcf-4677-99ab-3068979d6452 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:21.826731 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1047/2105] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:41:21.831546 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dc368-fc95-480d-9d8b-0d0b9b9dad65 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:21.842040 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dc368-fc95-480d-9d8b-0d0b9b9dad65 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:21.847673 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27def084-5192-467c-aa12-be0c591ebdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:21.848575 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27def084-5192-467c-aa12-be0c591ebdc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:21.848857 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27def084-5192-467c-aa12-be0c591ebdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:21.849160 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27def084-5192-467c-aa12-be0c591ebdc5 admin admin] PATH_INFO: `/v3/projects/8d013da9e00e4fb3852252b2bedb3d26/users/5c4753d876484a81a44e0afe8180a3a3/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:21.863436 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27def084-5192-467c-aa12-be0c591ebdc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d013da9e00e4fb3852252b2bedb3d26, user_id=5c4753d876484a81a44e0afe8180a3a3, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:21.866537 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27def084-5192-467c-aa12-be0c591ebdc5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:21.879069 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1059/2106] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:21 2022] PUT /identity/v3/projects/8d013da9e00e4fb3852252b2bedb3d26/users/5c4753d876484a81a44e0afe8180a3a3/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:41:21.890405 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcb000-aa5c-4c00-a717-dbd3240669a8 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:21.890913 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcb000-aa5c-4c00-a717-dbd3240669a8 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:21.891003 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bcb000-aa5c-4c00-a717-dbd3240669a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:21.928266 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-09bcb000-aa5c-4c00-a717-dbd3240669a8 None None] MFA Rules not processed for user `5c4753d876484a81a44e0afe8180a3a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:21.929699 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-09bcb000-aa5c-4c00-a717-dbd3240669a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:21.993295 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1048/2107] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:22.002747 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27def084-5192-467c-aa12-be0c591ebdc5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:22.004995 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-27def084-5192-467c-aa12-be0c591ebdc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:22.064853 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27def084-5192-467c-aa12-be0c591ebdc5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:22.069176 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4e257-f7b9-42f5-a27b-04fdfddc56f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:22.069821 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4e257-f7b9-42f5-a27b-04fdfddc56f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:22.070109 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4e257-f7b9-42f5-a27b-04fdfddc56f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:22.070393 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4e257-f7b9-42f5-a27b-04fdfddc56f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:22.078659 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4e257-f7b9-42f5-a27b-04fdfddc56f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:22.080100 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e4e257-f7b9-42f5-a27b-04fdfddc56f7 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:22.089605 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1060/2108] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:37.828568 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcb000-aa5c-4c00-a717-dbd3240669a8 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:37.830130 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-09bcb000-aa5c-4c00-a717-dbd3240669a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:37.934117 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bcb000-aa5c-4c00-a717-dbd3240669a8 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:37.938580 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebf70d-15fb-448a-8f16-72c3a972b7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:37.939439 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebf70d-15fb-448a-8f16-72c3a972b7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:37.939726 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebf70d-15fb-448a-8f16-72c3a972b7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:37.940533 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebf70d-15fb-448a-8f16-72c3a972b7dd admin admin] PATH_INFO: `/v3/users/c43b2e2082b543828b9955ebdf3aaeab` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:37.946725 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebf70d-15fb-448a-8f16-72c3a972b7dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c43b2e2082b543828b9955ebdf3aaeab)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:37.948886 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebf70d-15fb-448a-8f16-72c3a972b7dd admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:38.000553 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3aebf70d-15fb-448a-8f16-72c3a972b7dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c43b2e2082b543828b9955ebdf3aaeab'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:38.011690 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3aebf70d-15fb-448a-8f16-72c3a972b7dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c43b2e2082b543828b9955ebdf3aaeab'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:38.012819 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3aebf70d-15fb-448a-8f16-72c3a972b7dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c43b2e2082b543828b9955ebdf3aaeab'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:38.037498 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3aebf70d-15fb-448a-8f16-72c3a972b7dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c43b2e2082b543828b9955ebdf3aaeab'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:38.047143 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3aebf70d-15fb-448a-8f16-72c3a972b7dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c43b2e2082b543828b9955ebdf3aaeab'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:38.054085 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1049/2109] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:37 2022] DELETE /identity/v3/users/c43b2e2082b543828b9955ebdf3aaeab => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:38.259104 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4e257-f7b9-42f5-a27b-04fdfddc56f7 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:38.282614 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e4e257-f7b9-42f5-a27b-04fdfddc56f7 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:38.356447 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c250c11-91d5-484b-a279-c25f34f06092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:38.357302 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c250c11-91d5-484b-a279-c25f34f06092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:38.357585 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c250c11-91d5-484b-a279-c25f34f06092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:38.357862 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c250c11-91d5-484b-a279-c25f34f06092 admin admin] PATH_INFO: `/v3/projects/a86692805365495ab64b0aae70ab80fb` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:38.359387 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c250c11-91d5-484b-a279-c25f34f06092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a86692805365495ab64b0aae70ab80fb)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:38.363112 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c250c11-91d5-484b-a279-c25f34f06092 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:38.431795 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3c250c11-91d5-484b-a279-c25f34f06092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a86692805365495ab64b0aae70ab80fb', 'request_id': 'req-3c250c11-91d5-484b-a279-c25f34f06092'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:38.441157 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3c250c11-91d5-484b-a279-c25f34f06092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a86692805365495ab64b0aae70ab80fb', 'request_id': 'req-3c250c11-91d5-484b-a279-c25f34f06092'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:38.449244 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3c250c11-91d5-484b-a279-c25f34f06092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a86692805365495ab64b0aae70ab80fb', 'request_id': 'req-3c250c11-91d5-484b-a279-c25f34f06092'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:38.461901 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3c250c11-91d5-484b-a279-c25f34f06092 admin admin] The token cache is being invalidate because project a86692805365495ab64b0aae70ab80fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:38.462417 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3c250c11-91d5-484b-a279-c25f34f06092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:38.463235 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3c250c11-91d5-484b-a279-c25f34f06092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:38.465199 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1061/2110] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:38 2022] DELETE /identity/v3/projects/a86692805365495ab64b0aae70ab80fb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:38.473080 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e4233-3ad0-43e6-9358-ddec030facb8 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:38.473613 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e4233-3ad0-43e6-9358-ddec030facb8 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:38.474067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e4233-3ad0-43e6-9358-ddec030facb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:38.494729 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-198e4233-3ad0-43e6-9358-ddec030facb8 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:38.497146 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-198e4233-3ad0-43e6-9358-ddec030facb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:38.565839 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1050/2111] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:41:38.574694 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df2295-c857-4976-908e-63bc978b6190 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:38.575111 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df2295-c857-4976-908e-63bc978b6190 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:38.575506 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df2295-c857-4976-908e-63bc978b6190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:38.597062 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-40df2295-c857-4976-908e-63bc978b6190 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:38.598381 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-40df2295-c857-4976-908e-63bc978b6190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:38.606626 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1062/2112] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:38.612924 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e4233-3ad0-43e6-9358-ddec030facb8 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:38.626350 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e4233-3ad0-43e6-9358-ddec030facb8 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:38.631549 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b28187-fb11-4421-9461-c87f91325f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:38.632209 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b28187-fb11-4421-9461-c87f91325f61 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:38.632493 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b28187-fb11-4421-9461-c87f91325f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:38.632768 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b28187-fb11-4421-9461-c87f91325f61 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:38.633808 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b28187-fb11-4421-9461-c87f91325f61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:41:38.634118 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b28187-fb11-4421-9461-c87f91325f61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:38.635765 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b28187-fb11-4421-9461-c87f91325f61 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:38.648862 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1051/2113] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:41:38.653737 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df2295-c857-4976-908e-63bc978b6190 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:38.677498 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df2295-c857-4976-908e-63bc978b6190 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:38.684610 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db83351-9a65-46d9-ba42-c07546e95452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:38.685486 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db83351-9a65-46d9-ba42-c07546e95452 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:38.687021 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db83351-9a65-46d9-ba42-c07546e95452 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:38.687021 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db83351-9a65-46d9-ba42-c07546e95452 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:38.687021 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db83351-9a65-46d9-ba42-c07546e95452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:38.689500 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db83351-9a65-46d9-ba42-c07546e95452 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:38.729640 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1063/2114] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:38 2022] POST /identity/v3/projects => generated 387 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:38.730577 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b28187-fb11-4421-9461-c87f91325f61 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:38.740708 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b28187-fb11-4421-9461-c87f91325f61 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:38.823403 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450b971-219b-4f3d-b9a6-1ff42382f76c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:38.823611 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450b971-219b-4f3d-b9a6-1ff42382f76c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:38.823878 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450b971-219b-4f3d-b9a6-1ff42382f76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:38.835280 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763ded6-7aa1-4eac-92aa-15d118e6b3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:38.836542 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763ded6-7aa1-4eac-92aa-15d118e6b3da admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:38.837181 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763ded6-7aa1-4eac-92aa-15d118e6b3da admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:38.838241 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763ded6-7aa1-4eac-92aa-15d118e6b3da admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:38.839177 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763ded6-7aa1-4eac-92aa-15d118e6b3da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:38.841636 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3763ded6-7aa1-4eac-92aa-15d118e6b3da admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:38.847065 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d450b971-219b-4f3d-b9a6-1ff42382f76c None None] MFA Rules not processed for user `a7d55c38bc5e4545aa175151a75e9bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:38.848868 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d450b971-219b-4f3d-b9a6-1ff42382f76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:38.873320 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1052/2115] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:38 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:38.879602 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763ded6-7aa1-4eac-92aa-15d118e6b3da admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:38.893263 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3763ded6-7aa1-4eac-92aa-15d118e6b3da admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:38.899192 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2c779-7fd7-45d2-9351-5c0bee8851e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:38.900227 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2c779-7fd7-45d2-9351-5c0bee8851e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:38.900618 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2c779-7fd7-45d2-9351-5c0bee8851e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:38.901072 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2c779-7fd7-45d2-9351-5c0bee8851e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:38.902572 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2c779-7fd7-45d2-9351-5c0bee8851e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:38.905172 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2c779-7fd7-45d2-9351-5c0bee8851e8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:38.932098 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1053/2116] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:38.933849 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2c779-7fd7-45d2-9351-5c0bee8851e8 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:38.948723 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2c779-7fd7-45d2-9351-5c0bee8851e8 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:38.954382 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14aa065-5ce9-4a9a-81e4-7010654fa61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:38.955321 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14aa065-5ce9-4a9a-81e4-7010654fa61e admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:38.955783 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14aa065-5ce9-4a9a-81e4-7010654fa61e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:38.956234 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14aa065-5ce9-4a9a-81e4-7010654fa61e admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:38.957182 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14aa065-5ce9-4a9a-81e4-7010654fa61e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:38.960717 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14aa065-5ce9-4a9a-81e4-7010654fa61e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:38.982871 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1054/2117] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:38.988326 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14aa065-5ce9-4a9a-81e4-7010654fa61e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:39.003379 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1064/2118] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:41:39.022950 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14aa065-5ce9-4a9a-81e4-7010654fa61e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:39.032066 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae29d2-a214-4676-aa38-a6164338bb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:39.033380 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae29d2-a214-4676-aa38-a6164338bb29 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:39.033886 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae29d2-a214-4676-aa38-a6164338bb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:39.034361 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae29d2-a214-4676-aa38-a6164338bb29 admin admin] PATH_INFO: `/v3/projects/85be135f409d4f71944c325ee7356e39/users/c373e13cbd6c40ed9434caf0d2dec4b9/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:39.074291 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae29d2-a214-4676-aa38-a6164338bb29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85be135f409d4f71944c325ee7356e39, user_id=c373e13cbd6c40ed9434caf0d2dec4b9, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:39.077234 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae29d2-a214-4676-aa38-a6164338bb29 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:39.099733 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1055/2119] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:38 2022] PUT /identity/v3/projects/85be135f409d4f71944c325ee7356e39/users/c373e13cbd6c40ed9434caf0d2dec4b9/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:39.105599 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04c284-ff37-4d4a-ad85-3b560e37255d None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:39.105989 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04c284-ff37-4d4a-ad85-3b560e37255d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:39.106345 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04c284-ff37-4d4a-ad85-3b560e37255d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:39.129828 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-de04c284-ff37-4d4a-ad85-3b560e37255d None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:39.131190 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-de04c284-ff37-4d4a-ad85-3b560e37255d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:39.210111 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1065/2120] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:39.239685 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae29d2-a214-4676-aa38-a6164338bb29 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:39.241546 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-daae29d2-a214-4676-aa38-a6164338bb29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:39.411669 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae29d2-a214-4676-aa38-a6164338bb29 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:39.419034 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abba5d-7b90-4739-893e-ef3af60eb28f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:39.419704 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abba5d-7b90-4739-893e-ef3af60eb28f service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:39.419986 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abba5d-7b90-4739-893e-ef3af60eb28f service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:39.420258 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abba5d-7b90-4739-893e-ef3af60eb28f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:39.437812 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1abba5d-7b90-4739-893e-ef3af60eb28f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:39.440633 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1abba5d-7b90-4739-893e-ef3af60eb28f service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:39.453969 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1056/2121] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:40.348610 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04c284-ff37-4d4a-ad85-3b560e37255d None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:40.350238 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-de04c284-ff37-4d4a-ad85-3b560e37255d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:40.365899 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04c284-ff37-4d4a-ad85-3b560e37255d None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:40.376878 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401737a-073b-413e-b630-ca18397bf6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:40.384183 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401737a-073b-413e-b630-ca18397bf6c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:40.384641 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401737a-073b-413e-b630-ca18397bf6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:40.385102 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401737a-073b-413e-b630-ca18397bf6c0 admin admin] PATH_INFO: `/v3/users/c963b0786d21444987bc60c3440fd432` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:40.386645 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401737a-073b-413e-b630-ca18397bf6c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c963b0786d21444987bc60c3440fd432)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:40.389492 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401737a-073b-413e-b630-ca18397bf6c0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:40.480075 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a401737a-073b-413e-b630-ca18397bf6c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c963b0786d21444987bc60c3440fd432'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:40.492815 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a401737a-073b-413e-b630-ca18397bf6c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c963b0786d21444987bc60c3440fd432'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:40.493811 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a401737a-073b-413e-b630-ca18397bf6c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c963b0786d21444987bc60c3440fd432'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:40.532904 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a401737a-073b-413e-b630-ca18397bf6c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c963b0786d21444987bc60c3440fd432'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:40.545894 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a401737a-073b-413e-b630-ca18397bf6c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c963b0786d21444987bc60c3440fd432'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:40.576978 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1066/2122] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:40 2022] DELETE /identity/v3/users/c963b0786d21444987bc60c3440fd432 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:40.582444 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9e974-a64c-4a23-9c3b-a2bc17cec1cc None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:40.582902 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9e974-a64c-4a23-9c3b-a2bc17cec1cc None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:40.583145 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9e974-a64c-4a23-9c3b-a2bc17cec1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:40.611457 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-f7e9e974-a64c-4a23-9c3b-a2bc17cec1cc None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:40.614887 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-f7e9e974-a64c-4a23-9c3b-a2bc17cec1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:40.696936 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1057/2123] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:40.719221 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401737a-073b-413e-b630-ca18397bf6c0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:40.720855 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a401737a-073b-413e-b630-ca18397bf6c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:40.821770 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401737a-073b-413e-b630-ca18397bf6c0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:40.826808 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b3ab8-0852-4089-b9d3-d9b7c17bdff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:40.827793 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b3ab8-0852-4089-b9d3-d9b7c17bdff3 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:40.828414 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b3ab8-0852-4089-b9d3-d9b7c17bdff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:40.833349 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314b3ab8-0852-4089-b9d3-d9b7c17bdff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:40.848413 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b3ab8-0852-4089-b9d3-d9b7c17bdff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:40.852274 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314b3ab8-0852-4089-b9d3-d9b7c17bdff3 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:40.893640 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1067/2124] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:41.639157 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9e974-a64c-4a23-9c3b-a2bc17cec1cc None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:41.640627 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-f7e9e974-a64c-4a23-9c3b-a2bc17cec1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:41.654623 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9e974-a64c-4a23-9c3b-a2bc17cec1cc None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:41.663047 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd690c4a-4f88-4775-9d2b-eeb03fb957e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:41.664216 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd690c4a-4f88-4775-9d2b-eeb03fb957e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:41.664684 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd690c4a-4f88-4775-9d2b-eeb03fb957e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:41.665158 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd690c4a-4f88-4775-9d2b-eeb03fb957e4 admin admin] PATH_INFO: `/v3/projects/9d969dfc322e4b83b5ccdb0899d24bae` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:41.666910 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd690c4a-4f88-4775-9d2b-eeb03fb957e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d969dfc322e4b83b5ccdb0899d24bae)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:41.669490 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd690c4a-4f88-4775-9d2b-eeb03fb957e4 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:41.755239 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-cd690c4a-4f88-4775-9d2b-eeb03fb957e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d969dfc322e4b83b5ccdb0899d24bae', 'request_id': 'req-cd690c4a-4f88-4775-9d2b-eeb03fb957e4'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:41.765199 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-cd690c4a-4f88-4775-9d2b-eeb03fb957e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d969dfc322e4b83b5ccdb0899d24bae', 'request_id': 'req-cd690c4a-4f88-4775-9d2b-eeb03fb957e4'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:41.791917 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-cd690c4a-4f88-4775-9d2b-eeb03fb957e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d969dfc322e4b83b5ccdb0899d24bae', 'request_id': 'req-cd690c4a-4f88-4775-9d2b-eeb03fb957e4'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:41.816483 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-cd690c4a-4f88-4775-9d2b-eeb03fb957e4 admin admin] The token cache is being invalidate because project 9d969dfc322e4b83b5ccdb0899d24bae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:41.817089 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-cd690c4a-4f88-4775-9d2b-eeb03fb957e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:41.818677 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-cd690c4a-4f88-4775-9d2b-eeb03fb957e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:41.820300 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1058/2125] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:41 2022] DELETE /identity/v3/projects/9d969dfc322e4b83b5ccdb0899d24bae => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:41.825500 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b3ab8-0852-4089-b9d3-d9b7c17bdff3 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:41.846962 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314b3ab8-0852-4089-b9d3-d9b7c17bdff3 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:41.920290 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d0c8f-38c8-4b8f-9790-3659139ca217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:41.921214 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d0c8f-38c8-4b8f-9790-3659139ca217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:41.921501 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d0c8f-38c8-4b8f-9790-3659139ca217 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:41.921780 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d0c8f-38c8-4b8f-9790-3659139ca217 admin admin] PATH_INFO: `/v3/users/8512ff12d3f740a7b1f94fd5850ff287` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:41.923003 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d0c8f-38c8-4b8f-9790-3659139ca217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8512ff12d3f740a7b1f94fd5850ff287)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:41.925524 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d0c8f-38c8-4b8f-9790-3659139ca217 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:41.997972 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-1b6d0c8f-38c8-4b8f-9790-3659139ca217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8512ff12d3f740a7b1f94fd5850ff287'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:42.006243 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-1b6d0c8f-38c8-4b8f-9790-3659139ca217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8512ff12d3f740a7b1f94fd5850ff287'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:42.006953 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-1b6d0c8f-38c8-4b8f-9790-3659139ca217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8512ff12d3f740a7b1f94fd5850ff287'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:42.037276 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-1b6d0c8f-38c8-4b8f-9790-3659139ca217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8512ff12d3f740a7b1f94fd5850ff287'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:42.047070 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-1b6d0c8f-38c8-4b8f-9790-3659139ca217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8512ff12d3f740a7b1f94fd5850ff287'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:42.054290 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1068/2126] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:41 2022] DELETE /identity/v3/users/8512ff12d3f740a7b1f94fd5850ff287 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:42.850861 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd690c4a-4f88-4775-9d2b-eeb03fb957e4 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:42.852455 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-cd690c4a-4f88-4775-9d2b-eeb03fb957e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:42.883421 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd690c4a-4f88-4775-9d2b-eeb03fb957e4 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:42.957783 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46521ea7-09ec-4a8f-9679-33071a7e19e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:42.958690 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46521ea7-09ec-4a8f-9679-33071a7e19e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:42.958974 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46521ea7-09ec-4a8f-9679-33071a7e19e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:42.959394 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46521ea7-09ec-4a8f-9679-33071a7e19e2 admin admin] PATH_INFO: `/v3/users/2e066246cbeb4e4b8d976f7475cfad76` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:42.960661 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46521ea7-09ec-4a8f-9679-33071a7e19e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e066246cbeb4e4b8d976f7475cfad76)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:42.963174 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46521ea7-09ec-4a8f-9679-33071a7e19e2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:43.025658 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-46521ea7-09ec-4a8f-9679-33071a7e19e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e066246cbeb4e4b8d976f7475cfad76'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:43.055799 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-46521ea7-09ec-4a8f-9679-33071a7e19e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e066246cbeb4e4b8d976f7475cfad76'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:43.058687 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-46521ea7-09ec-4a8f-9679-33071a7e19e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e066246cbeb4e4b8d976f7475cfad76'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:43.112851 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-46521ea7-09ec-4a8f-9679-33071a7e19e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e066246cbeb4e4b8d976f7475cfad76'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:43.124301 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-46521ea7-09ec-4a8f-9679-33071a7e19e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e066246cbeb4e4b8d976f7475cfad76'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:43.133054 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1059/2127] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:42 2022] DELETE /identity/v3/users/2e066246cbeb4e4b8d976f7475cfad76 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:43.142884 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d0c8f-38c8-4b8f-9790-3659139ca217 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:43.144440 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1b6d0c8f-38c8-4b8f-9790-3659139ca217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:43.166708 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d0c8f-38c8-4b8f-9790-3659139ca217 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:43.276065 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dbdb24-a741-44dd-9f79-c4048c464b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:43.276952 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbdb24-a741-44dd-9f79-c4048c464b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:43.277270 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbdb24-a741-44dd-9f79-c4048c464b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:43.278237 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbdb24-a741-44dd-9f79-c4048c464b89 admin admin] PATH_INFO: `/v3/projects/241db0e4b5b240bd86145d4dbabbed92` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:43.279684 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbdb24-a741-44dd-9f79-c4048c464b89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=241db0e4b5b240bd86145d4dbabbed92)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:43.282343 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dbdb24-a741-44dd-9f79-c4048c464b89 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:43.357265 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f5dbdb24-a741-44dd-9f79-c4048c464b89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '241db0e4b5b240bd86145d4dbabbed92', 'request_id': 'req-f5dbdb24-a741-44dd-9f79-c4048c464b89'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:43.365323 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f5dbdb24-a741-44dd-9f79-c4048c464b89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '241db0e4b5b240bd86145d4dbabbed92', 'request_id': 'req-f5dbdb24-a741-44dd-9f79-c4048c464b89'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:43.390170 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f5dbdb24-a741-44dd-9f79-c4048c464b89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '241db0e4b5b240bd86145d4dbabbed92', 'request_id': 'req-f5dbdb24-a741-44dd-9f79-c4048c464b89'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:43.410830 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46521ea7-09ec-4a8f-9679-33071a7e19e2 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:43.411277 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f5dbdb24-a741-44dd-9f79-c4048c464b89 admin admin] The token cache is being invalidate because project 241db0e4b5b240bd86145d4dbabbed92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:43.411847 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f5dbdb24-a741-44dd-9f79-c4048c464b89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:43.412319 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-46521ea7-09ec-4a8f-9679-33071a7e19e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:43.413129 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f5dbdb24-a741-44dd-9f79-c4048c464b89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:43.420764 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1069/2128] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:43 2022] DELETE /identity/v3/projects/241db0e4b5b240bd86145d4dbabbed92 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:43.422716 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7afa6a-e4b2-4db0-acf5-7971db695afe None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:43.423190 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7afa6a-e4b2-4db0-acf5-7971db695afe None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:43.423745 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7afa6a-e4b2-4db0-acf5-7971db695afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:43.441654 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46521ea7-09ec-4a8f-9679-33071a7e19e2 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:43.458721 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ca7afa6a-e4b2-4db0-acf5-7971db695afe None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:43.460115 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ca7afa6a-e4b2-4db0-acf5-7971db695afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:43.505184 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97967f0e-58e5-498b-a77f-00cb9a5ffcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:43.506635 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97967f0e-58e5-498b-a77f-00cb9a5ffcd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:43.506635 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97967f0e-58e5-498b-a77f-00cb9a5ffcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:43.506635 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97967f0e-58e5-498b-a77f-00cb9a5ffcd7 admin admin] PATH_INFO: `/v3/projects/13e3120e771e40bd9a549071e3f3f219` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:43.507792 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97967f0e-58e5-498b-a77f-00cb9a5ffcd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13e3120e771e40bd9a549071e3f3f219)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:43.510703 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97967f0e-58e5-498b-a77f-00cb9a5ffcd7 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:43.586101 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-97967f0e-58e5-498b-a77f-00cb9a5ffcd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13e3120e771e40bd9a549071e3f3f219', 'request_id': 'req-97967f0e-58e5-498b-a77f-00cb9a5ffcd7'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:43.602558 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-97967f0e-58e5-498b-a77f-00cb9a5ffcd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13e3120e771e40bd9a549071e3f3f219', 'request_id': 'req-97967f0e-58e5-498b-a77f-00cb9a5ffcd7'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:43.614462 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-97967f0e-58e5-498b-a77f-00cb9a5ffcd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13e3120e771e40bd9a549071e3f3f219', 'request_id': 'req-97967f0e-58e5-498b-a77f-00cb9a5ffcd7'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:43.633996 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-97967f0e-58e5-498b-a77f-00cb9a5ffcd7 admin admin] The token cache is being invalidate because project 13e3120e771e40bd9a549071e3f3f219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:43.633996 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-97967f0e-58e5-498b-a77f-00cb9a5ffcd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:43.633996 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-97967f0e-58e5-498b-a77f-00cb9a5ffcd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:43.638234 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1060/2129] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:43 2022] DELETE /identity/v3/projects/13e3120e771e40bd9a549071e3f3f219 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:43.644763 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77896dd6-2d13-43e8-9b88-0c8d6dcce143 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:43.645214 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77896dd6-2d13-43e8-9b88-0c8d6dcce143 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:43.646179 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77896dd6-2d13-43e8-9b88-0c8d6dcce143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:43.666951 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1070/2130] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:43.673862 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7afa6a-e4b2-4db0-acf5-7971db695afe None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:43.678769 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-77896dd6-2d13-43e8-9b88-0c8d6dcce143 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:43.678965 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ca7afa6a-e4b2-4db0-acf5-7971db695afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:43.685355 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-77896dd6-2d13-43e8-9b88-0c8d6dcce143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:43.706659 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7afa6a-e4b2-4db0-acf5-7971db695afe None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:43.812559 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cf64a-25b8-4518-ad1e-93ef5b269dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:43.814866 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cf64a-25b8-4518-ad1e-93ef5b269dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:43.815348 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cf64a-25b8-4518-ad1e-93ef5b269dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:43.815900 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cf64a-25b8-4518-ad1e-93ef5b269dc9 admin admin] PATH_INFO: `/v3/users/49c46b03cf334810854dcc02c734ca54` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:43.817712 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442cf64a-25b8-4518-ad1e-93ef5b269dc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49c46b03cf334810854dcc02c734ca54)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:43.820521 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442cf64a-25b8-4518-ad1e-93ef5b269dc9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:43.839874 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1061/2131] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:41:43.843793 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77896dd6-2d13-43e8-9b88-0c8d6dcce143 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:43.857441 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77896dd6-2d13-43e8-9b88-0c8d6dcce143 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:43.866987 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873309ab-3973-4c5b-851b-02821fe8bc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:43.868021 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873309ab-3973-4c5b-851b-02821fe8bc48 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:43.868351 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873309ab-3973-4c5b-851b-02821fe8bc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:43.868689 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873309ab-3973-4c5b-851b-02821fe8bc48 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:43.870184 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873309ab-3973-4c5b-851b-02821fe8bc48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:41:43.870591 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873309ab-3973-4c5b-851b-02821fe8bc48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:43.873094 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873309ab-3973-4c5b-851b-02821fe8bc48 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:43.889700 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1062/2132] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:41:43.894162 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873309ab-3973-4c5b-851b-02821fe8bc48 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:43.905157 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873309ab-3973-4c5b-851b-02821fe8bc48 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:43.913065 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f0931-e88c-452e-9ba3-17b6b5cc5270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:43.914259 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-442cf64a-25b8-4518-ad1e-93ef5b269dc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49c46b03cf334810854dcc02c734ca54'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:43.915018 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f0931-e88c-452e-9ba3-17b6b5cc5270 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:43.915522 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f0931-e88c-452e-9ba3-17b6b5cc5270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:43.915936 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f0931-e88c-452e-9ba3-17b6b5cc5270 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:43.916834 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f0931-e88c-452e-9ba3-17b6b5cc5270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:43.919406 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f0931-e88c-452e-9ba3-17b6b5cc5270 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:43.926048 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-442cf64a-25b8-4518-ad1e-93ef5b269dc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49c46b03cf334810854dcc02c734ca54'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:43.927149 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-442cf64a-25b8-4518-ad1e-93ef5b269dc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49c46b03cf334810854dcc02c734ca54'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:43.948776 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-442cf64a-25b8-4518-ad1e-93ef5b269dc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49c46b03cf334810854dcc02c734ca54'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:43.953438 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1063/2133] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:43 2022] POST /identity/v3/projects => generated 363 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:43.957923 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f0931-e88c-452e-9ba3-17b6b5cc5270 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:43.961731 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-442cf64a-25b8-4518-ad1e-93ef5b269dc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49c46b03cf334810854dcc02c734ca54'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:43.969851 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1071/2134] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:43 2022] DELETE /identity/v3/users/49c46b03cf334810854dcc02c734ca54 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:44.025961 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f0931-e88c-452e-9ba3-17b6b5cc5270 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:44.089761 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe00dd7-af92-49d1-8b43-f94f899d6dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:44.090455 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe00dd7-af92-49d1-8b43-f94f899d6dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:44.090746 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe00dd7-af92-49d1-8b43-f94f899d6dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:44.091024 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe00dd7-af92-49d1-8b43-f94f899d6dc3 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:44.091733 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe00dd7-af92-49d1-8b43-f94f899d6dc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:44.093711 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe00dd7-af92-49d1-8b43-f94f899d6dc3 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:44.136383 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1064/2135] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:43 2022] POST /identity/v3/users => generated 282 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:41:44.140539 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cf64a-25b8-4518-ad1e-93ef5b269dc9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:44.142117 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-442cf64a-25b8-4518-ad1e-93ef5b269dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:44.165741 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cf64a-25b8-4518-ad1e-93ef5b269dc9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:44.175074 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774850d0-bb3e-4831-b3cc-cd73daf1a0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:44.175944 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774850d0-bb3e-4831-b3cc-cd73daf1a0ec admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:44.176325 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774850d0-bb3e-4831-b3cc-cd73daf1a0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:44.176925 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774850d0-bb3e-4831-b3cc-cd73daf1a0ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:44.178180 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774850d0-bb3e-4831-b3cc-cd73daf1a0ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:44.180214 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774850d0-bb3e-4831-b3cc-cd73daf1a0ec admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:44.194826 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe00dd7-af92-49d1-8b43-f94f899d6dc3 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:44.197097 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-ebe00dd7-af92-49d1-8b43-f94f899d6dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:44.198361 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1072/2136] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:44.203099 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774850d0-bb3e-4831-b3cc-cd73daf1a0ec admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:44.217369 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe00dd7-af92-49d1-8b43-f94f899d6dc3 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:44.220675 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774850d0-bb3e-4831-b3cc-cd73daf1a0ec admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:44.238385 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259ed92-6289-4117-ae01-030e25c77eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:44.239301 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259ed92-6289-4117-ae01-030e25c77eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:44.239635 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259ed92-6289-4117-ae01-030e25c77eff admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:44.239911 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259ed92-6289-4117-ae01-030e25c77eff admin admin] PATH_INFO: `/v3/projects/2d052ad078b94ae6a9e460493d45f890` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:44.241281 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259ed92-6289-4117-ae01-030e25c77eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d052ad078b94ae6a9e460493d45f890)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:44.241558 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d29b2e-1bb8-4bf2-a08a-69496281e998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:44.242890 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d29b2e-1bb8-4bf2-a08a-69496281e998 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:44.243197 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f259ed92-6289-4117-ae01-030e25c77eff admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:44.243352 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d29b2e-1bb8-4bf2-a08a-69496281e998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:44.243732 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d29b2e-1bb8-4bf2-a08a-69496281e998 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:44.244588 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d29b2e-1bb8-4bf2-a08a-69496281e998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:44.246613 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d29b2e-1bb8-4bf2-a08a-69496281e998 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:44.258126 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1073/2137] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:44.262414 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d29b2e-1bb8-4bf2-a08a-69496281e998 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:44.281449 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d29b2e-1bb8-4bf2-a08a-69496281e998 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:44.287016 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0cccb5-86aa-4c37-b6f1-9f061d0a6a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:44.288131 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cccb5-86aa-4c37-b6f1-9f061d0a6a23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:44.288496 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cccb5-86aa-4c37-b6f1-9f061d0a6a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:44.288883 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0cccb5-86aa-4c37-b6f1-9f061d0a6a23 admin admin] PATH_INFO: `/v3/projects/838b5c79e0a6401bbe571a36f4837c22/users/667524b90473435d9ecf321080f3d993/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:44.307455 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-f259ed92-6289-4117-ae01-030e25c77eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d052ad078b94ae6a9e460493d45f890', 'request_id': 'req-f259ed92-6289-4117-ae01-030e25c77eff'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:44.309187 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0cccb5-86aa-4c37-b6f1-9f061d0a6a23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=838b5c79e0a6401bbe571a36f4837c22, user_id=667524b90473435d9ecf321080f3d993, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:44.312220 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0cccb5-86aa-4c37-b6f1-9f061d0a6a23 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:44.316862 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-f259ed92-6289-4117-ae01-030e25c77eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d052ad078b94ae6a9e460493d45f890', 'request_id': 'req-f259ed92-6289-4117-ae01-030e25c77eff'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:44.323984 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-f259ed92-6289-4117-ae01-030e25c77eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d052ad078b94ae6a9e460493d45f890', 'request_id': 'req-f259ed92-6289-4117-ae01-030e25c77eff'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:44.335680 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1074/2138] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:44 2022] PUT /identity/v3/projects/838b5c79e0a6401bbe571a36f4837c22/users/667524b90473435d9ecf321080f3d993/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:41:44.338947 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8c81e-e7c2-48bd-ac7d-33404b1e1374 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:44.339335 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8c81e-e7c2-48bd-ac7d-33404b1e1374 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:44.339718 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8c81e-e7c2-48bd-ac7d-33404b1e1374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:44.349457 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-f259ed92-6289-4117-ae01-030e25c77eff admin admin] The token cache is being invalidate because project 2d052ad078b94ae6a9e460493d45f890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:44.350025 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-f259ed92-6289-4117-ae01-030e25c77eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:44.351520 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-f259ed92-6289-4117-ae01-030e25c77eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:44.353350 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1065/2139] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:44 2022] DELETE /identity/v3/projects/2d052ad078b94ae6a9e460493d45f890 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:44.359284 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b5179-03ab-452c-9850-8d71ef0703d9 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:44.359751 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b5179-03ab-452c-9850-8d71ef0703d9 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:44.360309 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b5179-03ab-452c-9850-8d71ef0703d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:44.369720 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-38b8c81e-e7c2-48bd-ac7d-33404b1e1374 None None] MFA Rules not processed for user `667524b90473435d9ecf321080f3d993`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:44.371201 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-38b8c81e-e7c2-48bd-ac7d-33404b1e1374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:44.381886 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-fc9b5179-03ab-452c-9850-8d71ef0703d9 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:44.383308 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-fc9b5179-03ab-452c-9850-8d71ef0703d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:44.474040 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1066/2140] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:44.483988 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c40933-6bff-4c81-917b-c9cb996d9709 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:44.484274 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c40933-6bff-4c81-917b-c9cb996d9709 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:44.484600 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c40933-6bff-4c81-917b-c9cb996d9709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:44.503185 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1075/2141] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:44 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:44.508363 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8c81e-e7c2-48bd-ac7d-33404b1e1374 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:44.510987 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-38b8c81e-e7c2-48bd-ac7d-33404b1e1374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:44.528626 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-20c40933-6bff-4c81-917b-c9cb996d9709 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:44.528626 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-20c40933-6bff-4c81-917b-c9cb996d9709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:44.549172 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8c81e-e7c2-48bd-ac7d-33404b1e1374 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:44.551484 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1067/2142] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:44.555897 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c40933-6bff-4c81-917b-c9cb996d9709 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:44.560634 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ba751-6095-4d90-8615-9dba3baaccf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:44.560634 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ba751-6095-4d90-8615-9dba3baaccf2 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:44.560634 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ba751-6095-4d90-8615-9dba3baaccf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:44.561326 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ba751-6095-4d90-8615-9dba3baaccf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:44.562309 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ba751-6095-4d90-8615-9dba3baaccf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:44.564209 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ba751-6095-4d90-8615-9dba3baaccf2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:44.589397 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c40933-6bff-4c81-917b-c9cb996d9709 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:44.603368 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1076/2143] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:44 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:44.607231 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ba751-6095-4d90-8615-9dba3baaccf2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:44.615216 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d012f-a8b1-4596-8889-47c555453a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:44.616889 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d012f-a8b1-4596-8889-47c555453a53 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:44.617056 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d012f-a8b1-4596-8889-47c555453a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:44.617297 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d012f-a8b1-4596-8889-47c555453a53 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:44.619686 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d012f-a8b1-4596-8889-47c555453a53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:41:44.621574 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d012f-a8b1-4596-8889-47c555453a53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:44.623939 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d012f-a8b1-4596-8889-47c555453a53 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:44.639659 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1068/2144] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:41:44.644348 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d012f-a8b1-4596-8889-47c555453a53 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:44.654887 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d012f-a8b1-4596-8889-47c555453a53 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:44.693179 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ba751-6095-4d90-8615-9dba3baaccf2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:44.702442 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450721b7-5769-47ed-9e20-c654e3594a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:44.703188 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450721b7-5769-47ed-9e20-c654e3594a31 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:44.703476 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450721b7-5769-47ed-9e20-c654e3594a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:44.703750 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450721b7-5769-47ed-9e20-c654e3594a31 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:44.704462 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450721b7-5769-47ed-9e20-c654e3594a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:44.707173 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450721b7-5769-47ed-9e20-c654e3594a31 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:44.727164 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492b3bf-39be-4a3c-9ec9-a15c84876ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:44.728380 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492b3bf-39be-4a3c-9ec9-a15c84876ccb admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:44.729752 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492b3bf-39be-4a3c-9ec9-a15c84876ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:44.730188 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492b3bf-39be-4a3c-9ec9-a15c84876ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:44.731172 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492b3bf-39be-4a3c-9ec9-a15c84876ccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:44.732495 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1077/2145] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:44 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:44.733655 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492b3bf-39be-4a3c-9ec9-a15c84876ccb admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:44.736496 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450721b7-5769-47ed-9e20-c654e3594a31 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:44.755514 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450721b7-5769-47ed-9e20-c654e3594a31 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:44.764788 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d455ea4-5cec-45e7-a92b-3e80edeb130c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:44.765510 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d455ea4-5cec-45e7-a92b-3e80edeb130c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:44.765796 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d455ea4-5cec-45e7-a92b-3e80edeb130c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:44.778806 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d455ea4-5cec-45e7-a92b-3e80edeb130c admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:44.779737 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d455ea4-5cec-45e7-a92b-3e80edeb130c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:44.781440 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d455ea4-5cec-45e7-a92b-3e80edeb130c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:44.787366 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1069/2146] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:44 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:44.789763 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492b3bf-39be-4a3c-9ec9-a15c84876ccb admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:44.813404 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1078/2147] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:44.815390 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d455ea4-5cec-45e7-a92b-3e80edeb130c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:44.820464 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8d455ea4-5cec-45e7-a92b-3e80edeb130c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:44.860742 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d455ea4-5cec-45e7-a92b-3e80edeb130c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:44.874617 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492b3bf-39be-4a3c-9ec9-a15c84876ccb admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:44.880266 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a619aab-96cf-487f-9848-5fc5797b2e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:44.881605 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a619aab-96cf-487f-9848-5fc5797b2e0a admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:44.882511 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a619aab-96cf-487f-9848-5fc5797b2e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:44.883542 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327fccb-cf20-44ba-9587-8d287a6a012e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:44.883920 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a619aab-96cf-487f-9848-5fc5797b2e0a admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:44.884274 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327fccb-cf20-44ba-9587-8d287a6a012e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:44.884565 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327fccb-cf20-44ba-9587-8d287a6a012e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:44.885075 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327fccb-cf20-44ba-9587-8d287a6a012e admin admin] PATH_INFO: `/v3/users/5c4753d876484a81a44e0afe8180a3a3` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:44.886278 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a619aab-96cf-487f-9848-5fc5797b2e0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:44.892240 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a619aab-96cf-487f-9848-5fc5797b2e0a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:44.895711 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327fccb-cf20-44ba-9587-8d287a6a012e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c4753d876484a81a44e0afe8180a3a3)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:44.897747 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327fccb-cf20-44ba-9587-8d287a6a012e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:44.940012 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1070/2148] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:44 2022] POST /identity/v3/users => generated 287 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:44.943145 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a619aab-96cf-487f-9848-5fc5797b2e0a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:44.968643 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a619aab-96cf-487f-9848-5fc5797b2e0a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:44.974944 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8327fccb-cf20-44ba-9587-8d287a6a012e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c4753d876484a81a44e0afe8180a3a3'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:44.980713 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef5a76-abf9-4cac-8b1c-00cf0315ddc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:44.982414 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef5a76-abf9-4cac-8b1c-00cf0315ddc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:44.982906 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef5a76-abf9-4cac-8b1c-00cf0315ddc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:44.983374 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef5a76-abf9-4cac-8b1c-00cf0315ddc9 admin admin] PATH_INFO: `/v3/projects/2040c46f1e794c5cb1808f62c83d1ac5/users/7eb215a26ae943c8a43959874c6b8025/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:45.002188 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8327fccb-cf20-44ba-9587-8d287a6a012e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c4753d876484a81a44e0afe8180a3a3'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:45.004570 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8327fccb-cf20-44ba-9587-8d287a6a012e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c4753d876484a81a44e0afe8180a3a3'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:45.025067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef5a76-abf9-4cac-8b1c-00cf0315ddc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2040c46f1e794c5cb1808f62c83d1ac5, user_id=7eb215a26ae943c8a43959874c6b8025, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:45.030131 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef5a76-abf9-4cac-8b1c-00cf0315ddc9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:45.047650 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8327fccb-cf20-44ba-9587-8d287a6a012e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c4753d876484a81a44e0afe8180a3a3'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:45.061449 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8327fccb-cf20-44ba-9587-8d287a6a012e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c4753d876484a81a44e0afe8180a3a3'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:45.064589 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1071/2149] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:44 2022] PUT /identity/v3/projects/2040c46f1e794c5cb1808f62c83d1ac5/users/7eb215a26ae943c8a43959874c6b8025/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:45.065346 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef5a76-abf9-4cac-8b1c-00cf0315ddc9 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:45.067061 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-b1ef5a76-abf9-4cac-8b1c-00cf0315ddc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:45.077335 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1079/2150] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:44 2022] DELETE /identity/v3/users/5c4753d876484a81a44e0afe8180a3a3 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:45.078371 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327fccb-cf20-44ba-9587-8d287a6a012e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:45.080166 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8327fccb-cf20-44ba-9587-8d287a6a012e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:45.197263 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327fccb-cf20-44ba-9587-8d287a6a012e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:45.203078 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84507ef4-cf70-470b-8756-c1771c9c8d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:45.204864 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84507ef4-cf70-470b-8756-c1771c9c8d96 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:45.206567 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84507ef4-cf70-470b-8756-c1771c9c8d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:45.206996 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84507ef4-cf70-470b-8756-c1771c9c8d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:45.207905 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84507ef4-cf70-470b-8756-c1771c9c8d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:45.210975 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84507ef4-cf70-470b-8756-c1771c9c8d96 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:45.228056 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1080/2151] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:45.232409 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7abf0-05ea-40c7-85ed-0cab2f35bc15 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:45.232755 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7abf0-05ea-40c7-85ed-0cab2f35bc15 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:45.233052 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7abf0-05ea-40c7-85ed-0cab2f35bc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:45.240076 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef5a76-abf9-4cac-8b1c-00cf0315ddc9 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:45.253899 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-1ef7abf0-05ea-40c7-85ed-0cab2f35bc15 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:45.255699 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1ef7abf0-05ea-40c7-85ed-0cab2f35bc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:45.259221 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af33692-a081-442a-a6d5-88c53c40d83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:45.259379 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af33692-a081-442a-a6d5-88c53c40d83e admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:45.259686 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af33692-a081-442a-a6d5-88c53c40d83e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:45.260032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af33692-a081-442a-a6d5-88c53c40d83e admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:45.260821 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af33692-a081-442a-a6d5-88c53c40d83e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:45.262712 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af33692-a081-442a-a6d5-88c53c40d83e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:45.268936 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1081/2152] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:45.268936 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7abf0-05ea-40c7-85ed-0cab2f35bc15 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:45.282449 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7abf0-05ea-40c7-85ed-0cab2f35bc15 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:45.296067 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93242b-f988-4321-8403-a7c617c41f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:45.297058 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93242b-f988-4321-8403-a7c617c41f03 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:45.297349 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93242b-f988-4321-8403-a7c617c41f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:45.297621 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93242b-f988-4321-8403-a7c617c41f03 admin admin] PATH_INFO: `/v3/projects/2040c46f1e794c5cb1808f62c83d1ac5/users/7eb215a26ae943c8a43959874c6b8025/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:45.298786 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1072/2153] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:45.302476 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af33692-a081-442a-a6d5-88c53c40d83e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:45.303268 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93242b-f988-4321-8403-a7c617c41f03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2040c46f1e794c5cb1808f62c83d1ac5, user_id=7eb215a26ae943c8a43959874c6b8025, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:45.306140 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7af33692-a081-442a-a6d5-88c53c40d83e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:45.306410 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93242b-f988-4321-8403-a7c617c41f03 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:45.325578 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1082/2154] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:45 2022] PUT /identity/v3/projects/2040c46f1e794c5cb1808f62c83d1ac5/users/7eb215a26ae943c8a43959874c6b8025/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:45.327594 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93242b-f988-4321-8403-a7c617c41f03 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:45.402679 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af33692-a081-442a-a6d5-88c53c40d83e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:45.445198 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93242b-f988-4321-8403-a7c617c41f03 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:45.455364 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34c922-2da9-47cb-acaf-ac6212cdd77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:45.457856 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34c922-2da9-47cb-acaf-ac6212cdd77f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:45.458408 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34c922-2da9-47cb-acaf-ac6212cdd77f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:45.458667 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34c922-2da9-47cb-acaf-ac6212cdd77f admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:45.459429 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34c922-2da9-47cb-acaf-ac6212cdd77f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:45.461095 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34c922-2da9-47cb-acaf-ac6212cdd77f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:45.485155 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1083/2155] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:45.491118 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91242ec4-345d-4846-affe-825962a1e5c2 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:45.491428 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91242ec4-345d-4846-affe-825962a1e5c2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:45.492166 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91242ec4-345d-4846-affe-825962a1e5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:45.535824 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824503c3-aff0-4f46-9408-f456a71ebb46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:45.537545 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824503c3-aff0-4f46-9408-f456a71ebb46 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:45.537836 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824503c3-aff0-4f46-9408-f456a71ebb46 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:45.538116 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824503c3-aff0-4f46-9408-f456a71ebb46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:45.557293 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824503c3-aff0-4f46-9408-f456a71ebb46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:45.560744 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824503c3-aff0-4f46-9408-f456a71ebb46 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:45.580160 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1073/2156] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:41:45.581642 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-91242ec4-345d-4846-affe-825962a1e5c2 None None] MFA Rules not processed for user `7eb215a26ae943c8a43959874c6b8025`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:45.581940 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824503c3-aff0-4f46-9408-f456a71ebb46 service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:45.582876 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-91242ec4-345d-4846-affe-825962a1e5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:45.593943 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824503c3-aff0-4f46-9408-f456a71ebb46 service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:45.609169 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326954e2-5e04-46b8-a786-741b769b4ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:45.610106 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326954e2-5e04-46b8-a786-741b769b4ecc admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:45.610360 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326954e2-5e04-46b8-a786-741b769b4ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:45.610639 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326954e2-5e04-46b8-a786-741b769b4ecc admin admin] PATH_INFO: `/v3/projects/458282dedc004065a87f028633e61b66/users/926376f895a540a48aa1d00850b5e715/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:45.638799 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326954e2-5e04-46b8-a786-741b769b4ecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=458282dedc004065a87f028633e61b66, user_id=926376f895a540a48aa1d00850b5e715, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:45.643335 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326954e2-5e04-46b8-a786-741b769b4ecc admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:45.676253 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1074/2157] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:45 2022] PUT /identity/v3/projects/458282dedc004065a87f028633e61b66/users/926376f895a540a48aa1d00850b5e715/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:45.693183 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed9130-278f-4fc1-b74a-cccf8298fda6 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:45.693518 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed9130-278f-4fc1-b74a-cccf8298fda6 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:45.693770 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed9130-278f-4fc1-b74a-cccf8298fda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:45.738295 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1084/2158] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:45.749042 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91242ec4-345d-4846-affe-825962a1e5c2 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:45.752307 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-91242ec4-345d-4846-affe-825962a1e5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:45.766910 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-7bed9130-278f-4fc1-b74a-cccf8298fda6 None None] MFA Rules not processed for user `926376f895a540a48aa1d00850b5e715`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:45.769802 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7bed9130-278f-4fc1-b74a-cccf8298fda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:45.866317 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1075/2159] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:45.872176 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed9130-278f-4fc1-b74a-cccf8298fda6 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:45.875724 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7bed9130-278f-4fc1-b74a-cccf8298fda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:45.881533 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91242ec4-345d-4846-affe-825962a1e5c2 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:45.983145 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed9130-278f-4fc1-b74a-cccf8298fda6 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:45.992413 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f5105-8920-48cf-b717-e317eceb45fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:45.992413 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f5105-8920-48cf-b717-e317eceb45fc service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:45.992413 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f5105-8920-48cf-b717-e317eceb45fc service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:45.992413 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f5105-8920-48cf-b717-e317eceb45fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:46.005909 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacaf83-d3f8-4efc-ac1b-71763774cd99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:46.006574 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacaf83-d3f8-4efc-ac1b-71763774cd99 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:46.006996 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacaf83-d3f8-4efc-ac1b-71763774cd99 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:46.007127 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacaf83-d3f8-4efc-ac1b-71763774cd99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:46.009858 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f5105-8920-48cf-b717-e317eceb45fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:46.012134 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f5105-8920-48cf-b717-e317eceb45fc service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:46.026346 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1076/2160] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:41:46.061194 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f5105-8920-48cf-b717-e317eceb45fc service cinder] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:46.112622 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacaf83-d3f8-4efc-ac1b-71763774cd99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:46.114590 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacaf83-d3f8-4efc-ac1b-71763774cd99 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:46.128063 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1085/2161] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:45 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:41:46.178339 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f5105-8920-48cf-b717-e317eceb45fc service cinder] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:46.184947 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e20eb4-8af2-4624-8a27-526f40c2fba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:46.186635 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e20eb4-8af2-4624-8a27-526f40c2fba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:46.186635 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e20eb4-8af2-4624-8a27-526f40c2fba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:46.186635 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e20eb4-8af2-4624-8a27-526f40c2fba2 admin admin] PATH_INFO: `/v3/users/926376f895a540a48aa1d00850b5e715` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:46.188311 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e20eb4-8af2-4624-8a27-526f40c2fba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=926376f895a540a48aa1d00850b5e715)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:46.191379 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e20eb4-8af2-4624-8a27-526f40c2fba2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:46.267754 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacaf83-d3f8-4efc-ac1b-71763774cd99 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:46.279916 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacaf83-d3f8-4efc-ac1b-71763774cd99 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:46.293318 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-07e20eb4-8af2-4624-8a27-526f40c2fba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '926376f895a540a48aa1d00850b5e715'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:46.309325 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54777e-abf3-417d-bde8-7ee30dd6fd0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:46.309886 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-07e20eb4-8af2-4624-8a27-526f40c2fba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '926376f895a540a48aa1d00850b5e715'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:46.309999 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54777e-abf3-417d-bde8-7ee30dd6fd0e service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:46.311753 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54777e-abf3-417d-bde8-7ee30dd6fd0e service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:46.312055 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54777e-abf3-417d-bde8-7ee30dd6fd0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:46.312533 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-07e20eb4-8af2-4624-8a27-526f40c2fba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '926376f895a540a48aa1d00850b5e715'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:46.317073 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9c54777e-abf3-417d-bde8-7ee30dd6fd0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:46.337904 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-07e20eb4-8af2-4624-8a27-526f40c2fba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '926376f895a540a48aa1d00850b5e715'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:46.355971 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-07e20eb4-8af2-4624-8a27-526f40c2fba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '926376f895a540a48aa1d00850b5e715'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:46.364088 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1077/2162] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:46 2022] DELETE /identity/v3/users/926376f895a540a48aa1d00850b5e715 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:46.369751 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ca972-5785-4612-bb73-69b1c01a49af None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:46.370034 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ca972-5785-4612-bb73-69b1c01a49af None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:46.370321 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ca972-5785-4612-bb73-69b1c01a49af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:46.403040 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-169ca972-5785-4612-bb73-69b1c01a49af None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:46.404282 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-169ca972-5785-4612-bb73-69b1c01a49af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:46.418634 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54777e-abf3-417d-bde8-7ee30dd6fd0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:46.420928 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54777e-abf3-417d-bde8-7ee30dd6fd0e service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:46.442880 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1086/2163] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:46 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:41:46.531557 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1078/2164] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:46.561434 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54777e-abf3-417d-bde8-7ee30dd6fd0e service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:46.712138 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54777e-abf3-417d-bde8-7ee30dd6fd0e service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:46.814844 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e73cb-bc8a-4210-8495-aa08d61114a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:46.815892 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e73cb-bc8a-4210-8495-aa08d61114a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:46.817299 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e73cb-bc8a-4210-8495-aa08d61114a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:46.817833 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e73cb-bc8a-4210-8495-aa08d61114a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:46.849078 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e73cb-bc8a-4210-8495-aa08d61114a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:46.849078 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e73cb-bc8a-4210-8495-aa08d61114a2 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:46.860013 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1087/2165] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:46.876243 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ca972-5785-4612-bb73-69b1c01a49af None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:46.878679 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-169ca972-5785-4612-bb73-69b1c01a49af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:46.916476 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ca972-5785-4612-bb73-69b1c01a49af None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:46.923295 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7ff31-7d81-4db7-bf40-224492787ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:46.929432 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7ff31-7d81-4db7-bf40-224492787ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:46.929952 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7ff31-7d81-4db7-bf40-224492787ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:46.930420 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7ff31-7d81-4db7-bf40-224492787ef3 admin admin] PATH_INFO: `/v3/projects/8d013da9e00e4fb3852252b2bedb3d26` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:46.933179 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7ff31-7d81-4db7-bf40-224492787ef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d013da9e00e4fb3852252b2bedb3d26)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:46.935325 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7ff31-7d81-4db7-bf40-224492787ef3 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:47.000755 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7df7ff31-7d81-4db7-bf40-224492787ef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d013da9e00e4fb3852252b2bedb3d26', 'request_id': 'req-7df7ff31-7d81-4db7-bf40-224492787ef3'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:47.010998 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7df7ff31-7d81-4db7-bf40-224492787ef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d013da9e00e4fb3852252b2bedb3d26', 'request_id': 'req-7df7ff31-7d81-4db7-bf40-224492787ef3'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:47.020094 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7df7ff31-7d81-4db7-bf40-224492787ef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d013da9e00e4fb3852252b2bedb3d26', 'request_id': 'req-7df7ff31-7d81-4db7-bf40-224492787ef3'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:47.040326 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7df7ff31-7d81-4db7-bf40-224492787ef3 admin admin] The token cache is being invalidate because project 8d013da9e00e4fb3852252b2bedb3d26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:47.040922 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7df7ff31-7d81-4db7-bf40-224492787ef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:47.042257 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7df7ff31-7d81-4db7-bf40-224492787ef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:47.044149 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1079/2166] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:46 2022] DELETE /identity/v3/projects/8d013da9e00e4fb3852252b2bedb3d26 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:47.670381 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e73cb-bc8a-4210-8495-aa08d61114a2 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:47.672885 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-029e73cb-bc8a-4210-8495-aa08d61114a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:47.693530 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e73cb-bc8a-4210-8495-aa08d61114a2 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:47.830281 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965a099-f468-44dd-959f-a62c4963b2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:47.831596 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965a099-f468-44dd-959f-a62c4963b2ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:47.832306 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965a099-f468-44dd-959f-a62c4963b2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:47.832838 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965a099-f468-44dd-959f-a62c4963b2ec admin admin] PATH_INFO: `/v3/projects/458282dedc004065a87f028633e61b66` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:47.836381 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965a099-f468-44dd-959f-a62c4963b2ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=458282dedc004065a87f028633e61b66)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:47.838494 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965a099-f468-44dd-959f-a62c4963b2ec admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:47.911902 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d79722-d99a-4dbc-9f3b-31064bc32646 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:47.912454 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d79722-d99a-4dbc-9f3b-31064bc32646 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:47.912554 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d79722-d99a-4dbc-9f3b-31064bc32646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:47.948797 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-1965a099-f468-44dd-959f-a62c4963b2ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '458282dedc004065a87f028633e61b66', 'request_id': 'req-1965a099-f468-44dd-959f-a62c4963b2ec'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:47.955614 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-84d79722-d99a-4dbc-9f3b-31064bc32646 None None] MFA Rules not processed for user `c373e13cbd6c40ed9434caf0d2dec4b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:47.957218 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-84d79722-d99a-4dbc-9f3b-31064bc32646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:47.964975 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-1965a099-f468-44dd-959f-a62c4963b2ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '458282dedc004065a87f028633e61b66', 'request_id': 'req-1965a099-f468-44dd-959f-a62c4963b2ec'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:47.990168 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-1965a099-f468-44dd-959f-a62c4963b2ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '458282dedc004065a87f028633e61b66', 'request_id': 'req-1965a099-f468-44dd-959f-a62c4963b2ec'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:48.005667 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-1965a099-f468-44dd-959f-a62c4963b2ec admin admin] The token cache is being invalidate because project 458282dedc004065a87f028633e61b66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:48.005974 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-1965a099-f468-44dd-959f-a62c4963b2ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:48.008331 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-1965a099-f468-44dd-959f-a62c4963b2ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:48.011595 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1088/2167] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:47 2022] DELETE /identity/v3/projects/458282dedc004065a87f028633e61b66 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:48.016992 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae03716-a82a-4f93-8c4d-026de0dfaf57 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:48.017148 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae03716-a82a-4f93-8c4d-026de0dfaf57 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:48.017551 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae03716-a82a-4f93-8c4d-026de0dfaf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:48.060143 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1080/2168] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:41:48.061812 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-fae03716-a82a-4f93-8c4d-026de0dfaf57 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:48.063466 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fae03716-a82a-4f93-8c4d-026de0dfaf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:48.067153 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d79722-d99a-4dbc-9f3b-31064bc32646 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:48.068682 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-84d79722-d99a-4dbc-9f3b-31064bc32646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:48.181375 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1089/2169] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:41:48.188812 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d79722-d99a-4dbc-9f3b-31064bc32646 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:48.193315 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69ac4f-9a2e-447b-8e27-1c777a203dd1 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:48.193772 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69ac4f-9a2e-447b-8e27-1c777a203dd1 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:48.193941 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69ac4f-9a2e-447b-8e27-1c777a203dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:48.209698 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4471a-5f1e-4807-b7c1-748948d6c807 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:48.210359 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4471a-5f1e-4807-b7c1-748948d6c807 service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:48.210643 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4471a-5f1e-4807-b7c1-748948d6c807 service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:48.210915 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4471a-5f1e-4807-b7c1-748948d6c807 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:48.220552 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-dd69ac4f-9a2e-447b-8e27-1c777a203dd1 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:48.223046 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4471a-5f1e-4807-b7c1-748948d6c807 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:48.223140 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-dd69ac4f-9a2e-447b-8e27-1c777a203dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:48.228071 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4471a-5f1e-4807-b7c1-748948d6c807 service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:48.234056 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1090/2170] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:48.238667 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69ac4f-9a2e-447b-8e27-1c777a203dd1 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:48.239163 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1081/2171] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:41:48.250855 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69ac4f-9a2e-447b-8e27-1c777a203dd1 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:48.257588 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900a119-837a-44b8-91b4-adb98ae76ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:48.258345 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900a119-837a-44b8-91b4-adb98ae76ddb admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:48.258914 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900a119-837a-44b8-91b4-adb98ae76ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:48.259207 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900a119-837a-44b8-91b4-adb98ae76ddb admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:48.259985 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900a119-837a-44b8-91b4-adb98ae76ddb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:41:48.260704 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900a119-837a-44b8-91b4-adb98ae76ddb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:48.262282 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900a119-837a-44b8-91b4-adb98ae76ddb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:48.278751 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1091/2172] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:41:48.283349 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4471a-5f1e-4807-b7c1-748948d6c807 service nova] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:48.295561 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4471a-5f1e-4807-b7c1-748948d6c807 service nova] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:48.301221 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebcb3f-dc95-4886-894f-82ae1a3e7302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:48.301867 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebcb3f-dc95-4886-894f-82ae1a3e7302 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:48.302190 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebcb3f-dc95-4886-894f-82ae1a3e7302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:48.302408 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebcb3f-dc95-4886-894f-82ae1a3e7302 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:48.303118 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daebcb3f-dc95-4886-894f-82ae1a3e7302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:48.305032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daebcb3f-dc95-4886-894f-82ae1a3e7302 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:48.361570 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1082/2173] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:48 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:48.362507 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900a119-837a-44b8-91b4-adb98ae76ddb admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:48.374450 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900a119-837a-44b8-91b4-adb98ae76ddb admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:48.454955 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb04a6-a016-467b-b04f-4c76cd7e578b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:48.456387 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb04a6-a016-467b-b04f-4c76cd7e578b admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:48.456812 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb04a6-a016-467b-b04f-4c76cd7e578b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:48.457207 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb04a6-a016-467b-b04f-4c76cd7e578b admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:48.458154 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb04a6-a016-467b-b04f-4c76cd7e578b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:48.460078 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb04a6-a016-467b-b04f-4c76cd7e578b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:48.488696 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1092/2174] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:48 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:48.492625 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebcb3f-dc95-4886-894f-82ae1a3e7302 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:48.515622 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebcb3f-dc95-4886-894f-82ae1a3e7302 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:48.522991 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96ae33-b823-4586-a2f8-6ea83d95eaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:48.524565 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96ae33-b823-4586-a2f8-6ea83d95eaed admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:48.524852 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96ae33-b823-4586-a2f8-6ea83d95eaed admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:48.525181 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96ae33-b823-4586-a2f8-6ea83d95eaed admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:48.525936 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96ae33-b823-4586-a2f8-6ea83d95eaed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:48.527604 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96ae33-b823-4586-a2f8-6ea83d95eaed admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:48.539495 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1083/2175] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:48.543724 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb04a6-a016-467b-b04f-4c76cd7e578b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:48.556290 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb04a6-a016-467b-b04f-4c76cd7e578b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:48.568149 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291737f3-e9db-4a9f-90b4-0bfbef528250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:48.569085 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291737f3-e9db-4a9f-90b4-0bfbef528250 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:48.569379 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291737f3-e9db-4a9f-90b4-0bfbef528250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:48.569661 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291737f3-e9db-4a9f-90b4-0bfbef528250 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:48.570426 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291737f3-e9db-4a9f-90b4-0bfbef528250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:48.572353 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291737f3-e9db-4a9f-90b4-0bfbef528250 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:48.589056 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1093/2176] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:48.591935 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96ae33-b823-4586-a2f8-6ea83d95eaed admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:48.608095 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96ae33-b823-4586-a2f8-6ea83d95eaed admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:48.621292 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13f8fb-6b94-4c3c-8624-791e7504323a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:48.622321 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13f8fb-6b94-4c3c-8624-791e7504323a admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:48.622610 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13f8fb-6b94-4c3c-8624-791e7504323a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:48.622985 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13f8fb-6b94-4c3c-8624-791e7504323a admin admin] PATH_INFO: `/v3/projects/e08a6042764a49428ab7e63e70bc1359/users/ca6ae8f92ee44946955914e92dd77df4/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:48.655520 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13f8fb-6b94-4c3c-8624-791e7504323a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08a6042764a49428ab7e63e70bc1359, user_id=ca6ae8f92ee44946955914e92dd77df4, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:48.660258 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa13f8fb-6b94-4c3c-8624-791e7504323a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:48.700314 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002f60e-8fa6-41e5-b5ec-7759feeee21b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:48.700785 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002f60e-8fa6-41e5-b5ec-7759feeee21b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:48.700873 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002f60e-8fa6-41e5-b5ec-7759feeee21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:48.713506 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1084/2177] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:48 2022] PUT /identity/v3/projects/e08a6042764a49428ab7e63e70bc1359/users/ca6ae8f92ee44946955914e92dd77df4/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:48.753414 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d002f60e-8fa6-41e5-b5ec-7759feeee21b None None] MFA Rules not processed for user `ca6ae8f92ee44946955914e92dd77df4`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:48.761370 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d002f60e-8fa6-41e5-b5ec-7759feeee21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:48.882141 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1094/2178] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:48.894593 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13f8fb-6b94-4c3c-8624-791e7504323a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:48.896355 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-aa13f8fb-6b94-4c3c-8624-791e7504323a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:48.974282 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13f8fb-6b94-4c3c-8624-791e7504323a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:48.988557 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4cc94-1f67-48fe-9e07-497fa2b98385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:48.989513 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4cc94-1f67-48fe-9e07-497fa2b98385 service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:48.990202 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4cc94-1f67-48fe-9e07-497fa2b98385 service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:48.990202 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4cc94-1f67-48fe-9e07-497fa2b98385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:49.000758 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4cc94-1f67-48fe-9e07-497fa2b98385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:49.002834 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4cc94-1f67-48fe-9e07-497fa2b98385 service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:49.013814 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1085/2179] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:49.567415 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002f60e-8fa6-41e5-b5ec-7759feeee21b None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:49.569113 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d002f60e-8fa6-41e5-b5ec-7759feeee21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:49.654500 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002f60e-8fa6-41e5-b5ec-7759feeee21b None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:49.662159 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7864f4c-ea88-4e72-9373-781e76813f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:49.663141 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7864f4c-ea88-4e72-9373-781e76813f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:49.663496 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7864f4c-ea88-4e72-9373-781e76813f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:49.663775 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7864f4c-ea88-4e72-9373-781e76813f28 admin admin] PATH_INFO: `/v3/users/667524b90473435d9ecf321080f3d993` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:49.665158 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7864f4c-ea88-4e72-9373-781e76813f28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=667524b90473435d9ecf321080f3d993)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:49.667153 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7864f4c-ea88-4e72-9373-781e76813f28 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:49.716422 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a7864f4c-ea88-4e72-9373-781e76813f28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '667524b90473435d9ecf321080f3d993'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:49.725614 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a7864f4c-ea88-4e72-9373-781e76813f28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '667524b90473435d9ecf321080f3d993'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:49.726783 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a7864f4c-ea88-4e72-9373-781e76813f28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '667524b90473435d9ecf321080f3d993'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:49.741095 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a7864f4c-ea88-4e72-9373-781e76813f28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '667524b90473435d9ecf321080f3d993'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:49.749590 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a7864f4c-ea88-4e72-9373-781e76813f28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '667524b90473435d9ecf321080f3d993'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:49.756600 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1095/2180] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:49 2022] DELETE /identity/v3/users/667524b90473435d9ecf321080f3d993 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:49.760927 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9dc25-7a78-44db-b939-a68c52e58fa7 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:49.761278 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9dc25-7a78-44db-b939-a68c52e58fa7 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:49.761556 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9dc25-7a78-44db-b939-a68c52e58fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:49.782592 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-3cf9dc25-7a78-44db-b939-a68c52e58fa7 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:49.783877 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-3cf9dc25-7a78-44db-b939-a68c52e58fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:49.852959 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1086/2181] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:41:49.862932 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7864f4c-ea88-4e72-9373-781e76813f28 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:49.864528 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a7864f4c-ea88-4e72-9373-781e76813f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:49.933120 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7864f4c-ea88-4e72-9373-781e76813f28 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:49.937561 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40193d5-195b-47bb-b11d-fffb55647b90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:49.938702 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40193d5-195b-47bb-b11d-fffb55647b90 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:49.938986 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40193d5-195b-47bb-b11d-fffb55647b90 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:49.939262 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40193d5-195b-47bb-b11d-fffb55647b90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:49.952395 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40193d5-195b-47bb-b11d-fffb55647b90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:49.954556 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40193d5-195b-47bb-b11d-fffb55647b90 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:49.969066 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1096/2182] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:41:50.306379 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40193d5-195b-47bb-b11d-fffb55647b90 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:50.306789 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9dc25-7a78-44db-b939-a68c52e58fa7 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:50.309864 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e40193d5-195b-47bb-b11d-fffb55647b90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:50.310743 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-3cf9dc25-7a78-44db-b939-a68c52e58fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:50.343498 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9dc25-7a78-44db-b939-a68c52e58fa7 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:50.348579 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40193d5-195b-47bb-b11d-fffb55647b90 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:50.349677 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d51d5-9f59-4b30-aa1c-5362eef0ab19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:50.350772 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d51d5-9f59-4b30-aa1c-5362eef0ab19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:50.351259 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d51d5-9f59-4b30-aa1c-5362eef0ab19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:50.351756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d51d5-9f59-4b30-aa1c-5362eef0ab19 admin admin] PATH_INFO: `/v3/projects/838b5c79e0a6401bbe571a36f4837c22` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:50.353249 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d51d5-9f59-4b30-aa1c-5362eef0ab19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=838b5c79e0a6401bbe571a36f4837c22)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:50.360329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2128b-ada8-49bf-adee-ff9b17b2aba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:50.361268 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2128b-ada8-49bf-adee-ff9b17b2aba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:50.361554 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2128b-ada8-49bf-adee-ff9b17b2aba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:50.361845 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2128b-ada8-49bf-adee-ff9b17b2aba2 admin admin] PATH_INFO: `/v3/users/45f22fa15a1d44fb8a2a3e687d28d306` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:50.363937 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2128b-ada8-49bf-adee-ff9b17b2aba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45f22fa15a1d44fb8a2a3e687d28d306)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:50.366199 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a2128b-ada8-49bf-adee-ff9b17b2aba2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:50.385882 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d51d5-9f59-4b30-aa1c-5362eef0ab19 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:50.482397 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-15a2128b-ada8-49bf-adee-ff9b17b2aba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45f22fa15a1d44fb8a2a3e687d28d306'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:50.489430 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0a1d51d5-9f59-4b30-aa1c-5362eef0ab19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '838b5c79e0a6401bbe571a36f4837c22', 'request_id': 'req-0a1d51d5-9f59-4b30-aa1c-5362eef0ab19'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:50.500842 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-15a2128b-ada8-49bf-adee-ff9b17b2aba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45f22fa15a1d44fb8a2a3e687d28d306'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:50.501851 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-15a2128b-ada8-49bf-adee-ff9b17b2aba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45f22fa15a1d44fb8a2a3e687d28d306'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:50.521586 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0a1d51d5-9f59-4b30-aa1c-5362eef0ab19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '838b5c79e0a6401bbe571a36f4837c22', 'request_id': 'req-0a1d51d5-9f59-4b30-aa1c-5362eef0ab19'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:50.521945 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-15a2128b-ada8-49bf-adee-ff9b17b2aba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45f22fa15a1d44fb8a2a3e687d28d306'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:50.539706 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0a1d51d5-9f59-4b30-aa1c-5362eef0ab19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '838b5c79e0a6401bbe571a36f4837c22', 'request_id': 'req-0a1d51d5-9f59-4b30-aa1c-5362eef0ab19'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:50.549857 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-15a2128b-ada8-49bf-adee-ff9b17b2aba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45f22fa15a1d44fb8a2a3e687d28d306'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:50.564667 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1097/2183] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:50 2022] DELETE /identity/v3/users/45f22fa15a1d44fb8a2a3e687d28d306 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:50.564878 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938a343-31f2-49e5-b6c1-91ad893450a7 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:50.565160 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938a343-31f2-49e5-b6c1-91ad893450a7 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:50.565440 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938a343-31f2-49e5-b6c1-91ad893450a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:50.565725 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0a1d51d5-9f59-4b30-aa1c-5362eef0ab19 admin admin] The token cache is being invalidate because project 838b5c79e0a6401bbe571a36f4837c22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:50.566025 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0a1d51d5-9f59-4b30-aa1c-5362eef0ab19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:50.568013 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0a1d51d5-9f59-4b30-aa1c-5362eef0ab19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:50.573735 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1087/2184] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:50 2022] DELETE /identity/v3/projects/838b5c79e0a6401bbe571a36f4837c22 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:50.573735 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5993bb7-a918-4e21-ada0-c52e4a339995 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:50.573735 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5993bb7-a918-4e21-ada0-c52e4a339995 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:50.573735 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5993bb7-a918-4e21-ada0-c52e4a339995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:50.624377 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-3938a343-31f2-49e5-b6c1-91ad893450a7 None None] MFA Rules not processed for user `c373e13cbd6c40ed9434caf0d2dec4b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:50.625744 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3938a343-31f2-49e5-b6c1-91ad893450a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:50.662986 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-e5993bb7-a918-4e21-ada0-c52e4a339995 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:50.667013 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-e5993bb7-a918-4e21-ada0-c52e4a339995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:50.734963 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1098/2185] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:50.734963 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938a343-31f2-49e5-b6c1-91ad893450a7 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:50.734963 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3938a343-31f2-49e5-b6c1-91ad893450a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:50.837163 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1088/2186] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:50.850965 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5993bb7-a918-4e21-ada0-c52e4a339995 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:50.856538 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-e5993bb7-a918-4e21-ada0-c52e4a339995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:50.907898 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938a343-31f2-49e5-b6c1-91ad893450a7 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:50.924427 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f333c-8da9-4562-a844-bd64295f842a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:50.925692 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f333c-8da9-4562-a844-bd64295f842a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:50.927174 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f333c-8da9-4562-a844-bd64295f842a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:50.927645 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f333c-8da9-4562-a844-bd64295f842a admin admin] PATH_INFO: `/v3/users/7eb215a26ae943c8a43959874c6b8025` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:50.930677 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f333c-8da9-4562-a844-bd64295f842a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eb215a26ae943c8a43959874c6b8025)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:50.935276 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f333c-8da9-4562-a844-bd64295f842a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:51.032717 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-018f333c-8da9-4562-a844-bd64295f842a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eb215a26ae943c8a43959874c6b8025'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:51.041554 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-018f333c-8da9-4562-a844-bd64295f842a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eb215a26ae943c8a43959874c6b8025'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:51.042253 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-018f333c-8da9-4562-a844-bd64295f842a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eb215a26ae943c8a43959874c6b8025'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:51.046697 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5993bb7-a918-4e21-ada0-c52e4a339995 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:51.052205 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24216955-61d1-423d-ab29-b51035f95567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:51.053292 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24216955-61d1-423d-ab29-b51035f95567 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:51.053876 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24216955-61d1-423d-ab29-b51035f95567 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:51.054294 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24216955-61d1-423d-ab29-b51035f95567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:51.057316 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-018f333c-8da9-4562-a844-bd64295f842a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eb215a26ae943c8a43959874c6b8025'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:51.067135 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24216955-61d1-423d-ab29-b51035f95567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:51.068617 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24216955-61d1-423d-ab29-b51035f95567 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:51.070575 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-018f333c-8da9-4562-a844-bd64295f842a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eb215a26ae943c8a43959874c6b8025'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:51.078952 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1099/2187] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:50 2022] DELETE /identity/v3/users/7eb215a26ae943c8a43959874c6b8025 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:51.088682 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1089/2188] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:51.630809 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f333c-8da9-4562-a844-bd64295f842a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:51.632570 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-018f333c-8da9-4562-a844-bd64295f842a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:51.729950 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24216955-61d1-423d-ab29-b51035f95567 service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:51.734185 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-24216955-61d1-423d-ab29-b51035f95567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:51.764916 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f333c-8da9-4562-a844-bd64295f842a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:51.770556 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4576e-09cc-4e51-9e31-f9217796bc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:51.771052 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24216955-61d1-423d-ab29-b51035f95567 service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:51.771816 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4576e-09cc-4e51-9e31-f9217796bc94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:51.772246 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4576e-09cc-4e51-9e31-f9217796bc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:51.772597 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4576e-09cc-4e51-9e31-f9217796bc94 admin admin] PATH_INFO: `/v3/projects/2040c46f1e794c5cb1808f62c83d1ac5` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:51.774238 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4576e-09cc-4e51-9e31-f9217796bc94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2040c46f1e794c5cb1808f62c83d1ac5)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:51.776457 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4576e-09cc-4e51-9e31-f9217796bc94 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:51.792040 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eab07b-d7ad-493e-8410-327bb8a94f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:51.793843 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eab07b-d7ad-493e-8410-327bb8a94f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:51.794727 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eab07b-d7ad-493e-8410-327bb8a94f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:51.795164 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eab07b-d7ad-493e-8410-327bb8a94f8a admin admin] PATH_INFO: `/v3/projects/11842d8563464d73932aa00ec7cb473c` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:51.796588 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eab07b-d7ad-493e-8410-327bb8a94f8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=11842d8563464d73932aa00ec7cb473c)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:51.799575 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eab07b-d7ad-493e-8410-327bb8a94f8a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:51.874366 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-92eab07b-d7ad-493e-8410-327bb8a94f8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11842d8563464d73932aa00ec7cb473c', 'request_id': 'req-92eab07b-d7ad-493e-8410-327bb8a94f8a'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:51.885721 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-92eab07b-d7ad-493e-8410-327bb8a94f8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11842d8563464d73932aa00ec7cb473c', 'request_id': 'req-92eab07b-d7ad-493e-8410-327bb8a94f8a'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:51.889790 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-26a4576e-09cc-4e51-9e31-f9217796bc94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2040c46f1e794c5cb1808f62c83d1ac5', 'request_id': 'req-26a4576e-09cc-4e51-9e31-f9217796bc94'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:51.909259 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-92eab07b-d7ad-493e-8410-327bb8a94f8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11842d8563464d73932aa00ec7cb473c', 'request_id': 'req-92eab07b-d7ad-493e-8410-327bb8a94f8a'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:51.911042 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-26a4576e-09cc-4e51-9e31-f9217796bc94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2040c46f1e794c5cb1808f62c83d1ac5', 'request_id': 'req-26a4576e-09cc-4e51-9e31-f9217796bc94'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:51.928795 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-26a4576e-09cc-4e51-9e31-f9217796bc94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2040c46f1e794c5cb1808f62c83d1ac5', 'request_id': 'req-26a4576e-09cc-4e51-9e31-f9217796bc94'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:51.936621 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-92eab07b-d7ad-493e-8410-327bb8a94f8a admin admin] The token cache is being invalidate because project 11842d8563464d73932aa00ec7cb473c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:51.937137 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-92eab07b-d7ad-493e-8410-327bb8a94f8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:51.937903 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-92eab07b-d7ad-493e-8410-327bb8a94f8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:51.941422 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1090/2189] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:51 2022] DELETE /identity/v3/projects/11842d8563464d73932aa00ec7cb473c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:51.947345 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-26a4576e-09cc-4e51-9e31-f9217796bc94 admin admin] The token cache is being invalidate because project 2040c46f1e794c5cb1808f62c83d1ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:51.947644 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-26a4576e-09cc-4e51-9e31-f9217796bc94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:51.948751 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-26a4576e-09cc-4e51-9e31-f9217796bc94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:51.951147 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f1730-7645-40c4-b11f-03455c1971ed None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:51.951437 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f1730-7645-40c4-b11f-03455c1971ed None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:51.951921 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1100/2190] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:51 2022] DELETE /identity/v3/projects/2040c46f1e794c5cb1808f62c83d1ac5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:51.952039 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398f1730-7645-40c4-b11f-03455c1971ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:51.958800 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd5e8e-1163-47a0-82f3-638f8aecbbcd None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:51.959129 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd5e8e-1163-47a0-82f3-638f8aecbbcd None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:51.959361 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd5e8e-1163-47a0-82f3-638f8aecbbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:52.014091 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2bcd5e8e-1163-47a0-82f3-638f8aecbbcd None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:52.019710 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2bcd5e8e-1163-47a0-82f3-638f8aecbbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:52.026159 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-398f1730-7645-40c4-b11f-03455c1971ed None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:52.027352 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-398f1730-7645-40c4-b11f-03455c1971ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:52.179621 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1101/2191] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:52.180569 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd5e8e-1163-47a0-82f3-638f8aecbbcd None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:52.191098 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2bcd5e8e-1163-47a0-82f3-638f8aecbbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:52.194805 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1091/2192] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:52.197550 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a16795-b742-444e-80b4-8d12eff8ccef None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:52.197844 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a16795-b742-444e-80b4-8d12eff8ccef None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:52.198180 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a16795-b742-444e-80b4-8d12eff8ccef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:52.206262 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd5e8e-1163-47a0-82f3-638f8aecbbcd None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:52.220602 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-f3a16795-b742-444e-80b4-8d12eff8ccef None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:52.221785 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cdef5-a71c-428c-ab68-26f4e5d042ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:52.221918 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-f3a16795-b742-444e-80b4-8d12eff8ccef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:52.228509 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cdef5-a71c-428c-ab68-26f4e5d042ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:52.228956 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cdef5-a71c-428c-ab68-26f4e5d042ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:52.229389 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cdef5-a71c-428c-ab68-26f4e5d042ec admin admin] PATH_INFO: `/v3/users/ca6ae8f92ee44946955914e92dd77df4` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:52.230823 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cdef5-a71c-428c-ab68-26f4e5d042ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca6ae8f92ee44946955914e92dd77df4)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:52.234282 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1092/2193] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:52.234424 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cdef5-a71c-428c-ab68-26f4e5d042ec admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:52.234515 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee60c0-4a8f-4f49-851b-bf628e7fea08 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:52.234515 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee60c0-4a8f-4f49-851b-bf628e7fea08 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:52.234515 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee60c0-4a8f-4f49-851b-bf628e7fea08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:52.257283 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-9bee60c0-4a8f-4f49-851b-bf628e7fea08 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:52.258622 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-9bee60c0-4a8f-4f49-851b-bf628e7fea08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:52.271288 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1093/2194] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:52.275874 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee60c0-4a8f-4f49-851b-bf628e7fea08 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:52.286625 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee60c0-4a8f-4f49-851b-bf628e7fea08 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:52.293602 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859c8dd-c784-492a-b754-5f3dee398429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:52.294437 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859c8dd-c784-492a-b754-5f3dee398429 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:52.294785 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859c8dd-c784-492a-b754-5f3dee398429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:52.295211 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859c8dd-c784-492a-b754-5f3dee398429 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:52.296049 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859c8dd-c784-492a-b754-5f3dee398429 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:41:52.296424 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859c8dd-c784-492a-b754-5f3dee398429 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:52.300012 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859c8dd-c784-492a-b754-5f3dee398429 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:52.304254 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9c6cdef5-a71c-428c-ab68-26f4e5d042ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca6ae8f92ee44946955914e92dd77df4'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:52.329853 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1094/2195] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:41:52.330074 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9c6cdef5-a71c-428c-ab68-26f4e5d042ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca6ae8f92ee44946955914e92dd77df4'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:52.330159 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859c8dd-c784-492a-b754-5f3dee398429 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:52.333401 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9c6cdef5-a71c-428c-ab68-26f4e5d042ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca6ae8f92ee44946955914e92dd77df4'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:52.348379 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859c8dd-c784-492a-b754-5f3dee398429 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:52.353840 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9c6cdef5-a71c-428c-ab68-26f4e5d042ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca6ae8f92ee44946955914e92dd77df4'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:52.355565 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3047fd3-bf38-4729-b1db-d850bca119c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:52.356854 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3047fd3-bf38-4729-b1db-d850bca119c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:52.357461 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3047fd3-bf38-4729-b1db-d850bca119c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:52.358601 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3047fd3-bf38-4729-b1db-d850bca119c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:52.365658 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9c6cdef5-a71c-428c-ab68-26f4e5d042ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca6ae8f92ee44946955914e92dd77df4'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:52.371899 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3047fd3-bf38-4729-b1db-d850bca119c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:41:52.372694 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3047fd3-bf38-4729-b1db-d850bca119c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:52.373461 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1102/2196] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:52 2022] DELETE /identity/v3/users/ca6ae8f92ee44946955914e92dd77df4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:52.374508 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cdef5-a71c-428c-ab68-26f4e5d042ec admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:52.376327 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9c6cdef5-a71c-428c-ab68-26f4e5d042ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:52.377417 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3047fd3-bf38-4729-b1db-d850bca119c5 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:52.395036 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1095/2197] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:41:52.396552 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001bb30-9360-4c4c-82f6-776dadc75a6b None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:52.396911 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001bb30-9360-4c4c-82f6-776dadc75a6b None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:52.397284 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001bb30-9360-4c4c-82f6-776dadc75a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:52.416394 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-c001bb30-9360-4c4c-82f6-776dadc75a6b None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:52.417544 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-c001bb30-9360-4c4c-82f6-776dadc75a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:52.488220 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1096/2198] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:52.492678 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001bb30-9360-4c4c-82f6-776dadc75a6b None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:52.494151 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-c001bb30-9360-4c4c-82f6-776dadc75a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:52.510774 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cdef5-a71c-428c-ab68-26f4e5d042ec admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:52.516146 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f4ae2-d550-474a-a2f9-14310e6de64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:52.518435 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f4ae2-d550-474a-a2f9-14310e6de64e admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:52.518797 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f4ae2-d550-474a-a2f9-14310e6de64e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:52.519144 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f4ae2-d550-474a-a2f9-14310e6de64e admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:52.520260 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f4ae2-d550-474a-a2f9-14310e6de64e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:52.523519 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f4ae2-d550-474a-a2f9-14310e6de64e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:52.527645 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c001bb30-9360-4c4c-82f6-776dadc75a6b None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:52.541603 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54645e94-c63b-45ea-bcf5-9f7cf9b21dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:52.542352 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54645e94-c63b-45ea-bcf5-9f7cf9b21dcc admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:52.542709 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54645e94-c63b-45ea-bcf5-9f7cf9b21dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:52.543062 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54645e94-c63b-45ea-bcf5-9f7cf9b21dcc admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:52.546074 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54645e94-c63b-45ea-bcf5-9f7cf9b21dcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:52.548432 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54645e94-c63b-45ea-bcf5-9f7cf9b21dcc admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:52.561472 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1103/2199] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:52 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:52.561472 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f4ae2-d550-474a-a2f9-14310e6de64e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:52.561472 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3e8f4ae2-d550-474a-a2f9-14310e6de64e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:52.597217 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1097/2200] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:52 2022] POST /identity/v3/projects => generated 359 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:52.598166 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54645e94-c63b-45ea-bcf5-9f7cf9b21dcc admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:52.648306 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f4ae2-d550-474a-a2f9-14310e6de64e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:52.734293 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54645e94-c63b-45ea-bcf5-9f7cf9b21dcc admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:52.741872 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642cd3b-8da2-4910-a048-d54cfc9dcd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:52.742570 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642cd3b-8da2-4910-a048-d54cfc9dcd29 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:52.742850 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642cd3b-8da2-4910-a048-d54cfc9dcd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:52.743222 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642cd3b-8da2-4910-a048-d54cfc9dcd29 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:52.744042 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642cd3b-8da2-4910-a048-d54cfc9dcd29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:52.745985 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642cd3b-8da2-4910-a048-d54cfc9dcd29 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:52.770313 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acad52c-621d-45a0-a3b5-be289023418c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:52.771636 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acad52c-621d-45a0-a3b5-be289023418c service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:52.772066 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acad52c-621d-45a0-a3b5-be289023418c service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:52.772577 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acad52c-621d-45a0-a3b5-be289023418c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:52.779989 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1098/2201] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:52 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:52.780910 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642cd3b-8da2-4910-a048-d54cfc9dcd29 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:52.794738 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642cd3b-8da2-4910-a048-d54cfc9dcd29 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:52.796791 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acad52c-621d-45a0-a3b5-be289023418c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:52.798406 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acad52c-621d-45a0-a3b5-be289023418c service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:52.806633 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d0c7a-1f5b-4f04-a2db-4b95fa681cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:52.807322 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d0c7a-1f5b-4f04-a2db-4b95fa681cda admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:52.807605 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d0c7a-1f5b-4f04-a2db-4b95fa681cda admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:52.807883 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d0c7a-1f5b-4f04-a2db-4b95fa681cda admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:52.808908 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d0c7a-1f5b-4f04-a2db-4b95fa681cda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:52.812675 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d0c7a-1f5b-4f04-a2db-4b95fa681cda admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:52.824517 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1104/2202] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:52.826062 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acad52c-621d-45a0-a3b5-be289023418c service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:52.851047 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1099/2203] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:52 2022] POST /identity/v3/users => generated 280 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:52.855820 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d0c7a-1f5b-4f04-a2db-4b95fa681cda admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:52.863197 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acad52c-621d-45a0-a3b5-be289023418c service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:52.872720 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d0c7a-1f5b-4f04-a2db-4b95fa681cda admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:52.883805 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803e1cb-f77b-4fcd-b146-5fcee49461e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:52.884496 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803e1cb-f77b-4fcd-b146-5fcee49461e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:52.884782 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803e1cb-f77b-4fcd-b146-5fcee49461e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:52.885088 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803e1cb-f77b-4fcd-b146-5fcee49461e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:52.885841 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803e1cb-f77b-4fcd-b146-5fcee49461e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:52.887792 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803e1cb-f77b-4fcd-b146-5fcee49461e7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:52.895450 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0c6a9-5b5f-4ca7-8e66-8eb5b87490aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:52.896099 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0c6a9-5b5f-4ca7-8e66-8eb5b87490aa admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:52.896354 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0c6a9-5b5f-4ca7-8e66-8eb5b87490aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:52.896624 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0c6a9-5b5f-4ca7-8e66-8eb5b87490aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:52.897404 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0c6a9-5b5f-4ca7-8e66-8eb5b87490aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:52.899479 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0c6a9-5b5f-4ca7-8e66-8eb5b87490aa admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:52.918783 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1100/2204] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:52.919915 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0c6a9-5b5f-4ca7-8e66-8eb5b87490aa admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:52.933262 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1105/2205] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:52.937503 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803e1cb-f77b-4fcd-b146-5fcee49461e7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:52.939454 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0c6a9-5b5f-4ca7-8e66-8eb5b87490aa admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:52.946648 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca55dc-9828-4a1d-be8f-ecb2dc2809f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:52.948369 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca55dc-9828-4a1d-be8f-ecb2dc2809f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:52.949126 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca55dc-9828-4a1d-be8f-ecb2dc2809f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:52.949254 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803e1cb-f77b-4fcd-b146-5fcee49461e7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:52.949417 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca55dc-9828-4a1d-be8f-ecb2dc2809f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:52.950553 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca55dc-9828-4a1d-be8f-ecb2dc2809f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:52.952484 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca55dc-9828-4a1d-be8f-ecb2dc2809f2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:52.954340 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d04d4-59d4-4aa8-8362-d5e95e0a0138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:52.955230 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d04d4-59d4-4aa8-8362-d5e95e0a0138 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:52.955854 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d04d4-59d4-4aa8-8362-d5e95e0a0138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:52.955984 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d04d4-59d4-4aa8-8362-d5e95e0a0138 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:52.956776 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d04d4-59d4-4aa8-8362-d5e95e0a0138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:52.958838 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d04d4-59d4-4aa8-8362-d5e95e0a0138 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:52.971596 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1106/2207] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:52.971727 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1101/2207] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:52.976414 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d04d4-59d4-4aa8-8362-d5e95e0a0138 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:52.979859 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca55dc-9828-4a1d-be8f-ecb2dc2809f2 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:52.990037 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d04d4-59d4-4aa8-8362-d5e95e0a0138 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:52.993255 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca55dc-9828-4a1d-be8f-ecb2dc2809f2 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:52.996197 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcb2d0-5b36-4511-8a68-616f3df49030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:52.999036 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcb2d0-5b36-4511-8a68-616f3df49030 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:52.999423 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcb2d0-5b36-4511-8a68-616f3df49030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:52.999801 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcb2d0-5b36-4511-8a68-616f3df49030 admin admin] PATH_INFO: `/v3/projects/c4e20a51ed0c4b4c8807d91e759777bd/users/4fd96943edd048549a9f1e30cfa1a4a2/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:52.999939 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f35d71-9dde-40d9-a813-637238881288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:53.000917 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f35d71-9dde-40d9-a813-637238881288 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:53.001226 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f35d71-9dde-40d9-a813-637238881288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:53.001511 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f35d71-9dde-40d9-a813-637238881288 admin admin] PATH_INFO: `/v3/projects/28c4d033b8fe40fa8d857ef89c1b2c1e/users/e2fc5ace98a241d2adae57f324bfbeb9/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:53.022932 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcb2d0-5b36-4511-8a68-616f3df49030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4e20a51ed0c4b4c8807d91e759777bd, user_id=4fd96943edd048549a9f1e30cfa1a4a2, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:53.024157 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f35d71-9dde-40d9-a813-637238881288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28c4d033b8fe40fa8d857ef89c1b2c1e, user_id=e2fc5ace98a241d2adae57f324bfbeb9, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:53.027213 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f35d71-9dde-40d9-a813-637238881288 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:53.027683 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcb2d0-5b36-4511-8a68-616f3df49030 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:53.048311 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1102/2208] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:52 2022] PUT /identity/v3/projects/28c4d033b8fe40fa8d857ef89c1b2c1e/users/e2fc5ace98a241d2adae57f324bfbeb9/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:53.048516 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1107/2209] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:52 2022] PUT /identity/v3/projects/c4e20a51ed0c4b4c8807d91e759777bd/users/4fd96943edd048549a9f1e30cfa1a4a2/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:53.059335 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2162cf-9fe7-4423-8a3a-4e52bdab477a None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:53.059631 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2162cf-9fe7-4423-8a3a-4e52bdab477a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:53.059910 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2162cf-9fe7-4423-8a3a-4e52bdab477a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:53.060019 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30fe45-931e-4984-8b9b-9d9f7517b70e None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:53.060204 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30fe45-931e-4984-8b9b-9d9f7517b70e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:53.060488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30fe45-931e-4984-8b9b-9d9f7517b70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:53.097743 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-6b2162cf-9fe7-4423-8a3a-4e52bdab477a None None] MFA Rules not processed for user `4fd96943edd048549a9f1e30cfa1a4a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:53.099234 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-6b2162cf-9fe7-4423-8a3a-4e52bdab477a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:53.101488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-9f30fe45-931e-4984-8b9b-9d9f7517b70e None None] MFA Rules not processed for user `e2fc5ace98a241d2adae57f324bfbeb9`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:53.103002 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9f30fe45-931e-4984-8b9b-9d9f7517b70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:53.211637 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1103/2210] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:53 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:53.249050 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2162cf-9fe7-4423-8a3a-4e52bdab477a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:53.252024 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-6b2162cf-9fe7-4423-8a3a-4e52bdab477a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:53.259022 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1108/2211] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:53.263419 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30fe45-931e-4984-8b9b-9d9f7517b70e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:53.340112 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2162cf-9fe7-4423-8a3a-4e52bdab477a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:53.346825 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81caf6-11be-4436-9e68-e73ecb8fd630 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:53.347617 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81caf6-11be-4436-9e68-e73ecb8fd630 service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:53.347896 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81caf6-11be-4436-9e68-e73ecb8fd630 service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:53.348313 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81caf6-11be-4436-9e68-e73ecb8fd630 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:53.358875 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81caf6-11be-4436-9e68-e73ecb8fd630 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:53.362694 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81caf6-11be-4436-9e68-e73ecb8fd630 service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:53.368316 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30fe45-931e-4984-8b9b-9d9f7517b70e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:53.371017 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1104/2212] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:53 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:53.371839 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81caf6-11be-4436-9e68-e73ecb8fd630 service cinder] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:53.373325 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-1f81caf6-11be-4436-9e68-e73ecb8fd630 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:53.374159 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999c360-b081-458f-a4a8-16b0c37d7280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:53.374843 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999c360-b081-458f-a4a8-16b0c37d7280 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:53.375100 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999c360-b081-458f-a4a8-16b0c37d7280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:53.375373 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999c360-b081-458f-a4a8-16b0c37d7280 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:53.376236 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999c360-b081-458f-a4a8-16b0c37d7280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:53.378214 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999c360-b081-458f-a4a8-16b0c37d7280 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:53.404322 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81caf6-11be-4436-9e68-e73ecb8fd630 service cinder] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:53.407178 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1109/2213] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:53 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:41:53.408777 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999c360-b081-458f-a4a8-16b0c37d7280 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:53.410284 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0b848-8167-47ab-8e66-7c32da53f69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:53.411300 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0b848-8167-47ab-8e66-7c32da53f69e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:53.411579 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0b848-8167-47ab-8e66-7c32da53f69e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:53.411849 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0b848-8167-47ab-8e66-7c32da53f69e admin admin] PATH_INFO: `/v3/projects/e08a6042764a49428ab7e63e70bc1359` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:53.413096 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0b848-8167-47ab-8e66-7c32da53f69e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08a6042764a49428ab7e63e70bc1359)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:53.416287 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0b848-8167-47ab-8e66-7c32da53f69e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:53.488478 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999c360-b081-458f-a4a8-16b0c37d7280 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:53.489315 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-80e0b848-8167-47ab-8e66-7c32da53f69e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08a6042764a49428ab7e63e70bc1359', 'request_id': 'req-80e0b848-8167-47ab-8e66-7c32da53f69e'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:53.498704 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-80e0b848-8167-47ab-8e66-7c32da53f69e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08a6042764a49428ab7e63e70bc1359', 'request_id': 'req-80e0b848-8167-47ab-8e66-7c32da53f69e'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:53.510205 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-80e0b848-8167-47ab-8e66-7c32da53f69e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08a6042764a49428ab7e63e70bc1359', 'request_id': 'req-80e0b848-8167-47ab-8e66-7c32da53f69e'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:53.539269 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-80e0b848-8167-47ab-8e66-7c32da53f69e admin admin] The token cache is being invalidate because project e08a6042764a49428ab7e63e70bc1359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:53.539592 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-80e0b848-8167-47ab-8e66-7c32da53f69e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:53.542062 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-80e0b848-8167-47ab-8e66-7c32da53f69e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:53.546918 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1105/2214] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:53 2022] DELETE /identity/v3/projects/e08a6042764a49428ab7e63e70bc1359 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:53.550304 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0b848-8167-47ab-8e66-7c32da53f69e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:53.553060 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-80e0b848-8167-47ab-8e66-7c32da53f69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:53.583435 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a2f84-6f01-4f43-9567-a7ca0a48fb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:53.585140 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a2f84-6f01-4f43-9567-a7ca0a48fb4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:53.585535 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a2f84-6f01-4f43-9567-a7ca0a48fb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:53.586303 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a2f84-6f01-4f43-9567-a7ca0a48fb4d admin admin] PATH_INFO: `/v3/users/4fd96943edd048549a9f1e30cfa1a4a2` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:53.591779 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a2f84-6f01-4f43-9567-a7ca0a48fb4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fd96943edd048549a9f1e30cfa1a4a2)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:53.595923 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a2f84-6f01-4f43-9567-a7ca0a48fb4d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:53.691184 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0b848-8167-47ab-8e66-7c32da53f69e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:53.697422 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df200c-ccb7-4e05-af43-0bad226ab527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:53.698552 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df200c-ccb7-4e05-af43-0bad226ab527 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:53.699046 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df200c-ccb7-4e05-af43-0bad226ab527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:53.699587 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df200c-ccb7-4e05-af43-0bad226ab527 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:53.700768 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df200c-ccb7-4e05-af43-0bad226ab527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:53.703277 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df200c-ccb7-4e05-af43-0bad226ab527 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:53.723858 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3e0a2f84-6f01-4f43-9567-a7ca0a48fb4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fd96943edd048549a9f1e30cfa1a4a2'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:53.732166 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1106/2215] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:53 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:53.733976 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3e0a2f84-6f01-4f43-9567-a7ca0a48fb4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fd96943edd048549a9f1e30cfa1a4a2'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:53.735635 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3e0a2f84-6f01-4f43-9567-a7ca0a48fb4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fd96943edd048549a9f1e30cfa1a4a2'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:53.736346 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df200c-ccb7-4e05-af43-0bad226ab527 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:53.749676 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df200c-ccb7-4e05-af43-0bad226ab527 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:53.753033 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3e0a2f84-6f01-4f43-9567-a7ca0a48fb4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fd96943edd048549a9f1e30cfa1a4a2'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:53.755324 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a986219-4fd0-4ccc-85b2-dee730a80189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:53.756049 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a986219-4fd0-4ccc-85b2-dee730a80189 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:53.757889 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a986219-4fd0-4ccc-85b2-dee730a80189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:53.757889 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a986219-4fd0-4ccc-85b2-dee730a80189 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:53.758554 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a986219-4fd0-4ccc-85b2-dee730a80189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:53.760051 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a986219-4fd0-4ccc-85b2-dee730a80189 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:53.761453 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3e0a2f84-6f01-4f43-9567-a7ca0a48fb4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fd96943edd048549a9f1e30cfa1a4a2'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:53.768872 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1110/2216] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:53 2022] DELETE /identity/v3/users/4fd96943edd048549a9f1e30cfa1a4a2 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:53.772220 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1107/2217] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:53.773933 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3527b01-c7da-4b08-994f-79bbbe28366f None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:53.774761 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3527b01-c7da-4b08-994f-79bbbe28366f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:53.775706 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3527b01-c7da-4b08-994f-79bbbe28366f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:53.777188 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a986219-4fd0-4ccc-85b2-dee730a80189 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:53.779242 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7a986219-4fd0-4ccc-85b2-dee730a80189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:53.793677 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a986219-4fd0-4ccc-85b2-dee730a80189 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:53.795329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-f3527b01-c7da-4b08-994f-79bbbe28366f None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:53.796105 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f3527b01-c7da-4b08-994f-79bbbe28366f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:53.848775 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf532f6-c33b-4e5e-844f-296c16a411b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:53.849703 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf532f6-c33b-4e5e-844f-296c16a411b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:53.849991 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf532f6-c33b-4e5e-844f-296c16a411b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:53.850267 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf532f6-c33b-4e5e-844f-296c16a411b7 admin admin] PATH_INFO: `/v3/projects/990b9a96331d44e482a3b14a2c39abaa/users/b6bb4313c54a48258dfe30efd6c20a31/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:53.857346 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1111/2218] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:41:53.865912 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf532f6-c33b-4e5e-844f-296c16a411b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=990b9a96331d44e482a3b14a2c39abaa, user_id=b6bb4313c54a48258dfe30efd6c20a31, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:53.867724 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3527b01-c7da-4b08-994f-79bbbe28366f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:53.868679 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf532f6-c33b-4e5e-844f-296c16a411b7 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:53.869321 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f3527b01-c7da-4b08-994f-79bbbe28366f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:53.885254 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1108/2219] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:53 2022] PUT /identity/v3/projects/990b9a96331d44e482a3b14a2c39abaa/users/b6bb4313c54a48258dfe30efd6c20a31/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:41:53.889621 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf532f6-c33b-4e5e-844f-296c16a411b7 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:53.931081 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3527b01-c7da-4b08-994f-79bbbe28366f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:53.976824 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf532f6-c33b-4e5e-844f-296c16a411b7 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:53.981849 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee4b58-b586-4701-ac37-8074e5d16295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:53.983326 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee4b58-b586-4701-ac37-8074e5d16295 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:53.983619 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee4b58-b586-4701-ac37-8074e5d16295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:53.983910 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee4b58-b586-4701-ac37-8074e5d16295 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:53.984666 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee4b58-b586-4701-ac37-8074e5d16295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:53.986889 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee4b58-b586-4701-ac37-8074e5d16295 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:54.003032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1109/2220] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:41:54.003965 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee4b58-b586-4701-ac37-8074e5d16295 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:54.005605 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b208dc-c9dc-4d2f-892b-b00c6d8e47a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:54.006557 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b208dc-c9dc-4d2f-892b-b00c6d8e47a1 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:54.006989 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b208dc-c9dc-4d2f-892b-b00c6d8e47a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:54.007411 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b208dc-c9dc-4d2f-892b-b00c6d8e47a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:54.013850 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee4b58-b586-4701-ac37-8074e5d16295 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:54.019200 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a76ec-040d-4f48-ae9f-905ec1dfb63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:54.020095 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a76ec-040d-4f48-ae9f-905ec1dfb63e admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:54.020377 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a76ec-040d-4f48-ae9f-905ec1dfb63e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:54.020648 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a76ec-040d-4f48-ae9f-905ec1dfb63e admin admin] PATH_INFO: `/v3/projects/990b9a96331d44e482a3b14a2c39abaa/users/b6bb4313c54a48258dfe30efd6c20a31/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:54.021156 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b208dc-c9dc-4d2f-892b-b00c6d8e47a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:54.022789 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b208dc-c9dc-4d2f-892b-b00c6d8e47a1 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:54.022924 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a76ec-040d-4f48-ae9f-905ec1dfb63e admin admin] RBAC: Authorizing `identity:create_grant(project_id=990b9a96331d44e482a3b14a2c39abaa, user_id=b6bb4313c54a48258dfe30efd6c20a31, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:54.025776 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a76ec-040d-4f48-ae9f-905ec1dfb63e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:54.034246 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1112/2221] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:41:54.041045 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1110/2222] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:54 2022] PUT /identity/v3/projects/990b9a96331d44e482a3b14a2c39abaa/users/b6bb4313c54a48258dfe30efd6c20a31/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:54.047635 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49e99c-bf73-4fb4-853d-ea5ffb64e3a9 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:54.047928 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49e99c-bf73-4fb4-853d-ea5ffb64e3a9 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:54.048226 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49e99c-bf73-4fb4-853d-ea5ffb64e3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:54.075607 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-9b49e99c-bf73-4fb4-853d-ea5ffb64e3a9 None None] MFA Rules not processed for user `b6bb4313c54a48258dfe30efd6c20a31`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:54.076845 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9b49e99c-bf73-4fb4-853d-ea5ffb64e3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:54.167309 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1113/2223] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:54.177242 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a76ec-040d-4f48-ae9f-905ec1dfb63e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:54.179596 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-638a76ec-040d-4f48-ae9f-905ec1dfb63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:54.260881 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a76ec-040d-4f48-ae9f-905ec1dfb63e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:54.268317 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a65a8-bd32-4a97-b913-b6721e8a6efa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:54.269858 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a65a8-bd32-4a97-b913-b6721e8a6efa service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:54.270459 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a65a8-bd32-4a97-b913-b6721e8a6efa service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:54.270803 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a65a8-bd32-4a97-b913-b6721e8a6efa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:54.281672 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a65a8-bd32-4a97-b913-b6721e8a6efa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:54.283490 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a65a8-bd32-4a97-b913-b6721e8a6efa service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:54.299231 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1111/2224] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:54.326835 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49e99c-bf73-4fb4-853d-ea5ffb64e3a9 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:54.404473 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49e99c-bf73-4fb4-853d-ea5ffb64e3a9 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:54.418625 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4e9a7-359a-46b4-8b21-0f2995c43a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:54.420045 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4e9a7-359a-46b4-8b21-0f2995c43a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:54.420528 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4e9a7-359a-46b4-8b21-0f2995c43a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:54.420833 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4e9a7-359a-46b4-8b21-0f2995c43a5a admin admin] PATH_INFO: `/v3/users/e2fc5ace98a241d2adae57f324bfbeb9` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:54.422477 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4e9a7-359a-46b4-8b21-0f2995c43a5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2fc5ace98a241d2adae57f324bfbeb9)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:54.424067 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4e9a7-359a-46b4-8b21-0f2995c43a5a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:54.480409 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-17e4e9a7-359a-46b4-8b21-0f2995c43a5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2fc5ace98a241d2adae57f324bfbeb9'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:54.492717 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-17e4e9a7-359a-46b4-8b21-0f2995c43a5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2fc5ace98a241d2adae57f324bfbeb9'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:54.493544 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-17e4e9a7-359a-46b4-8b21-0f2995c43a5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2fc5ace98a241d2adae57f324bfbeb9'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:54.507960 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-17e4e9a7-359a-46b4-8b21-0f2995c43a5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2fc5ace98a241d2adae57f324bfbeb9'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:54.516068 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-17e4e9a7-359a-46b4-8b21-0f2995c43a5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2fc5ace98a241d2adae57f324bfbeb9'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:54.525107 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1114/2225] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:54 2022] DELETE /identity/v3/users/e2fc5ace98a241d2adae57f324bfbeb9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:54.529828 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17e215-5a0e-45d8-9a9a-0d131713f504 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:54.530122 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17e215-5a0e-45d8-9a9a-0d131713f504 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:54.530402 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17e215-5a0e-45d8-9a9a-0d131713f504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:54.553185 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-7b17e215-5a0e-45d8-9a9a-0d131713f504 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:54.554413 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7b17e215-5a0e-45d8-9a9a-0d131713f504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:54.616191 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1112/2226] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:54.625885 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4e9a7-359a-46b4-8b21-0f2995c43a5a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:54.627970 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-17e4e9a7-359a-46b4-8b21-0f2995c43a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:54.687253 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4e9a7-359a-46b4-8b21-0f2995c43a5a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:54.691960 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f41bf2-8bce-4c2f-80e7-27c88bad154d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:54.692652 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f41bf2-8bce-4c2f-80e7-27c88bad154d service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:54.692922 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f41bf2-8bce-4c2f-80e7-27c88bad154d service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:54.693237 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f41bf2-8bce-4c2f-80e7-27c88bad154d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:54.705965 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f41bf2-8bce-4c2f-80e7-27c88bad154d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:54.710879 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f41bf2-8bce-4c2f-80e7-27c88bad154d service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:54.726314 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1115/2227] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:41:54.728165 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17e215-5a0e-45d8-9a9a-0d131713f504 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:54.729742 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7b17e215-5a0e-45d8-9a9a-0d131713f504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:54.755140 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17e215-5a0e-45d8-9a9a-0d131713f504 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:54.763743 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399833e-eaab-4a40-9c4c-c451f5c2b9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:54.764851 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399833e-eaab-4a40-9c4c-c451f5c2b9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:54.765342 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399833e-eaab-4a40-9c4c-c451f5c2b9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:54.765908 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399833e-eaab-4a40-9c4c-c451f5c2b9ae admin admin] PATH_INFO: `/v3/projects/c4e20a51ed0c4b4c8807d91e759777bd` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:54.768577 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399833e-eaab-4a40-9c4c-c451f5c2b9ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4e20a51ed0c4b4c8807d91e759777bd)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:54.772416 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399833e-eaab-4a40-9c4c-c451f5c2b9ae admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:54.858074 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-8399833e-eaab-4a40-9c4c-c451f5c2b9ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4e20a51ed0c4b4c8807d91e759777bd', 'request_id': 'req-8399833e-eaab-4a40-9c4c-c451f5c2b9ae'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:54.870054 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-8399833e-eaab-4a40-9c4c-c451f5c2b9ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4e20a51ed0c4b4c8807d91e759777bd', 'request_id': 'req-8399833e-eaab-4a40-9c4c-c451f5c2b9ae'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:54.877684 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-8399833e-eaab-4a40-9c4c-c451f5c2b9ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4e20a51ed0c4b4c8807d91e759777bd', 'request_id': 'req-8399833e-eaab-4a40-9c4c-c451f5c2b9ae'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:54.888711 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-8399833e-eaab-4a40-9c4c-c451f5c2b9ae admin admin] The token cache is being invalidate because project c4e20a51ed0c4b4c8807d91e759777bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:54.889073 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-8399833e-eaab-4a40-9c4c-c451f5c2b9ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:54.889725 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-8399833e-eaab-4a40-9c4c-c451f5c2b9ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:54.891708 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1113/2228] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:54 2022] DELETE /identity/v3/projects/c4e20a51ed0c4b4c8807d91e759777bd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:54.897849 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefc3f8-26ce-42d8-bd53-79ce4376bfbf None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:54.898637 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefc3f8-26ce-42d8-bd53-79ce4376bfbf None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:54.898722 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefc3f8-26ce-42d8-bd53-79ce4376bfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:54.919867 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-4eefc3f8-26ce-42d8-bd53-79ce4376bfbf None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:54.921833 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-4eefc3f8-26ce-42d8-bd53-79ce4376bfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:55.004237 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1116/2229] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:55.012455 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe6096-7d0f-44c8-90a4-5b8c89ccd0c3 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:55.012779 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe6096-7d0f-44c8-90a4-5b8c89ccd0c3 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:55.014467 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe6096-7d0f-44c8-90a4-5b8c89ccd0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:55.037698 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-4ffe6096-7d0f-44c8-90a4-5b8c89ccd0c3 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:55.038916 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-4ffe6096-7d0f-44c8-90a4-5b8c89ccd0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:55.047515 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1114/2230] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:55.051500 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefc3f8-26ce-42d8-bd53-79ce4376bfbf None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:55.061103 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eefc3f8-26ce-42d8-bd53-79ce4376bfbf None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:55.066675 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e7fed-b368-42c0-b0c8-58775bc32681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:55.067376 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e7fed-b368-42c0-b0c8-58775bc32681 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:55.067660 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e7fed-b368-42c0-b0c8-58775bc32681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:55.067939 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e7fed-b368-42c0-b0c8-58775bc32681 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:55.068847 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e7fed-b368-42c0-b0c8-58775bc32681 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:41:55.069269 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e7fed-b368-42c0-b0c8-58775bc32681 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:55.070959 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e7fed-b368-42c0-b0c8-58775bc32681 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:55.088672 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1117/2231] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:41:55.089555 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe6096-7d0f-44c8-90a4-5b8c89ccd0c3 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:55.089681 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e7fed-b368-42c0-b0c8-58775bc32681 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:55.091909 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-4ffe6096-7d0f-44c8-90a4-5b8c89ccd0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:55.099306 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e7fed-b368-42c0-b0c8-58775bc32681 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:55.104256 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab65e56-10f3-4faf-b7da-443e84237e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:55.104927 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab65e56-10f3-4faf-b7da-443e84237e1c admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:55.105250 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab65e56-10f3-4faf-b7da-443e84237e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:55.105527 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab65e56-10f3-4faf-b7da-443e84237e1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:55.106257 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab65e56-10f3-4faf-b7da-443e84237e1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:55.106860 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe6096-7d0f-44c8-90a4-5b8c89ccd0c3 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:55.108174 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab65e56-10f3-4faf-b7da-443e84237e1c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:55.112932 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fa505-3aca-4fb5-a129-c7d0a944eaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:55.114393 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa505-3aca-4fb5-a129-c7d0a944eaf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:55.114775 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa505-3aca-4fb5-a129-c7d0a944eaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:55.115149 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa505-3aca-4fb5-a129-c7d0a944eaf6 admin admin] PATH_INFO: `/v3/projects/28c4d033b8fe40fa8d857ef89c1b2c1e` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:55.117266 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fa505-3aca-4fb5-a129-c7d0a944eaf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28c4d033b8fe40fa8d857ef89c1b2c1e)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:55.119808 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fa505-3aca-4fb5-a129-c7d0a944eaf6 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:55.142914 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1118/2232] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:55 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:55.143860 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab65e56-10f3-4faf-b7da-443e84237e1c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:55.198208 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-646fa505-3aca-4fb5-a129-c7d0a944eaf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28c4d033b8fe40fa8d857ef89c1b2c1e', 'request_id': 'req-646fa505-3aca-4fb5-a129-c7d0a944eaf6'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:55.207706 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-646fa505-3aca-4fb5-a129-c7d0a944eaf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28c4d033b8fe40fa8d857ef89c1b2c1e', 'request_id': 'req-646fa505-3aca-4fb5-a129-c7d0a944eaf6'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:55.214864 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-646fa505-3aca-4fb5-a129-c7d0a944eaf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28c4d033b8fe40fa8d857ef89c1b2c1e', 'request_id': 'req-646fa505-3aca-4fb5-a129-c7d0a944eaf6'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:55.218585 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab65e56-10f3-4faf-b7da-443e84237e1c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:55.225521 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-646fa505-3aca-4fb5-a129-c7d0a944eaf6 admin admin] The token cache is being invalidate because project 28c4d033b8fe40fa8d857ef89c1b2c1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:55.226030 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-646fa505-3aca-4fb5-a129-c7d0a944eaf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:55.226713 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-646fa505-3aca-4fb5-a129-c7d0a944eaf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:55.228560 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1115/2233] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:55 2022] DELETE /identity/v3/projects/28c4d033b8fe40fa8d857ef89c1b2c1e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:55.234085 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fa505-3aca-4fb5-a129-c7d0a944eaf6 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:55.236196 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-646fa505-3aca-4fb5-a129-c7d0a944eaf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:55.289618 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a786016-e37e-4908-92c9-a5a1bf46aa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:55.290333 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a786016-e37e-4908-92c9-a5a1bf46aa08 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:55.290701 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a786016-e37e-4908-92c9-a5a1bf46aa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:55.290890 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a786016-e37e-4908-92c9-a5a1bf46aa08 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:55.291720 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a786016-e37e-4908-92c9-a5a1bf46aa08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:55.293955 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a786016-e37e-4908-92c9-a5a1bf46aa08 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:55.319916 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1119/2234] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:55 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:55.323428 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a786016-e37e-4908-92c9-a5a1bf46aa08 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:55.325235 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1a786016-e37e-4908-92c9-a5a1bf46aa08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:55.338136 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a786016-e37e-4908-92c9-a5a1bf46aa08 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:55.343896 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35e27d-7580-4e45-838e-5b5ffe77159b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:55.344678 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35e27d-7580-4e45-838e-5b5ffe77159b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:55.345052 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35e27d-7580-4e45-838e-5b5ffe77159b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:55.345428 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35e27d-7580-4e45-838e-5b5ffe77159b admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:55.346263 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35e27d-7580-4e45-838e-5b5ffe77159b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:55.346464 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fa505-3aca-4fb5-a129-c7d0a944eaf6 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:55.348138 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35e27d-7580-4e45-838e-5b5ffe77159b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:55.352543 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c780d0e-3667-4810-b1cf-114f27ac1a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:55.354441 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c780d0e-3667-4810-b1cf-114f27ac1a36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:55.354806 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c780d0e-3667-4810-b1cf-114f27ac1a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:55.355153 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c780d0e-3667-4810-b1cf-114f27ac1a36 admin admin] PATH_INFO: `/v3/users/b6bb4313c54a48258dfe30efd6c20a31` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:55.357212 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c780d0e-3667-4810-b1cf-114f27ac1a36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6bb4313c54a48258dfe30efd6c20a31)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:55.360263 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1120/2235] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:41:55.360521 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c780d0e-3667-4810-b1cf-114f27ac1a36 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:55.364839 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35e27d-7580-4e45-838e-5b5ffe77159b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:55.378879 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35e27d-7580-4e45-838e-5b5ffe77159b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:55.385474 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca94574-b4aa-45eb-b7b4-1eda521a776e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:55.386440 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca94574-b4aa-45eb-b7b4-1eda521a776e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:55.386909 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca94574-b4aa-45eb-b7b4-1eda521a776e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:55.387359 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca94574-b4aa-45eb-b7b4-1eda521a776e admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:55.388355 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca94574-b4aa-45eb-b7b4-1eda521a776e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:55.391146 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca94574-b4aa-45eb-b7b4-1eda521a776e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:55.416838 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1121/2236] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:55.418057 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca94574-b4aa-45eb-b7b4-1eda521a776e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:55.428524 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9c780d0e-3667-4810-b1cf-114f27ac1a36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6bb4313c54a48258dfe30efd6c20a31'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:55.438665 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca94574-b4aa-45eb-b7b4-1eda521a776e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:55.438918 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9c780d0e-3667-4810-b1cf-114f27ac1a36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6bb4313c54a48258dfe30efd6c20a31'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:55.440281 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9c780d0e-3667-4810-b1cf-114f27ac1a36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6bb4313c54a48258dfe30efd6c20a31'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:55.445682 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593944c2-4ed4-47cc-8ed4-b85a37d595c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:55.447018 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593944c2-4ed4-47cc-8ed4-b85a37d595c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:55.447945 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593944c2-4ed4-47cc-8ed4-b85a37d595c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:55.448412 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593944c2-4ed4-47cc-8ed4-b85a37d595c5 admin admin] PATH_INFO: `/v3/projects/9533f2e1c32849dab5373eff2f14d207/users/8d8b31822f5a46189763b59fb790e276/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:55.460535 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9c780d0e-3667-4810-b1cf-114f27ac1a36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6bb4313c54a48258dfe30efd6c20a31'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:55.476610 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593944c2-4ed4-47cc-8ed4-b85a37d595c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9533f2e1c32849dab5373eff2f14d207, user_id=8d8b31822f5a46189763b59fb790e276, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:55.479448 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593944c2-4ed4-47cc-8ed4-b85a37d595c5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:55.488883 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9c780d0e-3667-4810-b1cf-114f27ac1a36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6bb4313c54a48258dfe30efd6c20a31'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:55.503140 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1116/2237] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:41:55 2022] DELETE /identity/v3/users/b6bb4313c54a48258dfe30efd6c20a31 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:55.509564 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1122/2238] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:55 2022] PUT /identity/v3/projects/9533f2e1c32849dab5373eff2f14d207/users/8d8b31822f5a46189763b59fb790e276/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:55.522746 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5b439-2921-45d5-bc96-deb59377b30a None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:55.523404 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5b439-2921-45d5-bc96-deb59377b30a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:55.523743 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5b439-2921-45d5-bc96-deb59377b30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:55.561906 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-48b5b439-2921-45d5-bc96-deb59377b30a None None] MFA Rules not processed for user `8d8b31822f5a46189763b59fb790e276`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:55.563214 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-48b5b439-2921-45d5-bc96-deb59377b30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:55.649236 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1117/2239] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:55.650489 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593944c2-4ed4-47cc-8ed4-b85a37d595c5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:55.652499 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-593944c2-4ed4-47cc-8ed4-b85a37d595c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:55.770264 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593944c2-4ed4-47cc-8ed4-b85a37d595c5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:55.908846 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc864c82-c5dd-4654-bbfe-2cbd643b10e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:55.909513 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc864c82-c5dd-4654-bbfe-2cbd643b10e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:55.909835 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc864c82-c5dd-4654-bbfe-2cbd643b10e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:55.910054 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc864c82-c5dd-4654-bbfe-2cbd643b10e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:55.910946 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc864c82-c5dd-4654-bbfe-2cbd643b10e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:55.912863 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc864c82-c5dd-4654-bbfe-2cbd643b10e6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:55.951213 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5b439-2921-45d5-bc96-deb59377b30a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:55.951807 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1123/2240] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:55 2022] POST /identity/v3/projects => generated 377 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:55.966045 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5b439-2921-45d5-bc96-deb59377b30a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:56.036887 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc864c82-c5dd-4654-bbfe-2cbd643b10e6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:56.039966 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-cc864c82-c5dd-4654-bbfe-2cbd643b10e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:56.077873 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab18ec8-a694-4cc3-adeb-6abc1a484ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:56.078741 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab18ec8-a694-4cc3-adeb-6abc1a484ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:56.079285 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab18ec8-a694-4cc3-adeb-6abc1a484ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:56.079662 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab18ec8-a694-4cc3-adeb-6abc1a484ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:56.081107 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab18ec8-a694-4cc3-adeb-6abc1a484ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:56.083321 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab18ec8-a694-4cc3-adeb-6abc1a484ae2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:56.118464 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1118/2241] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:55 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:41:56.120143 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab18ec8-a694-4cc3-adeb-6abc1a484ae2 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:56.128531 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc864c82-c5dd-4654-bbfe-2cbd643b10e6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:56.131011 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab18ec8-a694-4cc3-adeb-6abc1a484ae2 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:56.134149 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75216c5-5e94-48a8-bbb1-172bdd647c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:56.135066 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75216c5-5e94-48a8-bbb1-172bdd647c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:56.135423 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75216c5-5e94-48a8-bbb1-172bdd647c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:56.135792 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75216c5-5e94-48a8-bbb1-172bdd647c7a admin admin] PATH_INFO: `/v3/projects/990b9a96331d44e482a3b14a2c39abaa` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:56.137129 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75216c5-5e94-48a8-bbb1-172bdd647c7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=990b9a96331d44e482a3b14a2c39abaa)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:56.137399 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57824c49-9dee-4907-a005-c2bcab311def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:56.138070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57824c49-9dee-4907-a005-c2bcab311def admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:56.138739 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57824c49-9dee-4907-a005-c2bcab311def admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:56.138739 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57824c49-9dee-4907-a005-c2bcab311def admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:56.139562 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75216c5-5e94-48a8-bbb1-172bdd647c7a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:56.140443 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57824c49-9dee-4907-a005-c2bcab311def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:56.142956 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57824c49-9dee-4907-a005-c2bcab311def admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:56.162922 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1119/2242] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:56.166941 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57824c49-9dee-4907-a005-c2bcab311def admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:56.187528 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57824c49-9dee-4907-a005-c2bcab311def admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:56.198701 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b75216c5-5e94-48a8-bbb1-172bdd647c7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '990b9a96331d44e482a3b14a2c39abaa', 'request_id': 'req-b75216c5-5e94-48a8-bbb1-172bdd647c7a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:56.205800 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b75216c5-5e94-48a8-bbb1-172bdd647c7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '990b9a96331d44e482a3b14a2c39abaa', 'request_id': 'req-b75216c5-5e94-48a8-bbb1-172bdd647c7a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:56.215538 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b75216c5-5e94-48a8-bbb1-172bdd647c7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '990b9a96331d44e482a3b14a2c39abaa', 'request_id': 'req-b75216c5-5e94-48a8-bbb1-172bdd647c7a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:56.230456 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b75216c5-5e94-48a8-bbb1-172bdd647c7a admin admin] The token cache is being invalidate because project 990b9a96331d44e482a3b14a2c39abaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:41:56.230746 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b75216c5-5e94-48a8-bbb1-172bdd647c7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:56.231468 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b75216c5-5e94-48a8-bbb1-172bdd647c7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:41:56.234265 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1124/2243] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:41:56 2022] DELETE /identity/v3/projects/990b9a96331d44e482a3b14a2c39abaa => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:41:56.242300 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ab179-68ce-411b-9eea-593908f9d8a0 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:56.242909 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ab179-68ce-411b-9eea-593908f9d8a0 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:56.243306 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ab179-68ce-411b-9eea-593908f9d8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:56.259280 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324c168-ac56-423f-a728-58bdf510bf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:56.261226 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324c168-ac56-423f-a728-58bdf510bf29 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:56.261746 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324c168-ac56-423f-a728-58bdf510bf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:56.262352 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324c168-ac56-423f-a728-58bdf510bf29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:56.263272 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-799ab179-68ce-411b-9eea-593908f9d8a0 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:56.263523 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324c168-ac56-423f-a728-58bdf510bf29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:56.264671 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-799ab179-68ce-411b-9eea-593908f9d8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:56.266096 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324c168-ac56-423f-a728-58bdf510bf29 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:56.276933 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1125/2244] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:56.278817 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1120/2245] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:56.282686 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ab179-68ce-411b-9eea-593908f9d8a0 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:56.286732 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-799ab179-68ce-411b-9eea-593908f9d8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:56.287264 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c95851-8f71-421d-a7f0-ce9370fb0677 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:56.287752 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c95851-8f71-421d-a7f0-ce9370fb0677 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:56.288193 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c95851-8f71-421d-a7f0-ce9370fb0677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:56.304406 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ab179-68ce-411b-9eea-593908f9d8a0 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:56.311529 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cd613-6440-4c53-9212-f89c55114e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:56.312495 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cd613-6440-4c53-9212-f89c55114e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:56.313695 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-b7c95851-8f71-421d-a7f0-ce9370fb0677 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:56.313973 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cd613-6440-4c53-9212-f89c55114e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:56.314816 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cd613-6440-4c53-9212-f89c55114e00 admin admin] PATH_INFO: `/v3/projects/52329d3c84bb4e68aa8be34260447f01/users/42bbd9e9ea644f409c1c93178848d557/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:56.316590 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-b7c95851-8f71-421d-a7f0-ce9370fb0677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:56.327041 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1121/2246] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:56.331376 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c95851-8f71-421d-a7f0-ce9370fb0677 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:56.335955 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cd613-6440-4c53-9212-f89c55114e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52329d3c84bb4e68aa8be34260447f01, user_id=42bbd9e9ea644f409c1c93178848d557, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:56.340151 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cd613-6440-4c53-9212-f89c55114e00 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:56.341785 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c95851-8f71-421d-a7f0-ce9370fb0677 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:56.348623 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e0e14-f71c-4229-9461-f074e825d8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:56.349643 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e0e14-f71c-4229-9461-f074e825d8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:56.350061 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e0e14-f71c-4229-9461-f074e825d8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:56.350570 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e0e14-f71c-4229-9461-f074e825d8b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:56.351396 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e0e14-f71c-4229-9461-f074e825d8b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:41:56.351977 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e0e14-f71c-4229-9461-f074e825d8b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:56.354183 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e0e14-f71c-4229-9461-f074e825d8b0 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:56.362571 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1126/2247] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:56 2022] PUT /identity/v3/projects/52329d3c84bb4e68aa8be34260447f01/users/42bbd9e9ea644f409c1c93178848d557/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:41:56.371041 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1122/2248] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:41:56.372806 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cd613-6440-4c53-9212-f89c55114e00 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:56.373323 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a41f0-ab5e-439a-92d3-f089c8d0e7a7 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:56.373619 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a41f0-ab5e-439a-92d3-f089c8d0e7a7 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:56.373899 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a41f0-ab5e-439a-92d3-f089c8d0e7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:56.407224 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-564a41f0-ab5e-439a-92d3-f089c8d0e7a7 None None] MFA Rules not processed for user `42bbd9e9ea644f409c1c93178848d557`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:56.409139 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-564a41f0-ab5e-439a-92d3-f089c8d0e7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:56.442318 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cd613-6440-4c53-9212-f89c55114e00 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:56.447123 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9833f-9ebe-411e-a8af-5b9140e2c2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:56.447792 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9833f-9ebe-411e-a8af-5b9140e2c2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:56.448196 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9833f-9ebe-411e-a8af-5b9140e2c2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:56.448638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9833f-9ebe-411e-a8af-5b9140e2c2f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:56.449381 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9833f-9ebe-411e-a8af-5b9140e2c2f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:56.451306 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9833f-9ebe-411e-a8af-5b9140e2c2f3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:56.478339 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1127/2249] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:56 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:56.482666 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9833f-9ebe-411e-a8af-5b9140e2c2f3 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:56.485467 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1123/2250] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:56.490371 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a41f0-ab5e-439a-92d3-f089c8d0e7a7 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:56.501095 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a41f0-ab5e-439a-92d3-f089c8d0e7a7 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:56.560568 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9833f-9ebe-411e-a8af-5b9140e2c2f3 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:56.562380 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aeb928-9be1-4388-b6d0-88f5d7314574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:56.563564 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeb928-9be1-4388-b6d0-88f5d7314574 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:56.563785 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeb928-9be1-4388-b6d0-88f5d7314574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:56.564238 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeb928-9be1-4388-b6d0-88f5d7314574 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:56.565793 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aeb928-9be1-4388-b6d0-88f5d7314574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:56.567842 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aeb928-9be1-4388-b6d0-88f5d7314574 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:56.569477 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee34e63-1e72-43ae-a5f3-fb4cd05b8e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:56.571064 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee34e63-1e72-43ae-a5f3-fb4cd05b8e5b admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:56.571736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee34e63-1e72-43ae-a5f3-fb4cd05b8e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:56.572620 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee34e63-1e72-43ae-a5f3-fb4cd05b8e5b admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:56.573547 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee34e63-1e72-43ae-a5f3-fb4cd05b8e5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:56.575920 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee34e63-1e72-43ae-a5f3-fb4cd05b8e5b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:56.596188 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1124/2251] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:41:56 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:41:56.599874 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aeb928-9be1-4388-b6d0-88f5d7314574 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:56.602225 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1128/2252] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:56 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:41:56.605799 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee34e63-1e72-43ae-a5f3-fb4cd05b8e5b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:56.616244 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee34e63-1e72-43ae-a5f3-fb4cd05b8e5b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:56.667779 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aeb928-9be1-4388-b6d0-88f5d7314574 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:56.672472 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8807db-2b3b-468a-8591-08c3a430958e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:56.673176 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8807db-2b3b-468a-8591-08c3a430958e admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:56.673449 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8807db-2b3b-468a-8591-08c3a430958e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:56.674317 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8807db-2b3b-468a-8591-08c3a430958e admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:56.675088 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8807db-2b3b-468a-8591-08c3a430958e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:56.677067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8807db-2b3b-468a-8591-08c3a430958e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:56.680265 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a430e-0cba-4f01-87dc-0362d3e4c189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:56.681303 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a430e-0cba-4f01-87dc-0362d3e4c189 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:56.681735 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a430e-0cba-4f01-87dc-0362d3e4c189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:56.682168 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a430e-0cba-4f01-87dc-0362d3e4c189 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:56.683055 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a430e-0cba-4f01-87dc-0362d3e4c189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:56.685292 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a430e-0cba-4f01-87dc-0362d3e4c189 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:56.695687 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1129/2253] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:41:56.697950 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1125/2254] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:41:56 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:41:56.699624 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a430e-0cba-4f01-87dc-0362d3e4c189 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:56.701551 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8807db-2b3b-468a-8591-08c3a430958e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:56.709610 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a430e-0cba-4f01-87dc-0362d3e4c189 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:56.710707 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8807db-2b3b-468a-8591-08c3a430958e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:56.714336 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50661fa1-cf74-45a5-8090-63fb47d4be68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:56.714991 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50661fa1-cf74-45a5-8090-63fb47d4be68 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:56.715211 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b674175-50df-4ce3-8f15-214243bf7c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:56.715326 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50661fa1-cf74-45a5-8090-63fb47d4be68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:56.715525 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50661fa1-cf74-45a5-8090-63fb47d4be68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:56.715885 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b674175-50df-4ce3-8f15-214243bf7c78 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:56.716167 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b674175-50df-4ce3-8f15-214243bf7c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:56.716371 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50661fa1-cf74-45a5-8090-63fb47d4be68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:56.716468 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b674175-50df-4ce3-8f15-214243bf7c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:56.717178 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b674175-50df-4ce3-8f15-214243bf7c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:56.717986 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50661fa1-cf74-45a5-8090-63fb47d4be68 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:56.718731 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b674175-50df-4ce3-8f15-214243bf7c78 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:56.728134 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1130/2255] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:41:56.729455 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1126/2256] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:56.732556 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50661fa1-cf74-45a5-8090-63fb47d4be68 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:56.733353 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b674175-50df-4ce3-8f15-214243bf7c78 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:56.742713 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50661fa1-cf74-45a5-8090-63fb47d4be68 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:56.743180 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b674175-50df-4ce3-8f15-214243bf7c78 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:56.747586 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038549d-7d96-4ab9-9c5e-5efadc57610b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:56.747737 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cd0ee-addc-4fe4-b3ad-dc6b4746e423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:56.748501 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038549d-7d96-4ab9-9c5e-5efadc57610b admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:56.748590 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cd0ee-addc-4fe4-b3ad-dc6b4746e423 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:56.748790 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038549d-7d96-4ab9-9c5e-5efadc57610b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:56.748872 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cd0ee-addc-4fe4-b3ad-dc6b4746e423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:56.749102 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cd0ee-addc-4fe4-b3ad-dc6b4746e423 admin admin] PATH_INFO: `/v3/projects/229f9e77eaec45f2aa5f47efdd443fa6/users/dc8b96df3914424eaf01f0312a01e524/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:56.749188 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038549d-7d96-4ab9-9c5e-5efadc57610b admin admin] PATH_INFO: `/v3/projects/9662dc6902ce40e99a816c22c3c42e61/users/3bf85af5dbc7462d917dc87e2f179575/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:56.765740 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038549d-7d96-4ab9-9c5e-5efadc57610b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9662dc6902ce40e99a816c22c3c42e61, user_id=3bf85af5dbc7462d917dc87e2f179575, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:56.766754 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6cd0ee-addc-4fe4-b3ad-dc6b4746e423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=229f9e77eaec45f2aa5f47efdd443fa6, user_id=dc8b96df3914424eaf01f0312a01e524, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:56.769230 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038549d-7d96-4ab9-9c5e-5efadc57610b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:56.769971 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6cd0ee-addc-4fe4-b3ad-dc6b4746e423 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:56.785774 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1131/2257] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:56 2022] PUT /identity/v3/projects/9662dc6902ce40e99a816c22c3c42e61/users/3bf85af5dbc7462d917dc87e2f179575/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:41:56.788225 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1127/2258] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:56 2022] PUT /identity/v3/projects/229f9e77eaec45f2aa5f47efdd443fa6/users/dc8b96df3914424eaf01f0312a01e524/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:41:56.794049 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038549d-7d96-4ab9-9c5e-5efadc57610b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:56.796389 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4705d-64df-4658-bb45-57eaae87af16 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:56.796702 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4705d-64df-4658-bb45-57eaae87af16 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:56.796981 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4705d-64df-4658-bb45-57eaae87af16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:56.830046 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-b0a4705d-64df-4658-bb45-57eaae87af16 None None] MFA Rules not processed for user `3bf85af5dbc7462d917dc87e2f179575`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:56.831451 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-b0a4705d-64df-4658-bb45-57eaae87af16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:56.883466 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038549d-7d96-4ab9-9c5e-5efadc57610b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:56.913838 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1128/2259] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:41:56.923525 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4705d-64df-4658-bb45-57eaae87af16 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:56.925917 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-b0a4705d-64df-4658-bb45-57eaae87af16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:56.948846 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f893a-db8a-46c7-af78-29106e1da686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:56.949565 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f893a-db8a-46c7-af78-29106e1da686 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:56.949921 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f893a-db8a-46c7-af78-29106e1da686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:56.950482 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f893a-db8a-46c7-af78-29106e1da686 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:56.951204 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f893a-db8a-46c7-af78-29106e1da686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:56.953356 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f893a-db8a-46c7-af78-29106e1da686 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:56.968933 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1132/2260] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:41:56.974791 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f893a-db8a-46c7-af78-29106e1da686 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:56.987588 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f893a-db8a-46c7-af78-29106e1da686 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:56.992784 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f56ec3-e4a0-4796-8d8a-2aa08d0109d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:56.993924 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f56ec3-e4a0-4796-8d8a-2aa08d0109d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:56.994393 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f56ec3-e4a0-4796-8d8a-2aa08d0109d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:56.994684 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f56ec3-e4a0-4796-8d8a-2aa08d0109d2 admin admin] PATH_INFO: `/v3/projects/229f9e77eaec45f2aa5f47efdd443fa6/users/dc8b96df3914424eaf01f0312a01e524/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:56.996728 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f56ec3-e4a0-4796-8d8a-2aa08d0109d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=229f9e77eaec45f2aa5f47efdd443fa6, user_id=dc8b96df3914424eaf01f0312a01e524, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:56.999615 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f56ec3-e4a0-4796-8d8a-2aa08d0109d2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:57.011174 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4705d-64df-4658-bb45-57eaae87af16 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:57.012552 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1133/2261] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:41:56 2022] PUT /identity/v3/projects/229f9e77eaec45f2aa5f47efdd443fa6/users/dc8b96df3914424eaf01f0312a01e524/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:41:57.022679 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f37c9-bd59-4907-8681-ce75100e86cd None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:57.023226 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f37c9-bd59-4907-8681-ce75100e86cd None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:57.023513 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f37c9-bd59-4907-8681-ce75100e86cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:57.052090 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-f17f37c9-bd59-4907-8681-ce75100e86cd None None] MFA Rules not processed for user `dc8b96df3914424eaf01f0312a01e524`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:41:57.053553 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f17f37c9-bd59-4907-8681-ce75100e86cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:57.069802 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1c94b-c8a4-4ba5-80ef-06aa3932ff7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:57.070535 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1c94b-c8a4-4ba5-80ef-06aa3932ff7e service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:57.070888 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1c94b-c8a4-4ba5-80ef-06aa3932ff7e service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:57.071432 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1c94b-c8a4-4ba5-80ef-06aa3932ff7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:57.127690 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1134/2262] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:41:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:41:57.135083 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1c94b-c8a4-4ba5-80ef-06aa3932ff7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:57.136950 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1c94b-c8a4-4ba5-80ef-06aa3932ff7e service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:57.137571 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f37c9-bd59-4907-8681-ce75100e86cd None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:41:57.139268 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f17f37c9-bd59-4907-8681-ce75100e86cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:57.149424 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1129/2263] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:41:57.152215 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f37c9-bd59-4907-8681-ce75100e86cd None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:41:57.156433 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd704046-0dc2-4500-9969-ef2a979de40d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:41:57.157242 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd704046-0dc2-4500-9969-ef2a979de40d service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:41:57.158500 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd704046-0dc2-4500-9969-ef2a979de40d service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:41:57.158500 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd704046-0dc2-4500-9969-ef2a979de40d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:41:57.160395 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fd704046-0dc2-4500-9969-ef2a979de40d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:41:57.228511 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd704046-0dc2-4500-9969-ef2a979de40d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:41:57.229999 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd704046-0dc2-4500-9969-ef2a979de40d service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:41:57.239285 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1135/2264] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:41:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:42:00.907304 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1c94b-c8a4-4ba5-80ef-06aa3932ff7e service cinder] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:00.917246 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1c94b-c8a4-4ba5-80ef-06aa3932ff7e service cinder] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:00.920047 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619012eb-f956-42bf-888e-bb7292fd2a07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:00.920675 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619012eb-f956-42bf-888e-bb7292fd2a07 service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:00.920954 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619012eb-f956-42bf-888e-bb7292fd2a07 service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:00.921262 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619012eb-f956-42bf-888e-bb7292fd2a07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:00.976659 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619012eb-f956-42bf-888e-bb7292fd2a07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:00.978134 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619012eb-f956-42bf-888e-bb7292fd2a07 service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:00.987146 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1130/2265] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:42:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:42:05.131920 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd704046-0dc2-4500-9969-ef2a979de40d service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:05.140328 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd704046-0dc2-4500-9969-ef2a979de40d service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:05.144711 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18ca8f-6ec5-42d8-972d-28c598873b66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:05.145397 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18ca8f-6ec5-42d8-972d-28c598873b66 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:05.145683 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18ca8f-6ec5-42d8-972d-28c598873b66 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:05.145965 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18ca8f-6ec5-42d8-972d-28c598873b66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:05.155811 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18ca8f-6ec5-42d8-972d-28c598873b66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:05.156964 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18ca8f-6ec5-42d8-972d-28c598873b66 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:05.168397 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1136/2266] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:42:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:42:08.718331 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619012eb-f956-42bf-888e-bb7292fd2a07 service cinder] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:08.790881 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619012eb-f956-42bf-888e-bb7292fd2a07 service cinder] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:08.795700 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472641d-964e-45e5-accf-a236f7348cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:08.796649 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472641d-964e-45e5-accf-a236f7348cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:08.797020 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472641d-964e-45e5-accf-a236f7348cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:08.797472 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472641d-964e-45e5-accf-a236f7348cc8 admin admin] PATH_INFO: `/v3/users/3bf85af5dbc7462d917dc87e2f179575` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:08.798716 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472641d-964e-45e5-accf-a236f7348cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf85af5dbc7462d917dc87e2f179575)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:08.800700 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472641d-964e-45e5-accf-a236f7348cc8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:08.853212 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6472641d-964e-45e5-accf-a236f7348cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf85af5dbc7462d917dc87e2f179575'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:08.860210 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6472641d-964e-45e5-accf-a236f7348cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf85af5dbc7462d917dc87e2f179575'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:08.861469 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6472641d-964e-45e5-accf-a236f7348cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf85af5dbc7462d917dc87e2f179575'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:08.876918 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6472641d-964e-45e5-accf-a236f7348cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf85af5dbc7462d917dc87e2f179575'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:08.887317 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6472641d-964e-45e5-accf-a236f7348cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf85af5dbc7462d917dc87e2f179575'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:08.895135 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1131/2267] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:42:08 2022] DELETE /identity/v3/users/3bf85af5dbc7462d917dc87e2f179575 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:08.898866 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ab82a-455a-4d8e-a6f7-0fe1ff0f5b1c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:08.899335 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ab82a-455a-4d8e-a6f7-0fe1ff0f5b1c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:08.899576 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ab82a-455a-4d8e-a6f7-0fe1ff0f5b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:08.917807 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-288ab82a-455a-4d8e-a6f7-0fe1ff0f5b1c None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:08.919260 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-288ab82a-455a-4d8e-a6f7-0fe1ff0f5b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:09.005354 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1137/2268] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:42:09.015067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472641d-964e-45e5-accf-a236f7348cc8 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:09.017675 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-6472641d-964e-45e5-accf-a236f7348cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:09.115894 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472641d-964e-45e5-accf-a236f7348cc8 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:09.127731 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ce514-6659-4e9f-9891-c13fe55562ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:09.136188 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ce514-6659-4e9f-9891-c13fe55562ef service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:09.136602 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ce514-6659-4e9f-9891-c13fe55562ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:09.136809 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ce514-6659-4e9f-9891-c13fe55562ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:09.154806 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ce514-6659-4e9f-9891-c13fe55562ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:09.158143 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ce514-6659-4e9f-9891-c13fe55562ef service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:09.172621 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1132/2269] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:42:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:42:09.498897 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ab82a-455a-4d8e-a6f7-0fe1ff0f5b1c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:09.502123 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-288ab82a-455a-4d8e-a6f7-0fe1ff0f5b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:09.521376 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ab82a-455a-4d8e-a6f7-0fe1ff0f5b1c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:09.529721 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520f7fc-fd56-4b44-b72c-ccd03e2b19b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:09.530775 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520f7fc-fd56-4b44-b72c-ccd03e2b19b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:09.531064 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520f7fc-fd56-4b44-b72c-ccd03e2b19b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:09.531521 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520f7fc-fd56-4b44-b72c-ccd03e2b19b9 admin admin] PATH_INFO: `/v3/projects/9662dc6902ce40e99a816c22c3c42e61` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:09.533673 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520f7fc-fd56-4b44-b72c-ccd03e2b19b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9662dc6902ce40e99a816c22c3c42e61)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:09.535774 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520f7fc-fd56-4b44-b72c-ccd03e2b19b9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:09.588819 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5520f7fc-fd56-4b44-b72c-ccd03e2b19b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9662dc6902ce40e99a816c22c3c42e61', 'request_id': 'req-5520f7fc-fd56-4b44-b72c-ccd03e2b19b9'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:09.595098 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5520f7fc-fd56-4b44-b72c-ccd03e2b19b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9662dc6902ce40e99a816c22c3c42e61', 'request_id': 'req-5520f7fc-fd56-4b44-b72c-ccd03e2b19b9'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:09.602159 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5520f7fc-fd56-4b44-b72c-ccd03e2b19b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9662dc6902ce40e99a816c22c3c42e61', 'request_id': 'req-5520f7fc-fd56-4b44-b72c-ccd03e2b19b9'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:09.612418 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5520f7fc-fd56-4b44-b72c-ccd03e2b19b9 admin admin] The token cache is being invalidate because project 9662dc6902ce40e99a816c22c3c42e61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:42:09.612730 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5520f7fc-fd56-4b44-b72c-ccd03e2b19b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:09.613414 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5520f7fc-fd56-4b44-b72c-ccd03e2b19b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:09.615011 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1138/2270] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:42:09 2022] DELETE /identity/v3/projects/9662dc6902ce40e99a816c22c3c42e61 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:09.620637 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6426d-eb05-4fa2-9a48-0ff92012479c None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:09.620928 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6426d-eb05-4fa2-9a48-0ff92012479c None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:09.621242 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6426d-eb05-4fa2-9a48-0ff92012479c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:09.639063 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-44d6426d-eb05-4fa2-9a48-0ff92012479c None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:09.640291 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-44d6426d-eb05-4fa2-9a48-0ff92012479c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:09.701289 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1133/2271] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:42:09.709890 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f800a16-4c23-4c7b-b173-5356bc942e36 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:09.710180 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f800a16-4c23-4c7b-b173-5356bc942e36 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:09.710457 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f800a16-4c23-4c7b-b173-5356bc942e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:09.728223 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-3f800a16-4c23-4c7b-b173-5356bc942e36 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:09.729463 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3f800a16-4c23-4c7b-b173-5356bc942e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:09.737729 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1139/2272] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:42:09.741680 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6426d-eb05-4fa2-9a48-0ff92012479c None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:09.751904 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6426d-eb05-4fa2-9a48-0ff92012479c None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:09.756577 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdd4b0-40c1-46a5-823b-e759bb74eca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:09.757372 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdd4b0-40c1-46a5-823b-e759bb74eca7 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:09.757652 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdd4b0-40c1-46a5-823b-e759bb74eca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:09.757923 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdd4b0-40c1-46a5-823b-e759bb74eca7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:09.758647 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdd4b0-40c1-46a5-823b-e759bb74eca7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:42:09.758948 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdd4b0-40c1-46a5-823b-e759bb74eca7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:09.760531 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdd4b0-40c1-46a5-823b-e759bb74eca7 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:09.772164 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1134/2273] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:42:09.776830 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f800a16-4c23-4c7b-b173-5356bc942e36 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:09.786650 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f800a16-4c23-4c7b-b173-5356bc942e36 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:09.791430 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e957a-831d-4389-b265-5402deb2f078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:09.792079 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e957a-831d-4389-b265-5402deb2f078 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:09.792364 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e957a-831d-4389-b265-5402deb2f078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:09.792673 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e957a-831d-4389-b265-5402deb2f078 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:09.793412 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e957a-831d-4389-b265-5402deb2f078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:09.795313 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709e957a-831d-4389-b265-5402deb2f078 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:09.821509 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1140/2274] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:42:09 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:42:09.825667 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdd4b0-40c1-46a5-823b-e759bb74eca7 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:09.835722 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdd4b0-40c1-46a5-823b-e759bb74eca7 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:09.896178 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa585c-db65-4d40-ad9e-5f0ddcf03d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:09.896847 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa585c-db65-4d40-ad9e-5f0ddcf03d2e admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:09.897159 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa585c-db65-4d40-ad9e-5f0ddcf03d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:09.897429 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa585c-db65-4d40-ad9e-5f0ddcf03d2e admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:09.898429 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa585c-db65-4d40-ad9e-5f0ddcf03d2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:09.900329 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa585c-db65-4d40-ad9e-5f0ddcf03d2e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:09.923668 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1135/2275] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:42:09 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:42:09.924846 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e957a-831d-4389-b265-5402deb2f078 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:09.935171 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e957a-831d-4389-b265-5402deb2f078 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:09.940733 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2112c-4a5a-4c18-b642-b66bd97dbfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:09.941428 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2112c-4a5a-4c18-b642-b66bd97dbfc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:09.941711 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2112c-4a5a-4c18-b642-b66bd97dbfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:09.941986 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee2112c-4a5a-4c18-b642-b66bd97dbfc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:09.942752 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2112c-4a5a-4c18-b642-b66bd97dbfc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:09.944376 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee2112c-4a5a-4c18-b642-b66bd97dbfc9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:09.955537 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1141/2276] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:42:09.959486 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa585c-db65-4d40-ad9e-5f0ddcf03d2e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:09.969358 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa585c-db65-4d40-ad9e-5f0ddcf03d2e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:09.974503 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2365e5-ac68-4c78-8234-8f5aa19c9ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:09.975187 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2365e5-ac68-4c78-8234-8f5aa19c9ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:09.975485 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2365e5-ac68-4c78-8234-8f5aa19c9ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:09.975808 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2365e5-ac68-4c78-8234-8f5aa19c9ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:09.976552 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2365e5-ac68-4c78-8234-8f5aa19c9ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:09.978168 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2365e5-ac68-4c78-8234-8f5aa19c9ed5 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:09.988402 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1136/2277] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:42:09.992591 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2112c-4a5a-4c18-b642-b66bd97dbfc9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:10.004401 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee2112c-4a5a-4c18-b642-b66bd97dbfc9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:10.009427 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f728974-da88-48b3-a833-103febf1177f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:10.010318 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f728974-da88-48b3-a833-103febf1177f admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:10.010605 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f728974-da88-48b3-a833-103febf1177f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:10.010882 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f728974-da88-48b3-a833-103febf1177f admin admin] PATH_INFO: `/v3/projects/ed2fb4c3914c43068fdcdfa82b480487/users/473e90834d8f408e98b7365709a5d332/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:10.026062 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f728974-da88-48b3-a833-103febf1177f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed2fb4c3914c43068fdcdfa82b480487, user_id=473e90834d8f408e98b7365709a5d332, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:10.028724 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f728974-da88-48b3-a833-103febf1177f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:10.042267 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1142/2278] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:42:09 2022] PUT /identity/v3/projects/ed2fb4c3914c43068fdcdfa82b480487/users/473e90834d8f408e98b7365709a5d332/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:10.052850 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e78f08-215c-4a16-922b-612b49284f63 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:10.053168 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e78f08-215c-4a16-922b-612b49284f63 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:10.053450 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e78f08-215c-4a16-922b-612b49284f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:10.065216 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f728974-da88-48b3-a833-103febf1177f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:10.066943 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0f728974-da88-48b3-a833-103febf1177f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:10.080405 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-93e78f08-215c-4a16-922b-612b49284f63 None None] MFA Rules not processed for user `473e90834d8f408e98b7365709a5d332`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:10.081612 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-93e78f08-215c-4a16-922b-612b49284f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:10.130334 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f728974-da88-48b3-a833-103febf1177f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:10.134938 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc22cfc-65b0-4001-b719-59f161ba18ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:10.135803 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc22cfc-65b0-4001-b719-59f161ba18ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:10.136094 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc22cfc-65b0-4001-b719-59f161ba18ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:10.136375 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc22cfc-65b0-4001-b719-59f161ba18ba admin admin] PATH_INFO: `/v3/users/8d8b31822f5a46189763b59fb790e276` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:10.137638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc22cfc-65b0-4001-b719-59f161ba18ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d8b31822f5a46189763b59fb790e276)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:10.139586 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc22cfc-65b0-4001-b719-59f161ba18ba admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:10.145203 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1137/2279] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:42:10.149474 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e78f08-215c-4a16-922b-612b49284f63 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:10.160683 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e78f08-215c-4a16-922b-612b49284f63 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:10.165283 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2e219-a2bf-4432-8010-02da1c608397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:10.165924 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2e219-a2bf-4432-8010-02da1c608397 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:10.166254 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2e219-a2bf-4432-8010-02da1c608397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:10.166481 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2e219-a2bf-4432-8010-02da1c608397 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:10.167175 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2e219-a2bf-4432-8010-02da1c608397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:10.169172 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2e219-a2bf-4432-8010-02da1c608397 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:10.188579 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2bc22cfc-65b0-4001-b719-59f161ba18ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d8b31822f5a46189763b59fb790e276'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:10.195060 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2bc22cfc-65b0-4001-b719-59f161ba18ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d8b31822f5a46189763b59fb790e276'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:10.195226 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1138/2280] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:42:10 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:42:10.195728 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2bc22cfc-65b0-4001-b719-59f161ba18ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d8b31822f5a46189763b59fb790e276'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:10.199507 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2e219-a2bf-4432-8010-02da1c608397 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:10.207357 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2bc22cfc-65b0-4001-b719-59f161ba18ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d8b31822f5a46189763b59fb790e276'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:10.214829 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2bc22cfc-65b0-4001-b719-59f161ba18ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d8b31822f5a46189763b59fb790e276'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:10.221272 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1143/2281] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:42:10 2022] DELETE /identity/v3/users/8d8b31822f5a46189763b59fb790e276 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:42:10.226113 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ce607-bd68-4d94-ad10-beb38b3c27a3 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:10.226113 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ce607-bd68-4d94-ad10-beb38b3c27a3 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:10.226389 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ce607-bd68-4d94-ad10-beb38b3c27a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:10.245455 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-204ce607-bd68-4d94-ad10-beb38b3c27a3 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:10.246751 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-204ce607-bd68-4d94-ad10-beb38b3c27a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:10.273561 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2e219-a2bf-4432-8010-02da1c608397 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:10.306733 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1144/2282] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:42:10.316406 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ce607-bd68-4d94-ad10-beb38b3c27a3 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:10.318036 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-204ce607-bd68-4d94-ad10-beb38b3c27a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:10.354604 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211337af-57ee-4df9-bcea-0527e3386a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:10.356459 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211337af-57ee-4df9-bcea-0527e3386a92 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:10.356755 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211337af-57ee-4df9-bcea-0527e3386a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:10.357067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211337af-57ee-4df9-bcea-0527e3386a92 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:10.357822 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211337af-57ee-4df9-bcea-0527e3386a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:10.359709 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211337af-57ee-4df9-bcea-0527e3386a92 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:10.384414 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1139/2283] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:42:10 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:42:10.386100 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ce607-bd68-4d94-ad10-beb38b3c27a3 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:10.389755 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfdd4a5-60c0-4100-b656-c5b3a062851c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:10.389925 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211337af-57ee-4df9-bcea-0527e3386a92 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:10.390533 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdd4a5-60c0-4100-b656-c5b3a062851c service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:10.390708 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdd4a5-60c0-4100-b656-c5b3a062851c service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:10.390984 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdd4a5-60c0-4100-b656-c5b3a062851c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:10.393558 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-211337af-57ee-4df9-bcea-0527e3386a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:10.401646 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfdd4a5-60c0-4100-b656-c5b3a062851c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:10.402639 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfdd4a5-60c0-4100-b656-c5b3a062851c service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:10.405787 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211337af-57ee-4df9-bcea-0527e3386a92 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:10.412483 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03fc60-5001-4478-b939-ea7f09077702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:10.412763 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1145/2284] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:42:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:42:10.413479 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03fc60-5001-4478-b939-ea7f09077702 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:10.413788 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03fc60-5001-4478-b939-ea7f09077702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:10.414688 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03fc60-5001-4478-b939-ea7f09077702 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:10.415452 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03fc60-5001-4478-b939-ea7f09077702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:10.417641 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03fc60-5001-4478-b939-ea7f09077702 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:10.432028 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1140/2285] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:42:10.433336 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfdd4a5-60c0-4100-b656-c5b3a062851c service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:10.444706 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfdd4a5-60c0-4100-b656-c5b3a062851c service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:10.450301 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996d687-dc92-44b6-b287-9d9606f25195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:10.451132 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996d687-dc92-44b6-b287-9d9606f25195 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:10.451542 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996d687-dc92-44b6-b287-9d9606f25195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:10.451893 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996d687-dc92-44b6-b287-9d9606f25195 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:10.452638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c996d687-dc92-44b6-b287-9d9606f25195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:10.454806 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c996d687-dc92-44b6-b287-9d9606f25195 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:10.466070 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1146/2286] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:42:10.470827 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03fc60-5001-4478-b939-ea7f09077702 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:10.481902 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03fc60-5001-4478-b939-ea7f09077702 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:10.486996 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12406d5-6d22-474f-8d79-c0a58419d142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:10.488061 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12406d5-6d22-474f-8d79-c0a58419d142 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:10.488468 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12406d5-6d22-474f-8d79-c0a58419d142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:10.488838 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12406d5-6d22-474f-8d79-c0a58419d142 admin admin] PATH_INFO: `/v3/projects/d6e1462450294e15828424d04477d1c5/users/831bddbc2bdd42c08c6856a9dd4e9804/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:10.508607 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12406d5-6d22-474f-8d79-c0a58419d142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e1462450294e15828424d04477d1c5, user_id=831bddbc2bdd42c08c6856a9dd4e9804, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:10.511758 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12406d5-6d22-474f-8d79-c0a58419d142 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:10.526532 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1141/2287] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:42:10 2022] PUT /identity/v3/projects/d6e1462450294e15828424d04477d1c5/users/831bddbc2bdd42c08c6856a9dd4e9804/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:10.537184 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8671251-10b6-4b05-8af5-c3d129bdf062 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:10.537474 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8671251-10b6-4b05-8af5-c3d129bdf062 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:10.537752 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8671251-10b6-4b05-8af5-c3d129bdf062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:10.583535 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a8671251-10b6-4b05-8af5-c3d129bdf062 None None] MFA Rules not processed for user `831bddbc2bdd42c08c6856a9dd4e9804`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:10.584843 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a8671251-10b6-4b05-8af5-c3d129bdf062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:10.693968 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1147/2288] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:42:10.698512 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12406d5-6d22-474f-8d79-c0a58419d142 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:10.778471 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8671251-10b6-4b05-8af5-c3d129bdf062 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:10.780236 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a8671251-10b6-4b05-8af5-c3d129bdf062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:10.794362 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12406d5-6d22-474f-8d79-c0a58419d142 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:10.802044 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf2cd1-6c12-40e1-9ab2-328a21b3b2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:10.803183 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf2cd1-6c12-40e1-9ab2-328a21b3b2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:10.803710 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf2cd1-6c12-40e1-9ab2-328a21b3b2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:10.804543 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf2cd1-6c12-40e1-9ab2-328a21b3b2f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:10.805530 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf2cd1-6c12-40e1-9ab2-328a21b3b2f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:10.808005 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf2cd1-6c12-40e1-9ab2-328a21b3b2f2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:10.819333 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8671251-10b6-4b05-8af5-c3d129bdf062 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:10.824203 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990383a2-8535-411c-8fea-8a6ff1542b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:10.825297 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990383a2-8535-411c-8fea-8a6ff1542b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:10.825575 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990383a2-8535-411c-8fea-8a6ff1542b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:10.825851 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990383a2-8535-411c-8fea-8a6ff1542b5e admin admin] PATH_INFO: `/v3/projects/9533f2e1c32849dab5373eff2f14d207` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:10.828299 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990383a2-8535-411c-8fea-8a6ff1542b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9533f2e1c32849dab5373eff2f14d207)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:10.830981 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990383a2-8535-411c-8fea-8a6ff1542b5e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:10.856817 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1142/2289] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:42:10 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:42:10.861664 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf2cd1-6c12-40e1-9ab2-328a21b3b2f2 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:10.885514 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-990383a2-8535-411c-8fea-8a6ff1542b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9533f2e1c32849dab5373eff2f14d207', 'request_id': 'req-990383a2-8535-411c-8fea-8a6ff1542b5e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:10.892834 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-990383a2-8535-411c-8fea-8a6ff1542b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9533f2e1c32849dab5373eff2f14d207', 'request_id': 'req-990383a2-8535-411c-8fea-8a6ff1542b5e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:10.900278 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-990383a2-8535-411c-8fea-8a6ff1542b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9533f2e1c32849dab5373eff2f14d207', 'request_id': 'req-990383a2-8535-411c-8fea-8a6ff1542b5e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:10.911092 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-990383a2-8535-411c-8fea-8a6ff1542b5e admin admin] The token cache is being invalidate because project 9533f2e1c32849dab5373eff2f14d207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:42:10.911397 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-990383a2-8535-411c-8fea-8a6ff1542b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:10.912062 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-990383a2-8535-411c-8fea-8a6ff1542b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:10.913626 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1148/2290] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:42:10 2022] DELETE /identity/v3/projects/9533f2e1c32849dab5373eff2f14d207 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:10.917783 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990383a2-8535-411c-8fea-8a6ff1542b5e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:10.919138 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-990383a2-8535-411c-8fea-8a6ff1542b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:10.932017 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf2cd1-6c12-40e1-9ab2-328a21b3b2f2 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:10.991483 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5ca3b-1e92-4799-a68a-4879a758d6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:10.992171 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5ca3b-1e92-4799-a68a-4879a758d6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:10.992526 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5ca3b-1e92-4799-a68a-4879a758d6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:10.992810 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5ca3b-1e92-4799-a68a-4879a758d6f9 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:10.993556 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5ca3b-1e92-4799-a68a-4879a758d6f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:10.995979 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5ca3b-1e92-4799-a68a-4879a758d6f9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:10.997081 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990383a2-8535-411c-8fea-8a6ff1542b5e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:11.003182 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f676fc-0f58-4b25-8432-c751b42c4b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:11.004324 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f676fc-0f58-4b25-8432-c751b42c4b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:11.004975 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f676fc-0f58-4b25-8432-c751b42c4b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:11.005581 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f676fc-0f58-4b25-8432-c751b42c4b6b admin admin] PATH_INFO: `/v3/users/42bbd9e9ea644f409c1c93178848d557` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:11.009202 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f676fc-0f58-4b25-8432-c751b42c4b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=42bbd9e9ea644f409c1c93178848d557)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:11.011487 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f676fc-0f58-4b25-8432-c751b42c4b6b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:11.019409 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1143/2291] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:42:10 2022] POST /identity/v3/users => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:42:11.023736 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5ca3b-1e92-4799-a68a-4879a758d6f9 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:11.025579 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-eda5ca3b-1e92-4799-a68a-4879a758d6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:11.040891 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5ca3b-1e92-4799-a68a-4879a758d6f9 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:11.046276 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5b9d8-dabf-4465-92a7-072a83b68941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:11.047119 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5b9d8-dabf-4465-92a7-072a83b68941 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:11.047974 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5b9d8-dabf-4465-92a7-072a83b68941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:11.047974 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5b9d8-dabf-4465-92a7-072a83b68941 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:11.049354 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5b9d8-dabf-4465-92a7-072a83b68941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:11.051159 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee5b9d8-dabf-4465-92a7-072a83b68941 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:11.064172 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1144/2292] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:42:11.068659 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5b9d8-dabf-4465-92a7-072a83b68941 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:11.071732 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b0f676fc-0f58-4b25-8432-c751b42c4b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42bbd9e9ea644f409c1c93178848d557'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:11.081402 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5b9d8-dabf-4465-92a7-072a83b68941 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:11.086327 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b0f676fc-0f58-4b25-8432-c751b42c4b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42bbd9e9ea644f409c1c93178848d557'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:11.086479 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2a675-e524-4389-9ce1-5eda743a35d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:11.087296 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2a675-e524-4389-9ce1-5eda743a35d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:11.087602 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b0f676fc-0f58-4b25-8432-c751b42c4b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42bbd9e9ea644f409c1c93178848d557'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:11.087710 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2a675-e524-4389-9ce1-5eda743a35d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:11.088139 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2a675-e524-4389-9ce1-5eda743a35d6 admin admin] PATH_INFO: `/v3/projects/43e797f4ee3c4ea084ff15f4e2a6d332/users/a826f7e1de8748c4b6c942ebb475fb49/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:11.105887 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b0f676fc-0f58-4b25-8432-c751b42c4b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42bbd9e9ea644f409c1c93178848d557'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:11.109527 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2a675-e524-4389-9ce1-5eda743a35d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e797f4ee3c4ea084ff15f4e2a6d332, user_id=a826f7e1de8748c4b6c942ebb475fb49, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:11.115299 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2a675-e524-4389-9ce1-5eda743a35d6 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:11.117604 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b0f676fc-0f58-4b25-8432-c751b42c4b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42bbd9e9ea644f409c1c93178848d557'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:11.125569 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1149/2293] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:42:10 2022] DELETE /identity/v3/users/42bbd9e9ea644f409c1c93178848d557 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:42:11.135028 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1145/2294] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:42:11 2022] PUT /identity/v3/projects/43e797f4ee3c4ea084ff15f4e2a6d332/users/a826f7e1de8748c4b6c942ebb475fb49/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:11.139162 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f676fc-0f58-4b25-8432-c751b42c4b6b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:11.140745 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b0f676fc-0f58-4b25-8432-c751b42c4b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:11.210520 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f676fc-0f58-4b25-8432-c751b42c4b6b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:11.265124 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ef339-3616-4563-8ff3-b3602a7dd45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:11.265821 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ef339-3616-4563-8ff3-b3602a7dd45f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:11.266151 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ef339-3616-4563-8ff3-b3602a7dd45f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:11.266398 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ef339-3616-4563-8ff3-b3602a7dd45f admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:11.267657 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ef339-3616-4563-8ff3-b3602a7dd45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:11.269437 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ef339-3616-4563-8ff3-b3602a7dd45f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:11.281546 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1150/2295] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:42:11.286088 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2a675-e524-4389-9ce1-5eda743a35d6 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:11.296797 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2a675-e524-4389-9ce1-5eda743a35d6 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:11.301438 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a85c5-1c72-4e61-a5bc-0dc0a7fc639a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:11.302311 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a85c5-1c72-4e61-a5bc-0dc0a7fc639a admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:11.302590 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a85c5-1c72-4e61-a5bc-0dc0a7fc639a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:11.302862 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a85c5-1c72-4e61-a5bc-0dc0a7fc639a admin admin] PATH_INFO: `/v3/projects/43e797f4ee3c4ea084ff15f4e2a6d332/users/a826f7e1de8748c4b6c942ebb475fb49/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:11.304827 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a85c5-1c72-4e61-a5bc-0dc0a7fc639a admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e797f4ee3c4ea084ff15f4e2a6d332, user_id=a826f7e1de8748c4b6c942ebb475fb49, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:11.307484 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a85c5-1c72-4e61-a5bc-0dc0a7fc639a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:11.318133 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1146/2296] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:42:11 2022] PUT /identity/v3/projects/43e797f4ee3c4ea084ff15f4e2a6d332/users/a826f7e1de8748c4b6c942ebb475fb49/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:11.329030 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c79f80-dd61-4fa2-8624-016446537647 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:11.330052 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c79f80-dd61-4fa2-8624-016446537647 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:11.330409 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c79f80-dd61-4fa2-8624-016446537647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:11.358566 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a6c79f80-dd61-4fa2-8624-016446537647 None None] MFA Rules not processed for user `a826f7e1de8748c4b6c942ebb475fb49`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:11.359806 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a6c79f80-dd61-4fa2-8624-016446537647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:11.417655 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a85c5-1c72-4e61-a5bc-0dc0a7fc639a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:11.419494 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-6b0a85c5-1c72-4e61-a5bc-0dc0a7fc639a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:11.442577 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1151/2297] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:42:11.452420 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c79f80-dd61-4fa2-8624-016446537647 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:11.453757 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a6c79f80-dd61-4fa2-8624-016446537647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:11.488051 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a85c5-1c72-4e61-a5bc-0dc0a7fc639a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:11.493257 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2c070-b90e-46bb-b15f-f32272937240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:11.494113 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2c070-b90e-46bb-b15f-f32272937240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:11.494395 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2c070-b90e-46bb-b15f-f32272937240 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:11.494671 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2c070-b90e-46bb-b15f-f32272937240 admin admin] PATH_INFO: `/v3/projects/52329d3c84bb4e68aa8be34260447f01` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:11.495853 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2c070-b90e-46bb-b15f-f32272937240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52329d3c84bb4e68aa8be34260447f01)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:11.497787 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2c070-b90e-46bb-b15f-f32272937240 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:11.509729 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c79f80-dd61-4fa2-8624-016446537647 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:11.513379 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb859f8a-d6b9-45d0-9745-a70012a7f4b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:11.514042 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859f8a-d6b9-45d0-9745-a70012a7f4b9 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:11.514323 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859f8a-d6b9-45d0-9745-a70012a7f4b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:11.514597 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb859f8a-d6b9-45d0-9745-a70012a7f4b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:11.516335 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-bb859f8a-d6b9-45d0-9745-a70012a7f4b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:11.542743 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9aa2c070-b90e-46bb-b15f-f32272937240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52329d3c84bb4e68aa8be34260447f01', 'request_id': 'req-9aa2c070-b90e-46bb-b15f-f32272937240'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:11.556871 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9aa2c070-b90e-46bb-b15f-f32272937240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52329d3c84bb4e68aa8be34260447f01', 'request_id': 'req-9aa2c070-b90e-46bb-b15f-f32272937240'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:11.563290 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9aa2c070-b90e-46bb-b15f-f32272937240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52329d3c84bb4e68aa8be34260447f01', 'request_id': 'req-9aa2c070-b90e-46bb-b15f-f32272937240'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:11.573834 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb859f8a-d6b9-45d0-9745-a70012a7f4b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:11.575357 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb859f8a-d6b9-45d0-9745-a70012a7f4b9 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:11.578819 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9aa2c070-b90e-46bb-b15f-f32272937240 admin admin] The token cache is being invalidate because project 52329d3c84bb4e68aa8be34260447f01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:42:11.579787 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9aa2c070-b90e-46bb-b15f-f32272937240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:11.580549 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9aa2c070-b90e-46bb-b15f-f32272937240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:11.582310 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1147/2298] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:42:11 2022] DELETE /identity/v3/projects/52329d3c84bb4e68aa8be34260447f01 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:42:11.585456 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1152/2299] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:42:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:42:11.586429 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2c070-b90e-46bb-b15f-f32272937240 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:11.588129 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-9aa2c070-b90e-46bb-b15f-f32272937240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:11.651878 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2c070-b90e-46bb-b15f-f32272937240 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:11.656567 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a86e8-3109-49a3-b67d-6824302a0027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:11.657843 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a86e8-3109-49a3-b67d-6824302a0027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:11.658538 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a86e8-3109-49a3-b67d-6824302a0027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:11.658732 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a86e8-3109-49a3-b67d-6824302a0027 admin admin] PATH_INFO: `/v3/users/dc8b96df3914424eaf01f0312a01e524` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:11.660269 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a86e8-3109-49a3-b67d-6824302a0027 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc8b96df3914424eaf01f0312a01e524)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:11.662249 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a86e8-3109-49a3-b67d-6824302a0027 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:11.709393 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-d55a86e8-3109-49a3-b67d-6824302a0027 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc8b96df3914424eaf01f0312a01e524'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:11.716821 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-d55a86e8-3109-49a3-b67d-6824302a0027 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc8b96df3914424eaf01f0312a01e524'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:11.717617 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-d55a86e8-3109-49a3-b67d-6824302a0027 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc8b96df3914424eaf01f0312a01e524'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:11.729811 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-d55a86e8-3109-49a3-b67d-6824302a0027 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc8b96df3914424eaf01f0312a01e524'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:11.737754 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-d55a86e8-3109-49a3-b67d-6824302a0027 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc8b96df3914424eaf01f0312a01e524'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:11.743869 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1148/2300] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:42:11 2022] DELETE /identity/v3/users/dc8b96df3914424eaf01f0312a01e524 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:12.125445 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb859f8a-d6b9-45d0-9745-a70012a7f4b9 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:12.137348 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb859f8a-d6b9-45d0-9745-a70012a7f4b9 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:12.202070 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e554ed7-4f8c-4c9d-a6f8-4cd62237db86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:12.202928 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e554ed7-4f8c-4c9d-a6f8-4cd62237db86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:12.203208 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e554ed7-4f8c-4c9d-a6f8-4cd62237db86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:12.203485 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e554ed7-4f8c-4c9d-a6f8-4cd62237db86 admin admin] PATH_INFO: `/v3/projects/229f9e77eaec45f2aa5f47efdd443fa6` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:12.205903 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e554ed7-4f8c-4c9d-a6f8-4cd62237db86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=229f9e77eaec45f2aa5f47efdd443fa6)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:12.207856 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e554ed7-4f8c-4c9d-a6f8-4cd62237db86 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:12.268942 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3e554ed7-4f8c-4c9d-a6f8-4cd62237db86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '229f9e77eaec45f2aa5f47efdd443fa6', 'request_id': 'req-3e554ed7-4f8c-4c9d-a6f8-4cd62237db86'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:12.277740 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3e554ed7-4f8c-4c9d-a6f8-4cd62237db86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '229f9e77eaec45f2aa5f47efdd443fa6', 'request_id': 'req-3e554ed7-4f8c-4c9d-a6f8-4cd62237db86'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:12.287045 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3e554ed7-4f8c-4c9d-a6f8-4cd62237db86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '229f9e77eaec45f2aa5f47efdd443fa6', 'request_id': 'req-3e554ed7-4f8c-4c9d-a6f8-4cd62237db86'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:12.298139 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3e554ed7-4f8c-4c9d-a6f8-4cd62237db86 admin admin] The token cache is being invalidate because project 229f9e77eaec45f2aa5f47efdd443fa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:42:12.298659 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3e554ed7-4f8c-4c9d-a6f8-4cd62237db86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:12.299537 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-3e554ed7-4f8c-4c9d-a6f8-4cd62237db86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:12.301546 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1153/2301] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:42:12 2022] DELETE /identity/v3/projects/229f9e77eaec45f2aa5f47efdd443fa6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:12.307175 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93e067-aeea-4c61-a900-1744b945a99a None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:12.307665 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93e067-aeea-4c61-a900-1744b945a99a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:12.307756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93e067-aeea-4c61-a900-1744b945a99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:12.333681 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-6b93e067-aeea-4c61-a900-1744b945a99a None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:12.334937 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-6b93e067-aeea-4c61-a900-1744b945a99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:12.407584 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1149/2302] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:42:12.415943 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd95fc4-5545-46a1-bb1f-da4c70d70b68 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:12.416239 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd95fc4-5545-46a1-bb1f-da4c70d70b68 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:12.416645 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd95fc4-5545-46a1-bb1f-da4c70d70b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:12.463084 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-4dd95fc4-5545-46a1-bb1f-da4c70d70b68 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:12.464318 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-4dd95fc4-5545-46a1-bb1f-da4c70d70b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:12.474322 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1154/2303] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:42:12.478778 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93e067-aeea-4c61-a900-1744b945a99a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:12.491417 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93e067-aeea-4c61-a900-1744b945a99a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:12.500107 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71574a-a77e-46fd-bc0e-2ae50ccb1850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:12.500768 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71574a-a77e-46fd-bc0e-2ae50ccb1850 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:12.501110 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71574a-a77e-46fd-bc0e-2ae50ccb1850 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:12.501388 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71574a-a77e-46fd-bc0e-2ae50ccb1850 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:12.502127 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71574a-a77e-46fd-bc0e-2ae50ccb1850 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:42:12.502428 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71574a-a77e-46fd-bc0e-2ae50ccb1850 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:12.504108 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71574a-a77e-46fd-bc0e-2ae50ccb1850 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:12.516189 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1150/2304] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:42:12.521198 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd95fc4-5545-46a1-bb1f-da4c70d70b68 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:12.531171 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd95fc4-5545-46a1-bb1f-da4c70d70b68 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:12.536313 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07031a-c163-4b70-aadb-872919551012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:12.536959 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07031a-c163-4b70-aadb-872919551012 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:12.537268 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07031a-c163-4b70-aadb-872919551012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:12.537538 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07031a-c163-4b70-aadb-872919551012 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:12.538300 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07031a-c163-4b70-aadb-872919551012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:12.540193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07031a-c163-4b70-aadb-872919551012 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:12.569222 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1155/2305] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:42:12 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:42:12.570747 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71574a-a77e-46fd-bc0e-2ae50ccb1850 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:12.581289 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71574a-a77e-46fd-bc0e-2ae50ccb1850 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:12.636582 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cb0d2-e67f-4044-b493-01a1b436aa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:12.637292 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cb0d2-e67f-4044-b493-01a1b436aa9f admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:12.637616 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cb0d2-e67f-4044-b493-01a1b436aa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:12.637898 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cb0d2-e67f-4044-b493-01a1b436aa9f admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:12.638610 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6cb0d2-e67f-4044-b493-01a1b436aa9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:12.640536 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6cb0d2-e67f-4044-b493-01a1b436aa9f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:12.665388 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1151/2306] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:42:12 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:42:12.666705 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07031a-c163-4b70-aadb-872919551012 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:12.676768 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07031a-c163-4b70-aadb-872919551012 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:12.681534 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918514c-a3c5-4043-b23f-9d8e37e48fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:12.682199 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918514c-a3c5-4043-b23f-9d8e37e48fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:12.682485 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918514c-a3c5-4043-b23f-9d8e37e48fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:12.682767 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918514c-a3c5-4043-b23f-9d8e37e48fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:12.683537 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918514c-a3c5-4043-b23f-9d8e37e48fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:12.685175 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918514c-a3c5-4043-b23f-9d8e37e48fa8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:12.695458 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1156/2307] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:42:12.699620 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cb0d2-e67f-4044-b493-01a1b436aa9f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:12.710011 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cb0d2-e67f-4044-b493-01a1b436aa9f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:12.714689 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efda09-38fb-495c-b35b-12124e017cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:12.715346 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efda09-38fb-495c-b35b-12124e017cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:12.715684 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efda09-38fb-495c-b35b-12124e017cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:12.715963 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efda09-38fb-495c-b35b-12124e017cc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:12.716741 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efda09-38fb-495c-b35b-12124e017cc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:12.718365 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efda09-38fb-495c-b35b-12124e017cc6 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:12.731946 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1152/2308] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:42:12.733167 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918514c-a3c5-4043-b23f-9d8e37e48fa8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:12.744166 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918514c-a3c5-4043-b23f-9d8e37e48fa8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:12.750120 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f45337-b211-4bff-8b7b-9e848e62880d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:12.751023 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f45337-b211-4bff-8b7b-9e848e62880d admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:12.751309 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f45337-b211-4bff-8b7b-9e848e62880d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:12.751585 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f45337-b211-4bff-8b7b-9e848e62880d admin admin] PATH_INFO: `/v3/projects/eb37fd7265554e5db56a9ff8ec53a786/users/b8ba85bb93ec4775a28fc8a73c585c3a/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:12.769175 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f45337-b211-4bff-8b7b-9e848e62880d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb37fd7265554e5db56a9ff8ec53a786, user_id=b8ba85bb93ec4775a28fc8a73c585c3a, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:12.772426 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f45337-b211-4bff-8b7b-9e848e62880d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:12.787282 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1157/2309] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:42:12 2022] PUT /identity/v3/projects/eb37fd7265554e5db56a9ff8ec53a786/users/b8ba85bb93ec4775a28fc8a73c585c3a/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:12.799558 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55521d-9d2f-409a-8f07-e6deb68c8e69 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:12.799868 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55521d-9d2f-409a-8f07-e6deb68c8e69 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:12.800184 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f55521d-9d2f-409a-8f07-e6deb68c8e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:12.829403 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-5f55521d-9d2f-409a-8f07-e6deb68c8e69 None None] MFA Rules not processed for user `b8ba85bb93ec4775a28fc8a73c585c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:12.830617 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-5f55521d-9d2f-409a-8f07-e6deb68c8e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:12.893258 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1153/2310] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:42:12.905435 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f45337-b211-4bff-8b7b-9e848e62880d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:12.907572 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-36f45337-b211-4bff-8b7b-9e848e62880d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:12.972997 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f45337-b211-4bff-8b7b-9e848e62880d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:12.976984 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b8424-68ce-4f81-95cf-7919e86e977e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6940472eb8e544c8aa3409328c804282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:12.977924 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b8424-68ce-4f81-95cf-7919e86e977e service glance] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:12.978365 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b8424-68ce-4f81-95cf-7919e86e977e service glance] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:12.978793 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b8424-68ce-4f81-95cf-7919e86e977e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:12.991197 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b8424-68ce-4f81-95cf-7919e86e977e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:12.992704 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399b8424-68ce-4f81-95cf-7919e86e977e service glance] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:13.005730 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1158/2311] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:42:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:42:13.165117 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55521d-9d2f-409a-8f07-e6deb68c8e69 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:13.166630 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-5f55521d-9d2f-409a-8f07-e6deb68c8e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:13.237579 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f55521d-9d2f-409a-8f07-e6deb68c8e69 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:13.241784 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398c783-6480-4ed5-8ea1-b45f1ce832a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:13.242568 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398c783-6480-4ed5-8ea1-b45f1ce832a7 service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:13.242663 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398c783-6480-4ed5-8ea1-b45f1ce832a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:13.242944 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398c783-6480-4ed5-8ea1-b45f1ce832a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:13.245434 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-8398c783-6480-4ed5-8ea1-b45f1ce832a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:13.316321 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398c783-6480-4ed5-8ea1-b45f1ce832a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:13.318696 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398c783-6480-4ed5-8ea1-b45f1ce832a7 service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:13.329947 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1154/2312] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:42:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:42:13.462943 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b8424-68ce-4f81-95cf-7919e86e977e service glance] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:13.464487 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-399b8424-68ce-4f81-95cf-7919e86e977e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:13.598096 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399b8424-68ce-4f81-95cf-7919e86e977e service glance] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:13.608170 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07f102-3584-48c9-a0c9-725184acc863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:13.609490 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07f102-3584-48c9-a0c9-725184acc863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:13.609490 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07f102-3584-48c9-a0c9-725184acc863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:13.609703 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07f102-3584-48c9-a0c9-725184acc863 admin admin] PATH_INFO: `/v3/users/bd79b87279bf4fe28e8010c9a7a1fb6a` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:13.611552 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07f102-3584-48c9-a0c9-725184acc863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd79b87279bf4fe28e8010c9a7a1fb6a)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:13.613548 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07f102-3584-48c9-a0c9-725184acc863 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:13.665388 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-af07f102-3584-48c9-a0c9-725184acc863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd79b87279bf4fe28e8010c9a7a1fb6a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:13.679354 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-af07f102-3584-48c9-a0c9-725184acc863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd79b87279bf4fe28e8010c9a7a1fb6a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:13.680393 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-af07f102-3584-48c9-a0c9-725184acc863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd79b87279bf4fe28e8010c9a7a1fb6a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:13.701853 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-af07f102-3584-48c9-a0c9-725184acc863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd79b87279bf4fe28e8010c9a7a1fb6a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:13.713386 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-af07f102-3584-48c9-a0c9-725184acc863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd79b87279bf4fe28e8010c9a7a1fb6a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:13.721468 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1159/2313] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:42:13 2022] DELETE /identity/v3/users/bd79b87279bf4fe28e8010c9a7a1fb6a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:13.724610 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d584d-1e9f-4cd6-a0fe-c9f0d8d88b39 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:13.724894 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d584d-1e9f-4cd6-a0fe-c9f0d8d88b39 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:13.725198 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d584d-1e9f-4cd6-a0fe-c9f0d8d88b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:13.760671 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-2e2d584d-1e9f-4cd6-a0fe-c9f0d8d88b39 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:13.763093 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-2e2d584d-1e9f-4cd6-a0fe-c9f0d8d88b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:13.856743 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1155/2314] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:42:13.869733 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07f102-3584-48c9-a0c9-725184acc863 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:13.871825 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-af07f102-3584-48c9-a0c9-725184acc863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:13.940275 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07f102-3584-48c9-a0c9-725184acc863 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:13.944029 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f3941-6c3e-4f26-b8f4-ff5e9ef0ba83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:13.944730 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f3941-6c3e-4f26-b8f4-ff5e9ef0ba83 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:13.945033 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f3941-6c3e-4f26-b8f4-ff5e9ef0ba83 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:13.945315 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f3941-6c3e-4f26-b8f4-ff5e9ef0ba83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:13.956448 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f3941-6c3e-4f26-b8f4-ff5e9ef0ba83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:13.958257 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f3941-6c3e-4f26-b8f4-ff5e9ef0ba83 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:13.969487 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1160/2315] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:42:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:42:14.114274 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d584d-1e9f-4cd6-a0fe-c9f0d8d88b39 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:14.117510 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-2e2d584d-1e9f-4cd6-a0fe-c9f0d8d88b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:14.197416 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d584d-1e9f-4cd6-a0fe-c9f0d8d88b39 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:14.201171 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468df25-aea3-4c9b-93bc-a339c38fafd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:14.201825 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468df25-aea3-4c9b-93bc-a339c38fafd8 service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:14.202150 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468df25-aea3-4c9b-93bc-a339c38fafd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:14.202544 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468df25-aea3-4c9b-93bc-a339c38fafd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:14.205409 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-5468df25-aea3-4c9b-93bc-a339c38fafd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:14.341573 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468df25-aea3-4c9b-93bc-a339c38fafd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:14.343030 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468df25-aea3-4c9b-93bc-a339c38fafd8 service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:14.368500 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1156/2316] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:42:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:42:14.629390 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f3941-6c3e-4f26-b8f4-ff5e9ef0ba83 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:14.630866 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ce8f3941-6c3e-4f26-b8f4-ff5e9ef0ba83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:14.644998 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f3941-6c3e-4f26-b8f4-ff5e9ef0ba83 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:14.653394 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a92cf4-26e6-417a-a430-7f7b2cd5c9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:14.654894 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a92cf4-26e6-417a-a430-7f7b2cd5c9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:14.655323 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a92cf4-26e6-417a-a430-7f7b2cd5c9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:14.655821 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a92cf4-26e6-417a-a430-7f7b2cd5c9bb admin admin] PATH_INFO: `/v3/projects/8cf1796cc0cd429a95ea76e90e54192c` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:14.659629 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a92cf4-26e6-417a-a430-7f7b2cd5c9bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cf1796cc0cd429a95ea76e90e54192c)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:14.662426 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a92cf4-26e6-417a-a430-7f7b2cd5c9bb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:14.774105 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-93a92cf4-26e6-417a-a430-7f7b2cd5c9bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cf1796cc0cd429a95ea76e90e54192c', 'request_id': 'req-93a92cf4-26e6-417a-a430-7f7b2cd5c9bb'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:14.781742 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-93a92cf4-26e6-417a-a430-7f7b2cd5c9bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cf1796cc0cd429a95ea76e90e54192c', 'request_id': 'req-93a92cf4-26e6-417a-a430-7f7b2cd5c9bb'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:14.793733 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-93a92cf4-26e6-417a-a430-7f7b2cd5c9bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cf1796cc0cd429a95ea76e90e54192c', 'request_id': 'req-93a92cf4-26e6-417a-a430-7f7b2cd5c9bb'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:14.818909 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-93a92cf4-26e6-417a-a430-7f7b2cd5c9bb admin admin] The token cache is being invalidate because project 8cf1796cc0cd429a95ea76e90e54192c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:42:14.819518 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-93a92cf4-26e6-417a-a430-7f7b2cd5c9bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:14.820614 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-93a92cf4-26e6-417a-a430-7f7b2cd5c9bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:14.823144 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1161/2317] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:42:14 2022] DELETE /identity/v3/projects/8cf1796cc0cd429a95ea76e90e54192c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:14.828793 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11949d4d-a174-4f64-8f96-5d97e7fa0e77 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:14.829720 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11949d4d-a174-4f64-8f96-5d97e7fa0e77 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:14.830008 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11949d4d-a174-4f64-8f96-5d97e7fa0e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:14.849637 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-11949d4d-a174-4f64-8f96-5d97e7fa0e77 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:14.850865 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-11949d4d-a174-4f64-8f96-5d97e7fa0e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:14.945148 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1157/2318] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:42:14.949479 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f6c11-91e4-4b4a-b88b-e245dc931500 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:14.949778 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f6c11-91e4-4b4a-b88b-e245dc931500 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:14.950061 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f6c11-91e4-4b4a-b88b-e245dc931500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:14.976239 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-7c1f6c11-91e4-4b4a-b88b-e245dc931500 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:14.977491 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7c1f6c11-91e4-4b4a-b88b-e245dc931500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:14.987014 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1162/2319] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:42:14.991172 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11949d4d-a174-4f64-8f96-5d97e7fa0e77 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:15.002270 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11949d4d-a174-4f64-8f96-5d97e7fa0e77 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:15.007234 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb594115-aadc-479e-8ae4-9f5675eab8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:15.007896 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb594115-aadc-479e-8ae4-9f5675eab8cd admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:15.008177 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb594115-aadc-479e-8ae4-9f5675eab8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:15.008452 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb594115-aadc-479e-8ae4-9f5675eab8cd admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:15.009229 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb594115-aadc-479e-8ae4-9f5675eab8cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:42:15.011155 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb594115-aadc-479e-8ae4-9f5675eab8cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:15.012785 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb594115-aadc-479e-8ae4-9f5675eab8cd admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:15.024921 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1158/2320] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:42:15.029114 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f6c11-91e4-4b4a-b88b-e245dc931500 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:15.039023 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f6c11-91e4-4b4a-b88b-e245dc931500 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:15.043866 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e9d3a-1136-40b5-8b9f-0e07fd4e3410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:15.044531 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e9d3a-1136-40b5-8b9f-0e07fd4e3410 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:15.044813 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e9d3a-1136-40b5-8b9f-0e07fd4e3410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:15.045125 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e9d3a-1136-40b5-8b9f-0e07fd4e3410 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:15.045844 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e9d3a-1136-40b5-8b9f-0e07fd4e3410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:15.048261 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e9d3a-1136-40b5-8b9f-0e07fd4e3410 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:15.084377 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1163/2321] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:42:15 2022] POST /identity/v3/projects => generated 399 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:42:15.088658 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb594115-aadc-479e-8ae4-9f5675eab8cd admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:15.101668 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb594115-aadc-479e-8ae4-9f5675eab8cd admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:15.170597 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087c0bc-fd33-4573-b452-eacc88713bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:15.171270 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087c0bc-fd33-4573-b452-eacc88713bda admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:15.171552 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087c0bc-fd33-4573-b452-eacc88713bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:15.171907 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087c0bc-fd33-4573-b452-eacc88713bda admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:15.172523 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087c0bc-fd33-4573-b452-eacc88713bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:15.175084 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087c0bc-fd33-4573-b452-eacc88713bda admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:15.198912 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1159/2322] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:42:15 2022] POST /identity/v3/users => generated 300 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:42:15.203307 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e9d3a-1136-40b5-8b9f-0e07fd4e3410 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:15.215594 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e9d3a-1136-40b5-8b9f-0e07fd4e3410 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:15.221659 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8c905-d21a-4acb-a85d-888af0bec9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:15.223462 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8c905-d21a-4acb-a85d-888af0bec9bb admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:15.223827 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8c905-d21a-4acb-a85d-888af0bec9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:15.224297 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8c905-d21a-4acb-a85d-888af0bec9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:15.225597 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8c905-d21a-4acb-a85d-888af0bec9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:15.227323 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b8c905-d21a-4acb-a85d-888af0bec9bb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:15.240859 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1164/2323] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:42:15.245100 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087c0bc-fd33-4573-b452-eacc88713bda admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:15.256392 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087c0bc-fd33-4573-b452-eacc88713bda admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:15.261187 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb97e8a-3ca8-4fc6-8ff1-33a313833d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:15.261864 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb97e8a-3ca8-4fc6-8ff1-33a313833d7f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:15.262144 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb97e8a-3ca8-4fc6-8ff1-33a313833d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:15.262418 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb97e8a-3ca8-4fc6-8ff1-33a313833d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:15.263161 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb97e8a-3ca8-4fc6-8ff1-33a313833d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:15.269548 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb97e8a-3ca8-4fc6-8ff1-33a313833d7f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:15.285724 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1160/2324] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:42:15.290071 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8c905-d21a-4acb-a85d-888af0bec9bb admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:15.304786 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8c905-d21a-4acb-a85d-888af0bec9bb admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:15.312049 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2073d-b8b4-43c0-ad3a-5cfb412549c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:15.313159 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2073d-b8b4-43c0-ad3a-5cfb412549c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:15.313663 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2073d-b8b4-43c0-ad3a-5cfb412549c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:15.314111 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2073d-b8b4-43c0-ad3a-5cfb412549c7 admin admin] PATH_INFO: `/v3/projects/f240d1b5a8a14d7eb05b68dfa029bf79/users/69be82ee252e4c4db56b47848652b078/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:15.335470 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2073d-b8b4-43c0-ad3a-5cfb412549c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f240d1b5a8a14d7eb05b68dfa029bf79, user_id=69be82ee252e4c4db56b47848652b078, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:15.338341 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2073d-b8b4-43c0-ad3a-5cfb412549c7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:15.356240 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1165/2325] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:42:15 2022] PUT /identity/v3/projects/f240d1b5a8a14d7eb05b68dfa029bf79/users/69be82ee252e4c4db56b47848652b078/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:15.367632 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28c027-0d87-4467-92f7-a65d62fb37c0 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:15.368119 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28c027-0d87-4467-92f7-a65d62fb37c0 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:15.368229 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28c027-0d87-4467-92f7-a65d62fb37c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:15.394735 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-ad28c027-0d87-4467-92f7-a65d62fb37c0 None None] MFA Rules not processed for user `69be82ee252e4c4db56b47848652b078`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:15.396046 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-ad28c027-0d87-4467-92f7-a65d62fb37c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:15.470365 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1161/2326] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:42:15.483060 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2073d-b8b4-43c0-ad3a-5cfb412549c7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:15.484745 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c8e2073d-b8b4-43c0-ad3a-5cfb412549c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:15.583324 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2073d-b8b4-43c0-ad3a-5cfb412549c7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:15.588306 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ad348-9fd7-416e-a872-5115f5ab741e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:15.588984 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ad348-9fd7-416e-a872-5115f5ab741e service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:15.589346 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ad348-9fd7-416e-a872-5115f5ab741e service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:15.589668 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ad348-9fd7-416e-a872-5115f5ab741e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:15.600864 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ad348-9fd7-416e-a872-5115f5ab741e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:15.602563 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ad348-9fd7-416e-a872-5115f5ab741e service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:15.613389 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1166/2327] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:42:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:42:18.394982 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28c027-0d87-4467-92f7-a65d62fb37c0 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:18.396385 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-ad28c027-0d87-4467-92f7-a65d62fb37c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:18.467101 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28c027-0d87-4467-92f7-a65d62fb37c0 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:18.472465 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20aa4a4-2dd0-4582-8f82-87831ee3f8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:18.473467 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20aa4a4-2dd0-4582-8f82-87831ee3f8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:18.473813 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20aa4a4-2dd0-4582-8f82-87831ee3f8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:18.474144 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20aa4a4-2dd0-4582-8f82-87831ee3f8b5 admin admin] PATH_INFO: `/v3/users/473e90834d8f408e98b7365709a5d332` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:18.475524 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20aa4a4-2dd0-4582-8f82-87831ee3f8b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=473e90834d8f408e98b7365709a5d332)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:18.477603 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20aa4a4-2dd0-4582-8f82-87831ee3f8b5 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:18.525627 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-b20aa4a4-2dd0-4582-8f82-87831ee3f8b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '473e90834d8f408e98b7365709a5d332'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:18.533029 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-b20aa4a4-2dd0-4582-8f82-87831ee3f8b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '473e90834d8f408e98b7365709a5d332'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:18.533863 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-b20aa4a4-2dd0-4582-8f82-87831ee3f8b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '473e90834d8f408e98b7365709a5d332'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:18.552861 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-b20aa4a4-2dd0-4582-8f82-87831ee3f8b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '473e90834d8f408e98b7365709a5d332'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:18.560860 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-b20aa4a4-2dd0-4582-8f82-87831ee3f8b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '473e90834d8f408e98b7365709a5d332'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:18.566985 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1162/2328] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:42:18 2022] DELETE /identity/v3/users/473e90834d8f408e98b7365709a5d332 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:18.574747 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521193f-324b-4af7-bb79-fa2b3e2b1f59 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:18.575215 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521193f-324b-4af7-bb79-fa2b3e2b1f59 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:18.575722 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521193f-324b-4af7-bb79-fa2b3e2b1f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:18.605495 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-3521193f-324b-4af7-bb79-fa2b3e2b1f59 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:18.606806 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3521193f-324b-4af7-bb79-fa2b3e2b1f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:18.664944 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1167/2329] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:42:18.674483 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20aa4a4-2dd0-4582-8f82-87831ee3f8b5 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:18.675877 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-b20aa4a4-2dd0-4582-8f82-87831ee3f8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:18.730658 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20aa4a4-2dd0-4582-8f82-87831ee3f8b5 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:18.734386 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcc8ec-f7d7-4357-84f3-70063d5c2c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:18.735019 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcc8ec-f7d7-4357-84f3-70063d5c2c2a service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:18.735329 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcc8ec-f7d7-4357-84f3-70063d5c2c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:18.735607 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcc8ec-f7d7-4357-84f3-70063d5c2c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:18.744609 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcc8ec-f7d7-4357-84f3-70063d5c2c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:18.746098 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcc8ec-f7d7-4357-84f3-70063d5c2c2a service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:18.759805 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1163/2330] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:42:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:42:19.020749 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521193f-324b-4af7-bb79-fa2b3e2b1f59 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:19.022325 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3521193f-324b-4af7-bb79-fa2b3e2b1f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:19.037403 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521193f-324b-4af7-bb79-fa2b3e2b1f59 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:19.042373 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8cd88-5377-437b-ac72-56a4f215bb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:19.043235 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8cd88-5377-437b-ac72-56a4f215bb5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:19.043561 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8cd88-5377-437b-ac72-56a4f215bb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:19.043779 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8cd88-5377-437b-ac72-56a4f215bb5f admin admin] PATH_INFO: `/v3/projects/ed2fb4c3914c43068fdcdfa82b480487` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:19.045179 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8cd88-5377-437b-ac72-56a4f215bb5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed2fb4c3914c43068fdcdfa82b480487)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:19.047152 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8cd88-5377-437b-ac72-56a4f215bb5f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:19.092663 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bda8cd88-5377-437b-ac72-56a4f215bb5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed2fb4c3914c43068fdcdfa82b480487', 'request_id': 'req-bda8cd88-5377-437b-ac72-56a4f215bb5f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:19.098722 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bda8cd88-5377-437b-ac72-56a4f215bb5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed2fb4c3914c43068fdcdfa82b480487', 'request_id': 'req-bda8cd88-5377-437b-ac72-56a4f215bb5f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:19.105748 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bda8cd88-5377-437b-ac72-56a4f215bb5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed2fb4c3914c43068fdcdfa82b480487', 'request_id': 'req-bda8cd88-5377-437b-ac72-56a4f215bb5f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:19.115873 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bda8cd88-5377-437b-ac72-56a4f215bb5f admin admin] The token cache is being invalidate because project ed2fb4c3914c43068fdcdfa82b480487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:42:19.116160 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bda8cd88-5377-437b-ac72-56a4f215bb5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:19.116800 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bda8cd88-5377-437b-ac72-56a4f215bb5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:19.118348 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1168/2331] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:42:19 2022] DELETE /identity/v3/projects/ed2fb4c3914c43068fdcdfa82b480487 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:19.122451 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcc8ec-f7d7-4357-84f3-70063d5c2c2a service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:19.132163 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcc8ec-f7d7-4357-84f3-70063d5c2c2a service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:19.192062 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac6bf0-3a25-4471-9250-3cac3458b2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:19.192924 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac6bf0-3a25-4471-9250-3cac3458b2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:19.193237 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac6bf0-3a25-4471-9250-3cac3458b2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:19.193512 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac6bf0-3a25-4471-9250-3cac3458b2c5 admin admin] PATH_INFO: `/v3/users/831bddbc2bdd42c08c6856a9dd4e9804` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:19.194701 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac6bf0-3a25-4471-9250-3cac3458b2c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=831bddbc2bdd42c08c6856a9dd4e9804)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:19.196613 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac6bf0-3a25-4471-9250-3cac3458b2c5 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:19.240417 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-8bac6bf0-3a25-4471-9250-3cac3458b2c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '831bddbc2bdd42c08c6856a9dd4e9804'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:19.247104 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-8bac6bf0-3a25-4471-9250-3cac3458b2c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '831bddbc2bdd42c08c6856a9dd4e9804'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:19.247785 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-8bac6bf0-3a25-4471-9250-3cac3458b2c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '831bddbc2bdd42c08c6856a9dd4e9804'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:19.259973 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-8bac6bf0-3a25-4471-9250-3cac3458b2c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '831bddbc2bdd42c08c6856a9dd4e9804'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:19.267566 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-8bac6bf0-3a25-4471-9250-3cac3458b2c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '831bddbc2bdd42c08c6856a9dd4e9804'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:19.273810 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1164/2332] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:42:19 2022] DELETE /identity/v3/users/831bddbc2bdd42c08c6856a9dd4e9804 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:19.533559 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8cd88-5377-437b-ac72-56a4f215bb5f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:19.535058 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-bda8cd88-5377-437b-ac72-56a4f215bb5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:19.548499 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8cd88-5377-437b-ac72-56a4f215bb5f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:19.604684 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f30aec-a8fc-46c7-bf3a-3111c28865d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:19.606270 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f30aec-a8fc-46c7-bf3a-3111c28865d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:19.606715 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f30aec-a8fc-46c7-bf3a-3111c28865d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:19.607251 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f30aec-a8fc-46c7-bf3a-3111c28865d5 admin admin] PATH_INFO: `/v3/projects/d6e1462450294e15828424d04477d1c5` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:19.608861 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f30aec-a8fc-46c7-bf3a-3111c28865d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6e1462450294e15828424d04477d1c5)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:19.611018 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f30aec-a8fc-46c7-bf3a-3111c28865d5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:19.660850 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a0f30aec-a8fc-46c7-bf3a-3111c28865d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6e1462450294e15828424d04477d1c5', 'request_id': 'req-a0f30aec-a8fc-46c7-bf3a-3111c28865d5'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:19.666787 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a0f30aec-a8fc-46c7-bf3a-3111c28865d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6e1462450294e15828424d04477d1c5', 'request_id': 'req-a0f30aec-a8fc-46c7-bf3a-3111c28865d5'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:19.674395 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a0f30aec-a8fc-46c7-bf3a-3111c28865d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6e1462450294e15828424d04477d1c5', 'request_id': 'req-a0f30aec-a8fc-46c7-bf3a-3111c28865d5'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:19.684091 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a0f30aec-a8fc-46c7-bf3a-3111c28865d5 admin admin] The token cache is being invalidate because project d6e1462450294e15828424d04477d1c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:42:19.684389 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a0f30aec-a8fc-46c7-bf3a-3111c28865d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:19.685026 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a0f30aec-a8fc-46c7-bf3a-3111c28865d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:19.686538 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1169/2333] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:42:19 2022] DELETE /identity/v3/projects/d6e1462450294e15828424d04477d1c5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:19.690480 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac6bf0-3a25-4471-9250-3cac3458b2c5 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:19.691894 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-8bac6bf0-3a25-4471-9250-3cac3458b2c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:19.704695 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac6bf0-3a25-4471-9250-3cac3458b2c5 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:19.758050 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef408a-2bb3-4013-97ab-ea91ac8a3ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:19.758904 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef408a-2bb3-4013-97ab-ea91ac8a3ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:19.759184 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef408a-2bb3-4013-97ab-ea91ac8a3ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:19.759457 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef408a-2bb3-4013-97ab-ea91ac8a3ca8 admin admin] PATH_INFO: `/v3/users/a826f7e1de8748c4b6c942ebb475fb49` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:19.760630 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef408a-2bb3-4013-97ab-ea91ac8a3ca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a826f7e1de8748c4b6c942ebb475fb49)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:19.762591 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef408a-2bb3-4013-97ab-ea91ac8a3ca8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:19.806020 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-2cef408a-2bb3-4013-97ab-ea91ac8a3ca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a826f7e1de8748c4b6c942ebb475fb49'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:19.812731 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-2cef408a-2bb3-4013-97ab-ea91ac8a3ca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a826f7e1de8748c4b6c942ebb475fb49'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:19.813952 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-2cef408a-2bb3-4013-97ab-ea91ac8a3ca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a826f7e1de8748c4b6c942ebb475fb49'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:19.824861 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-2cef408a-2bb3-4013-97ab-ea91ac8a3ca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a826f7e1de8748c4b6c942ebb475fb49'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:19.832028 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-2cef408a-2bb3-4013-97ab-ea91ac8a3ca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a826f7e1de8748c4b6c942ebb475fb49'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:19.838094 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1165/2334] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:42:19 2022] DELETE /identity/v3/users/a826f7e1de8748c4b6c942ebb475fb49 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:20.257906 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f30aec-a8fc-46c7-bf3a-3111c28865d5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:20.259391 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a0f30aec-a8fc-46c7-bf3a-3111c28865d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:20.272982 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f30aec-a8fc-46c7-bf3a-3111c28865d5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:20.339067 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b5a945-3aae-49ad-af12-bc0f8fbfdde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:20.339931 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5a945-3aae-49ad-af12-bc0f8fbfdde4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:20.340214 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5a945-3aae-49ad-af12-bc0f8fbfdde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:20.340489 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b5a945-3aae-49ad-af12-bc0f8fbfdde4 admin admin] PATH_INFO: `/v3/projects/43e797f4ee3c4ea084ff15f4e2a6d332` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:20.341704 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5a945-3aae-49ad-af12-bc0f8fbfdde4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43e797f4ee3c4ea084ff15f4e2a6d332)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:20.343658 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b5a945-3aae-49ad-af12-bc0f8fbfdde4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:20.390807 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e1b5a945-3aae-49ad-af12-bc0f8fbfdde4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43e797f4ee3c4ea084ff15f4e2a6d332', 'request_id': 'req-e1b5a945-3aae-49ad-af12-bc0f8fbfdde4'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:20.396860 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e1b5a945-3aae-49ad-af12-bc0f8fbfdde4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43e797f4ee3c4ea084ff15f4e2a6d332', 'request_id': 'req-e1b5a945-3aae-49ad-af12-bc0f8fbfdde4'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:20.403933 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e1b5a945-3aae-49ad-af12-bc0f8fbfdde4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43e797f4ee3c4ea084ff15f4e2a6d332', 'request_id': 'req-e1b5a945-3aae-49ad-af12-bc0f8fbfdde4'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:20.413994 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e1b5a945-3aae-49ad-af12-bc0f8fbfdde4 admin admin] The token cache is being invalidate because project 43e797f4ee3c4ea084ff15f4e2a6d332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:42:20.414284 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e1b5a945-3aae-49ad-af12-bc0f8fbfdde4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:20.414902 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e1b5a945-3aae-49ad-af12-bc0f8fbfdde4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:20.416473 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1170/2335] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:42:20 2022] DELETE /identity/v3/projects/43e797f4ee3c4ea084ff15f4e2a6d332 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:20.422284 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81784785-ebf8-4635-9156-9ce75698d7ba None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:20.423146 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81784785-ebf8-4635-9156-9ce75698d7ba None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:20.423424 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81784785-ebf8-4635-9156-9ce75698d7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:20.444761 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-81784785-ebf8-4635-9156-9ce75698d7ba None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:20.446137 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-81784785-ebf8-4635-9156-9ce75698d7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:20.504804 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1166/2336] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:42:20.512697 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79560f61-ff90-4fc7-a668-3f10b9a85a49 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:20.512989 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79560f61-ff90-4fc7-a668-3f10b9a85a49 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:20.513293 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79560f61-ff90-4fc7-a668-3f10b9a85a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:20.531578 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-79560f61-ff90-4fc7-a668-3f10b9a85a49 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:20.533307 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-79560f61-ff90-4fc7-a668-3f10b9a85a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:20.541331 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1171/2337] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:42:20.550437 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81784785-ebf8-4635-9156-9ce75698d7ba None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:20.560670 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81784785-ebf8-4635-9156-9ce75698d7ba None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:20.568608 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fc367-0edf-4544-8106-31fa1e0803ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:20.569295 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fc367-0edf-4544-8106-31fa1e0803ec admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:20.569584 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fc367-0edf-4544-8106-31fa1e0803ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:20.569862 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fc367-0edf-4544-8106-31fa1e0803ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:20.570606 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fc367-0edf-4544-8106-31fa1e0803ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:42:20.570913 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fc367-0edf-4544-8106-31fa1e0803ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:20.572538 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fc367-0edf-4544-8106-31fa1e0803ec admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:20.584149 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1167/2338] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:42:20.588254 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79560f61-ff90-4fc7-a668-3f10b9a85a49 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:20.597911 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79560f61-ff90-4fc7-a668-3f10b9a85a49 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:20.602540 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8029394-b5c1-4ec3-835d-e7a25cc36e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:20.603181 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8029394-b5c1-4ec3-835d-e7a25cc36e13 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:20.603463 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8029394-b5c1-4ec3-835d-e7a25cc36e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:20.603740 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8029394-b5c1-4ec3-835d-e7a25cc36e13 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:20.604493 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8029394-b5c1-4ec3-835d-e7a25cc36e13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:20.606416 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8029394-b5c1-4ec3-835d-e7a25cc36e13 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:20.631651 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1172/2339] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:42:20 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:42:20.635790 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fc367-0edf-4544-8106-31fa1e0803ec admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:20.646051 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fc367-0edf-4544-8106-31fa1e0803ec admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:20.701031 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d4969-86e2-4526-b0fd-46c851bba2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:20.701660 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d4969-86e2-4526-b0fd-46c851bba2a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:20.701772 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d4969-86e2-4526-b0fd-46c851bba2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:20.701990 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d4969-86e2-4526-b0fd-46c851bba2a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:20.702696 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d4969-86e2-4526-b0fd-46c851bba2a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:20.704628 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d4969-86e2-4526-b0fd-46c851bba2a0 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:20.726976 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1168/2340] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:42:20 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:42:20.728144 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8029394-b5c1-4ec3-835d-e7a25cc36e13 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:20.738915 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8029394-b5c1-4ec3-835d-e7a25cc36e13 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:20.743487 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bc3f5-d25a-4ece-9aa1-d8dd879d534e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:20.744143 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bc3f5-d25a-4ece-9aa1-d8dd879d534e admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:20.744430 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bc3f5-d25a-4ece-9aa1-d8dd879d534e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:20.744710 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bc3f5-d25a-4ece-9aa1-d8dd879d534e admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:20.745495 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5bc3f5-d25a-4ece-9aa1-d8dd879d534e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:20.747101 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5bc3f5-d25a-4ece-9aa1-d8dd879d534e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:20.757142 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1173/2341] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:42:20.760758 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d4969-86e2-4526-b0fd-46c851bba2a0 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:20.770463 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d4969-86e2-4526-b0fd-46c851bba2a0 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:20.775285 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70fe0b-960e-4157-9ea6-ae005f8bd223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:20.775917 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70fe0b-960e-4157-9ea6-ae005f8bd223 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:20.776212 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70fe0b-960e-4157-9ea6-ae005f8bd223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:20.776465 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70fe0b-960e-4157-9ea6-ae005f8bd223 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:20.777247 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70fe0b-960e-4157-9ea6-ae005f8bd223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:20.778963 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70fe0b-960e-4157-9ea6-ae005f8bd223 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:20.788847 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1169/2342] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:42:20.792700 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bc3f5-d25a-4ece-9aa1-d8dd879d534e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:20.803075 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bc3f5-d25a-4ece-9aa1-d8dd879d534e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:20.807719 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436206b-bf1b-47d5-a3ef-55459b8a53cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:20.808586 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436206b-bf1b-47d5-a3ef-55459b8a53cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:20.808871 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436206b-bf1b-47d5-a3ef-55459b8a53cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:20.809186 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436206b-bf1b-47d5-a3ef-55459b8a53cc admin admin] PATH_INFO: `/v3/projects/85b1c02b545d4272a79d2b1dfb6139f5/users/f97812ad784a49bb93ab0ec91d8edd65/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:20.822857 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436206b-bf1b-47d5-a3ef-55459b8a53cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b1c02b545d4272a79d2b1dfb6139f5, user_id=f97812ad784a49bb93ab0ec91d8edd65, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:20.825558 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436206b-bf1b-47d5-a3ef-55459b8a53cc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:20.837729 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1174/2343] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:42:20 2022] PUT /identity/v3/projects/85b1c02b545d4272a79d2b1dfb6139f5/users/f97812ad784a49bb93ab0ec91d8edd65/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:42:20.842648 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe610f3-3035-4bb0-a0f2-83bf82faac51 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:20.842940 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe610f3-3035-4bb0-a0f2-83bf82faac51 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:20.843228 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe610f3-3035-4bb0-a0f2-83bf82faac51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:20.862879 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-6fe610f3-3035-4bb0-a0f2-83bf82faac51 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:20.864094 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-6fe610f3-3035-4bb0-a0f2-83bf82faac51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:20.921941 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1170/2344] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:42:20.931368 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436206b-bf1b-47d5-a3ef-55459b8a53cc admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:20.933088 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1436206b-bf1b-47d5-a3ef-55459b8a53cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:20.987952 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436206b-bf1b-47d5-a3ef-55459b8a53cc admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:20.991623 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961e546-5214-45e6-b0c2-fef95faa8892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:20.992264 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961e546-5214-45e6-b0c2-fef95faa8892 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:20.992552 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961e546-5214-45e6-b0c2-fef95faa8892 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:20.992831 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961e546-5214-45e6-b0c2-fef95faa8892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:21.002365 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961e546-5214-45e6-b0c2-fef95faa8892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:21.003797 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961e546-5214-45e6-b0c2-fef95faa8892 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:21.013066 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1175/2345] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:42:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:42:21.601566 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4bcd2-2649-4bf2-86e0-b3f730bb2d24 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:21.601933 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4bcd2-2649-4bf2-86e0-b3f730bb2d24 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:21.602305 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d4bcd2-2649-4bf2-86e0-b3f730bb2d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:21.630651 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-21d4bcd2-2649-4bf2-86e0-b3f730bb2d24 None None] MFA Rules not processed for user `f97812ad784a49bb93ab0ec91d8edd65`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:21.631854 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-21d4bcd2-2649-4bf2-86e0-b3f730bb2d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:21.707702 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1171/2346] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:42:21.718485 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961e546-5214-45e6-b0c2-fef95faa8892 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:21.720889 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a961e546-5214-45e6-b0c2-fef95faa8892 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:21.775982 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961e546-5214-45e6-b0c2-fef95faa8892 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:21.779759 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2b2f1-4d48-4d87-8e4a-0f0674ac04ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:21.780399 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2b2f1-4d48-4d87-8e4a-0f0674ac04ea service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:21.780679 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2b2f1-4d48-4d87-8e4a-0f0674ac04ea service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:21.780953 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2b2f1-4d48-4d87-8e4a-0f0674ac04ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:21.789621 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2b2f1-4d48-4d87-8e4a-0f0674ac04ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:21.790992 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2b2f1-4d48-4d87-8e4a-0f0674ac04ea service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:21.799684 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1176/2347] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:42:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:42:26.280324 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c220e5-af4c-4c14-b038-e92b0a1076b6 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:26.280898 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c220e5-af4c-4c14-b038-e92b0a1076b6 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:26.280898 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c220e5-af4c-4c14-b038-e92b0a1076b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:26.298449 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-45c220e5-af4c-4c14-b038-e92b0a1076b6 None None] MFA Rules not processed for user `f97812ad784a49bb93ab0ec91d8edd65`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:26.299632 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-45c220e5-af4c-4c14-b038-e92b0a1076b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:26.306900 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1172/2348] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:42:26.995853 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00be7cd-5053-4318-8315-d2bef50a0172 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:26.996342 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00be7cd-5053-4318-8315-d2bef50a0172 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:26.996423 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00be7cd-5053-4318-8315-d2bef50a0172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:27.017428 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a00be7cd-5053-4318-8315-d2bef50a0172 None None] MFA Rules not processed for user `a7d55c38bc5e4545aa175151a75e9bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:27.018654 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a00be7cd-5053-4318-8315-d2bef50a0172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:27.103663 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1177/2349] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:42:28.146469 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c220e5-af4c-4c14-b038-e92b0a1076b6 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:28.148492 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-45c220e5-af4c-4c14-b038-e92b0a1076b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:28.166895 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c220e5-af4c-4c14-b038-e92b0a1076b6 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:28.172137 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2e324-46d2-4797-853b-1fbc48d29a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:28.173861 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2e324-46d2-4797-853b-1fbc48d29a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:28.174348 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2e324-46d2-4797-853b-1fbc48d29a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:28.175658 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2e324-46d2-4797-853b-1fbc48d29a43 admin admin] PATH_INFO: `/v3/users/69be82ee252e4c4db56b47848652b078` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:28.177693 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2e324-46d2-4797-853b-1fbc48d29a43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69be82ee252e4c4db56b47848652b078)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:28.180338 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2e324-46d2-4797-853b-1fbc48d29a43 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:28.235740 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-89c2e324-46d2-4797-853b-1fbc48d29a43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69be82ee252e4c4db56b47848652b078'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:28.245819 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-89c2e324-46d2-4797-853b-1fbc48d29a43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69be82ee252e4c4db56b47848652b078'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:28.246500 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-89c2e324-46d2-4797-853b-1fbc48d29a43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69be82ee252e4c4db56b47848652b078'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:28.267092 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-89c2e324-46d2-4797-853b-1fbc48d29a43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69be82ee252e4c4db56b47848652b078'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:28.277919 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-89c2e324-46d2-4797-853b-1fbc48d29a43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69be82ee252e4c4db56b47848652b078'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:28.287951 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1173/2350] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:42:28 2022] DELETE /identity/v3/users/69be82ee252e4c4db56b47848652b078 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:28.292500 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982005ed-1b54-4118-9bdd-c3cec861ff89 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:28.293440 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982005ed-1b54-4118-9bdd-c3cec861ff89 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:28.293913 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982005ed-1b54-4118-9bdd-c3cec861ff89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:28.317969 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-982005ed-1b54-4118-9bdd-c3cec861ff89 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:28.319349 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-982005ed-1b54-4118-9bdd-c3cec861ff89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:28.398683 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1178/2351] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:42:28.408515 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2e324-46d2-4797-853b-1fbc48d29a43 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:28.410057 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-89c2e324-46d2-4797-853b-1fbc48d29a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:28.468355 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2e324-46d2-4797-853b-1fbc48d29a43 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:28.473467 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979a7d6-95da-42bd-a76a-76876bc72fa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:28.474169 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979a7d6-95da-42bd-a76a-76876bc72fa5 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:28.474455 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979a7d6-95da-42bd-a76a-76876bc72fa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:28.474730 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979a7d6-95da-42bd-a76a-76876bc72fa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:28.484084 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979a7d6-95da-42bd-a76a-76876bc72fa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:28.486086 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979a7d6-95da-42bd-a76a-76876bc72fa5 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:28.496041 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1174/2352] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:42:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:42:28.784838 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982005ed-1b54-4118-9bdd-c3cec861ff89 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:28.786449 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-982005ed-1b54-4118-9bdd-c3cec861ff89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:28.809130 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982005ed-1b54-4118-9bdd-c3cec861ff89 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:28.826343 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e0584-7707-44d7-b662-532d23ddb507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:28.827279 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e0584-7707-44d7-b662-532d23ddb507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:28.827564 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e0584-7707-44d7-b662-532d23ddb507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:28.827896 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e0584-7707-44d7-b662-532d23ddb507 admin admin] PATH_INFO: `/v3/projects/f240d1b5a8a14d7eb05b68dfa029bf79` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:28.829556 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e0584-7707-44d7-b662-532d23ddb507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f240d1b5a8a14d7eb05b68dfa029bf79)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:28.832823 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e0584-7707-44d7-b662-532d23ddb507 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:28.914655 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-206e0584-7707-44d7-b662-532d23ddb507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f240d1b5a8a14d7eb05b68dfa029bf79', 'request_id': 'req-206e0584-7707-44d7-b662-532d23ddb507'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:28.926863 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-206e0584-7707-44d7-b662-532d23ddb507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f240d1b5a8a14d7eb05b68dfa029bf79', 'request_id': 'req-206e0584-7707-44d7-b662-532d23ddb507'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:28.939742 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-206e0584-7707-44d7-b662-532d23ddb507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f240d1b5a8a14d7eb05b68dfa029bf79', 'request_id': 'req-206e0584-7707-44d7-b662-532d23ddb507'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:28.960192 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-206e0584-7707-44d7-b662-532d23ddb507 admin admin] The token cache is being invalidate because project f240d1b5a8a14d7eb05b68dfa029bf79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:42:28.960192 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-206e0584-7707-44d7-b662-532d23ddb507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:28.960625 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-206e0584-7707-44d7-b662-532d23ddb507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:28.962403 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1179/2353] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:42:28 2022] DELETE /identity/v3/projects/f240d1b5a8a14d7eb05b68dfa029bf79 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:45.899693 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91ce8b-89b4-452f-8c4f-66efc1cbe392 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:45.900230 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91ce8b-89b4-452f-8c4f-66efc1cbe392 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:45.900230 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91ce8b-89b4-452f-8c4f-66efc1cbe392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:45.929942 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-4c91ce8b-89b4-452f-8c4f-66efc1cbe392 None None] MFA Rules not processed for user `f97812ad784a49bb93ab0ec91d8edd65`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:45.931217 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-4c91ce8b-89b4-452f-8c4f-66efc1cbe392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:46.002918 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1175/2354] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:42:57.565133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e0584-7707-44d7-b662-532d23ddb507 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:57.566618 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-206e0584-7707-44d7-b662-532d23ddb507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:57.680187 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e0584-7707-44d7-b662-532d23ddb507 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:57.684788 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ff031-289f-4890-9abe-a5d10f4071d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:57.685679 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ff031-289f-4890-9abe-a5d10f4071d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:57.685956 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ff031-289f-4890-9abe-a5d10f4071d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:57.686225 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ff031-289f-4890-9abe-a5d10f4071d5 admin admin] PATH_INFO: `/v3/users/b8ba85bb93ec4775a28fc8a73c585c3a` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:57.688011 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ff031-289f-4890-9abe-a5d10f4071d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8ba85bb93ec4775a28fc8a73c585c3a)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:57.689981 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ff031-289f-4890-9abe-a5d10f4071d5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:57.733389 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2f7ff031-289f-4890-9abe-a5d10f4071d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8ba85bb93ec4775a28fc8a73c585c3a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:57.741568 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2f7ff031-289f-4890-9abe-a5d10f4071d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8ba85bb93ec4775a28fc8a73c585c3a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:57.742309 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2f7ff031-289f-4890-9abe-a5d10f4071d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8ba85bb93ec4775a28fc8a73c585c3a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:57.755728 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2f7ff031-289f-4890-9abe-a5d10f4071d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8ba85bb93ec4775a28fc8a73c585c3a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:57.764584 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2f7ff031-289f-4890-9abe-a5d10f4071d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8ba85bb93ec4775a28fc8a73c585c3a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:57.775653 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1180/2355] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:42:57 2022] DELETE /identity/v3/users/b8ba85bb93ec4775a28fc8a73c585c3a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:57.779827 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b15e1d-8bd3-4163-a5b8-139d64e1024a None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:57.780370 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b15e1d-8bd3-4163-a5b8-139d64e1024a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:57.780503 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b15e1d-8bd3-4163-a5b8-139d64e1024a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:57.810847 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-c8b15e1d-8bd3-4163-a5b8-139d64e1024a None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:57.812101 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-c8b15e1d-8bd3-4163-a5b8-139d64e1024a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:57.872432 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1176/2356] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:42:57.882311 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ff031-289f-4890-9abe-a5d10f4071d5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:57.883755 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2f7ff031-289f-4890-9abe-a5d10f4071d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:57.974604 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ff031-289f-4890-9abe-a5d10f4071d5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:57.978221 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdbf5b-aa47-43cd-b00d-f77736bc752b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:57.978862 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdbf5b-aa47-43cd-b00d-f77736bc752b service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:57.979145 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdbf5b-aa47-43cd-b00d-f77736bc752b service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:57.979425 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdbf5b-aa47-43cd-b00d-f77736bc752b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:57.988248 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdbf5b-aa47-43cd-b00d-f77736bc752b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:57.989661 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdbf5b-aa47-43cd-b00d-f77736bc752b service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:57.998785 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1181/2357] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:42:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:42:58.322818 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b15e1d-8bd3-4163-a5b8-139d64e1024a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:58.324344 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-c8b15e1d-8bd3-4163-a5b8-139d64e1024a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:58.336426 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b15e1d-8bd3-4163-a5b8-139d64e1024a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:58.343282 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609e712-4508-41d7-b609-591794cc7b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:58.344642 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609e712-4508-41d7-b609-591794cc7b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:58.344961 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609e712-4508-41d7-b609-591794cc7b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:58.345211 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609e712-4508-41d7-b609-591794cc7b8e admin admin] PATH_INFO: `/v3/projects/eb37fd7265554e5db56a9ff8ec53a786` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:58.346431 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609e712-4508-41d7-b609-591794cc7b8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb37fd7265554e5db56a9ff8ec53a786)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:58.358796 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609e712-4508-41d7-b609-591794cc7b8e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:58.419207 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-d609e712-4508-41d7-b609-591794cc7b8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb37fd7265554e5db56a9ff8ec53a786', 'request_id': 'req-d609e712-4508-41d7-b609-591794cc7b8e'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:58.427563 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-d609e712-4508-41d7-b609-591794cc7b8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb37fd7265554e5db56a9ff8ec53a786', 'request_id': 'req-d609e712-4508-41d7-b609-591794cc7b8e'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:58.433845 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-d609e712-4508-41d7-b609-591794cc7b8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb37fd7265554e5db56a9ff8ec53a786', 'request_id': 'req-d609e712-4508-41d7-b609-591794cc7b8e'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:58.444885 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-d609e712-4508-41d7-b609-591794cc7b8e admin admin] The token cache is being invalidate because project eb37fd7265554e5db56a9ff8ec53a786 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:42:58.445209 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-d609e712-4508-41d7-b609-591794cc7b8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:58.445847 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-d609e712-4508-41d7-b609-591794cc7b8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:42:58.447396 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1177/2358] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:42:58 2022] DELETE /identity/v3/projects/eb37fd7265554e5db56a9ff8ec53a786 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:58.454185 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154c93b-20f5-4da8-b05e-4e62bfe593a1 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:58.454484 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154c93b-20f5-4da8-b05e-4e62bfe593a1 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:58.454765 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154c93b-20f5-4da8-b05e-4e62bfe593a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:58.508311 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-0154c93b-20f5-4da8-b05e-4e62bfe593a1 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:58.509558 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0154c93b-20f5-4da8-b05e-4e62bfe593a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:58.588583 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1182/2359] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:42:58.596776 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9b5e3-1781-46c5-8e58-56208364e15a None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:58.597093 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9b5e3-1781-46c5-8e58-56208364e15a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:58.597372 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9b5e3-1781-46c5-8e58-56208364e15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:58.618273 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-34c9b5e3-1781-46c5-8e58-56208364e15a None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:58.619667 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-34c9b5e3-1781-46c5-8e58-56208364e15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:58.629996 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1178/2360] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:42:58.634331 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154c93b-20f5-4da8-b05e-4e62bfe593a1 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:58.645441 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154c93b-20f5-4da8-b05e-4e62bfe593a1 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:58.650541 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97382077-ac89-4077-9236-162513dee8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:58.651312 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97382077-ac89-4077-9236-162513dee8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:58.651657 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97382077-ac89-4077-9236-162513dee8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:58.652668 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97382077-ac89-4077-9236-162513dee8e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:58.652794 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97382077-ac89-4077-9236-162513dee8e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:42:58.653194 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97382077-ac89-4077-9236-162513dee8e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:58.655019 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97382077-ac89-4077-9236-162513dee8e5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:58.671936 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1183/2361] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:42:58.673229 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9b5e3-1781-46c5-8e58-56208364e15a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:58.683479 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9b5e3-1781-46c5-8e58-56208364e15a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:58.687814 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7b92c-fa7b-4c79-bd8f-80484c16cf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:58.688499 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7b92c-fa7b-4c79-bd8f-80484c16cf73 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:58.688826 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7b92c-fa7b-4c79-bd8f-80484c16cf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:58.689132 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7b92c-fa7b-4c79-bd8f-80484c16cf73 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:58.689935 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7b92c-fa7b-4c79-bd8f-80484c16cf73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:58.691787 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7b92c-fa7b-4c79-bd8f-80484c16cf73 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:58.724079 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1179/2362] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:42:58 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:42:58.725523 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97382077-ac89-4077-9236-162513dee8e5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:58.739478 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97382077-ac89-4077-9236-162513dee8e5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:58.797142 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23ad7f-896e-4a1d-a4a8-d79bff5134d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:58.797807 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23ad7f-896e-4a1d-a4a8-d79bff5134d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:58.798088 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23ad7f-896e-4a1d-a4a8-d79bff5134d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:58.798364 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23ad7f-896e-4a1d-a4a8-d79bff5134d8 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:58.799074 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23ad7f-896e-4a1d-a4a8-d79bff5134d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:58.801072 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23ad7f-896e-4a1d-a4a8-d79bff5134d8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:58.819838 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1184/2363] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:42:58 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:42:58.824008 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7b92c-fa7b-4c79-bd8f-80484c16cf73 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:58.834951 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7b92c-fa7b-4c79-bd8f-80484c16cf73 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:58.839875 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07559823-358e-493e-b753-56d5308c367a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:58.840527 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07559823-358e-493e-b753-56d5308c367a admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:58.840805 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07559823-358e-493e-b753-56d5308c367a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:58.841105 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07559823-358e-493e-b753-56d5308c367a admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:58.841865 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07559823-358e-493e-b753-56d5308c367a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:58.843763 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07559823-358e-493e-b753-56d5308c367a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:58.856913 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1180/2364] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:42:58.858109 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23ad7f-896e-4a1d-a4a8-d79bff5134d8 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:58.868023 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23ad7f-896e-4a1d-a4a8-d79bff5134d8 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:58.876213 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c5214-1f87-45fc-915a-0bf2a4a17e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:58.877265 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c5214-1f87-45fc-915a-0bf2a4a17e6f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:58.877711 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c5214-1f87-45fc-915a-0bf2a4a17e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:58.878153 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c5214-1f87-45fc-915a-0bf2a4a17e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:58.879389 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c5214-1f87-45fc-915a-0bf2a4a17e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:58.881593 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c5214-1f87-45fc-915a-0bf2a4a17e6f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:58.892227 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1185/2365] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:42:58.896405 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07559823-358e-493e-b753-56d5308c367a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:58.906652 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07559823-358e-493e-b753-56d5308c367a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:58.911588 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67d8da-07ef-4ea6-8cb3-6447af72d1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:58.912457 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67d8da-07ef-4ea6-8cb3-6447af72d1c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:58.912734 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67d8da-07ef-4ea6-8cb3-6447af72d1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:58.913020 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a67d8da-07ef-4ea6-8cb3-6447af72d1c1 admin admin] PATH_INFO: `/v3/projects/f7cafc3f57fd4a7c88a12a997beae8be/users/48e475a79c524d6d9829c148bdec7d08/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:58.927050 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67d8da-07ef-4ea6-8cb3-6447af72d1c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7cafc3f57fd4a7c88a12a997beae8be, user_id=48e475a79c524d6d9829c148bdec7d08, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:58.929708 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a67d8da-07ef-4ea6-8cb3-6447af72d1c1 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:58.943389 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1181/2366] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:42:58 2022] PUT /identity/v3/projects/f7cafc3f57fd4a7c88a12a997beae8be/users/48e475a79c524d6d9829c148bdec7d08/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:42:58.948149 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32632e4-b23c-439f-8690-bc067f222586 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:58.948506 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32632e4-b23c-439f-8690-bc067f222586 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:58.948783 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32632e4-b23c-439f-8690-bc067f222586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:58.966552 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-f32632e4-b23c-439f-8690-bc067f222586 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:42:58.967798 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f32632e4-b23c-439f-8690-bc067f222586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:59.028161 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1186/2367] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:42:59.038188 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67d8da-07ef-4ea6-8cb3-6447af72d1c1 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:42:59.040032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-8a67d8da-07ef-4ea6-8cb3-6447af72d1c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:42:59.099513 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a67d8da-07ef-4ea6-8cb3-6447af72d1c1 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:42:59.104477 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a825247-2852-4567-bd62-c5a3f9bdfcd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:42:59.105156 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a825247-2852-4567-bd62-c5a3f9bdfcd1 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:42:59.105631 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a825247-2852-4567-bd62-c5a3f9bdfcd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:42:59.105907 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a825247-2852-4567-bd62-c5a3f9bdfcd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:42:59.116516 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a825247-2852-4567-bd62-c5a3f9bdfcd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:42:59.118117 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a825247-2852-4567-bd62-c5a3f9bdfcd1 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:42:59.128271 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1182/2368] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:42:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:43:00.173885 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cfb82-132e-4cf4-bbaf-be925f7d1dee None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:00.174472 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cfb82-132e-4cf4-bbaf-be925f7d1dee None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:00.174697 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65cfb82-132e-4cf4-bbaf-be925f7d1dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:00.203408 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d65cfb82-132e-4cf4-bbaf-be925f7d1dee None None] MFA Rules not processed for user `48e475a79c524d6d9829c148bdec7d08`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:43:00.204632 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d65cfb82-132e-4cf4-bbaf-be925f7d1dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:00.282122 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1187/2369] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:43:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:43:00.291640 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a825247-2852-4567-bd62-c5a3f9bdfcd1 service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:00.293109 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-4a825247-2852-4567-bd62-c5a3f9bdfcd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:00.349329 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a825247-2852-4567-bd62-c5a3f9bdfcd1 service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:00.352964 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c5579-7019-4efa-b39a-ca8a7fb1124e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:00.353627 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c5579-7019-4efa-b39a-ca8a7fb1124e service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:00.353907 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c5579-7019-4efa-b39a-ca8a7fb1124e service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:00.354179 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c5579-7019-4efa-b39a-ca8a7fb1124e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:00.363444 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c5579-7019-4efa-b39a-ca8a7fb1124e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:00.364963 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c5579-7019-4efa-b39a-ca8a7fb1124e service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:00.373994 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1183/2370] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:43:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:43:01.691478 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399fc1e-8622-4b5b-856a-cdb47349dd5a None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:01.691999 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399fc1e-8622-4b5b-856a-cdb47349dd5a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:01.692109 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399fc1e-8622-4b5b-856a-cdb47349dd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:01.710017 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-b399fc1e-8622-4b5b-856a-cdb47349dd5a None None] MFA Rules not processed for user `48e475a79c524d6d9829c148bdec7d08`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:43:01.711213 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b399fc1e-8622-4b5b-856a-cdb47349dd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:01.719337 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1188/2371] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:43:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:43:14.102481 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d5c3e-1bc0-431a-aa2e-8747a9dd9489 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:14.103004 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d5c3e-1bc0-431a-aa2e-8747a9dd9489 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:14.103004 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d5c3e-1bc0-431a-aa2e-8747a9dd9489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:14.140414 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-af4d5c3e-1bc0-431a-aa2e-8747a9dd9489 None None] MFA Rules not processed for user `98a27dbe620c4aff967363a7d48c46e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:43:14.141696 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-af4d5c3e-1bc0-431a-aa2e-8747a9dd9489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:14.202608 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1184/2372] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Feb 9 04:43:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:43:14.245045 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399fc1e-8622-4b5b-856a-cdb47349dd5a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:14.246459 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b399fc1e-8622-4b5b-856a-cdb47349dd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:14.319237 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399fc1e-8622-4b5b-856a-cdb47349dd5a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:14.324986 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96168e-b678-43c2-8ef0-4e9d4d69abd5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66fd482451f743cdb692677e57508764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:14.325673 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96168e-b678-43c2-8ef0-4e9d4d69abd5 service swift] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:14.325960 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96168e-b678-43c2-8ef0-4e9d4d69abd5 service swift] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:14.326261 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96168e-b678-43c2-8ef0-4e9d4d69abd5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:14.335399 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96168e-b678-43c2-8ef0-4e9d4d69abd5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:14.336989 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96168e-b678-43c2-8ef0-4e9d4d69abd5 service swift] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:14.346232 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1189/2373] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Feb 9 04:43:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:43:14.350263 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d3da1-fb8b-448b-869b-64495451fe5e None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:14.350622 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d3da1-fb8b-448b-869b-64495451fe5e None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:14.350866 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d3da1-fb8b-448b-869b-64495451fe5e None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:14.352744 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1185/2374] 10.222.0.36 () {54 vars in 960 bytes} [Wed Feb 9 04:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:43:14.358070 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06420287-68dc-44f8-81c4-0e4902dbfd58 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:14.358234 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06420287-68dc-44f8-81c4-0e4902dbfd58 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:14.358512 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06420287-68dc-44f8-81c4-0e4902dbfd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:14.423314 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-06420287-68dc-44f8-81c4-0e4902dbfd58 None None] MFA Rules not processed for user `add56fc0cfd8403b86c5ef23fd374a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:43:14.425262 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-06420287-68dc-44f8-81c4-0e4902dbfd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:14.505810 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1190/2375] 10.222.0.36 () {58 vars in 1057 bytes} [Wed Feb 9 04:43:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:43:14.515195 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d3da1-fb8b-448b-869b-64495451fe5e None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:14.532181 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d3da1-fb8b-448b-869b-64495451fe5e None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:14.538666 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b5c7b-db5e-487f-a74c-18d5e7a74094 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add56fc0cfd8403b86c5ef23fd374a5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:14.539476 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b5c7b-db5e-487f-a74c-18d5e7a74094 service placement] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:14.540079 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b5c7b-db5e-487f-a74c-18d5e7a74094 service placement] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:14.540363 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b5c7b-db5e-487f-a74c-18d5e7a74094 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:14.542681 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-ee7b5c7b-db5e-487f-a74c-18d5e7a74094 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:14.564146 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b5c7b-db5e-487f-a74c-18d5e7a74094 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:14.566467 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b5c7b-db5e-487f-a74c-18d5e7a74094 service placement] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:14.600844 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1186/2376] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:43:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:43:28.857842 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06420287-68dc-44f8-81c4-0e4902dbfd58 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:28.862811 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-06420287-68dc-44f8-81c4-0e4902dbfd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:28.885756 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06420287-68dc-44f8-81c4-0e4902dbfd58 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:28.892696 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d2624-e3f9-4d55-81fa-6be23797ef34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:28.893920 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d2624-e3f9-4d55-81fa-6be23797ef34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:28.894206 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d2624-e3f9-4d55-81fa-6be23797ef34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:28.895061 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d2624-e3f9-4d55-81fa-6be23797ef34 admin admin] PATH_INFO: `/v3/users/a7d55c38bc5e4545aa175151a75e9bfc` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:28.897838 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d2624-e3f9-4d55-81fa-6be23797ef34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7d55c38bc5e4545aa175151a75e9bfc)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:28.903827 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d2624-e3f9-4d55-81fa-6be23797ef34 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:28.978065 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e25d2624-e3f9-4d55-81fa-6be23797ef34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7d55c38bc5e4545aa175151a75e9bfc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:28.990791 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e25d2624-e3f9-4d55-81fa-6be23797ef34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7d55c38bc5e4545aa175151a75e9bfc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:28.992094 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e25d2624-e3f9-4d55-81fa-6be23797ef34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7d55c38bc5e4545aa175151a75e9bfc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:29.016898 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e25d2624-e3f9-4d55-81fa-6be23797ef34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7d55c38bc5e4545aa175151a75e9bfc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:29.026785 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e25d2624-e3f9-4d55-81fa-6be23797ef34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7d55c38bc5e4545aa175151a75e9bfc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:29.040463 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1191/2377] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:43:28 2022] DELETE /identity/v3/users/a7d55c38bc5e4545aa175151a75e9bfc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:43:29.463018 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b5c7b-db5e-487f-a74c-18d5e7a74094 service placement] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:29.503789 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b5c7b-db5e-487f-a74c-18d5e7a74094 service placement] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:29.619063 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e14c16-dc8b-4fdb-a917-de27307e5748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:29.620017 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e14c16-dc8b-4fdb-a917-de27307e5748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:29.620366 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e14c16-dc8b-4fdb-a917-de27307e5748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:29.620705 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e14c16-dc8b-4fdb-a917-de27307e5748 admin admin] PATH_INFO: `/v3/projects/0c50afe9853e428f82ee884dc82b5cfe` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:29.622029 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e14c16-dc8b-4fdb-a917-de27307e5748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c50afe9853e428f82ee884dc82b5cfe)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:29.624046 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e14c16-dc8b-4fdb-a917-de27307e5748 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:29.681135 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-86e14c16-dc8b-4fdb-a917-de27307e5748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c50afe9853e428f82ee884dc82b5cfe', 'request_id': 'req-86e14c16-dc8b-4fdb-a917-de27307e5748'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:29.690779 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-86e14c16-dc8b-4fdb-a917-de27307e5748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c50afe9853e428f82ee884dc82b5cfe', 'request_id': 'req-86e14c16-dc8b-4fdb-a917-de27307e5748'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:29.700795 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-86e14c16-dc8b-4fdb-a917-de27307e5748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c50afe9853e428f82ee884dc82b5cfe', 'request_id': 'req-86e14c16-dc8b-4fdb-a917-de27307e5748'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:29.715139 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-86e14c16-dc8b-4fdb-a917-de27307e5748 admin admin] The token cache is being invalidate because project 0c50afe9853e428f82ee884dc82b5cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:43:29.715463 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-86e14c16-dc8b-4fdb-a917-de27307e5748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:29.716216 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-86e14c16-dc8b-4fdb-a917-de27307e5748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:29.718022 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1187/2378] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:43:29 2022] DELETE /identity/v3/projects/0c50afe9853e428f82ee884dc82b5cfe => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:43:29.724621 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf3617-2822-4471-8761-0fe75f52ae3c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:29.725674 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf3617-2822-4471-8761-0fe75f52ae3c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:29.726179 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf3617-2822-4471-8761-0fe75f52ae3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:29.760191 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-0ebf3617-2822-4471-8761-0fe75f52ae3c None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:43:29.761677 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0ebf3617-2822-4471-8761-0fe75f52ae3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:29.857051 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1192/2379] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:43:29.868417 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5bad9-0270-46fa-8a24-7f038a9d5a9a None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:29.869066 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5bad9-0270-46fa-8a24-7f038a9d5a9a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:29.869767 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5bad9-0270-46fa-8a24-7f038a9d5a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:29.908020 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-26b5bad9-0270-46fa-8a24-7f038a9d5a9a None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:43:29.910930 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-26b5bad9-0270-46fa-8a24-7f038a9d5a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:29.938967 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf3617-2822-4471-8761-0fe75f52ae3c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:29.948668 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1188/2380] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:43:29.953853 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf3617-2822-4471-8761-0fe75f52ae3c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:29.961845 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e0187-2f9b-4919-84c1-923f4ed90c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:29.962931 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e0187-2f9b-4919-84c1-923f4ed90c31 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:29.963525 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e0187-2f9b-4919-84c1-923f4ed90c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:29.964504 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e0187-2f9b-4919-84c1-923f4ed90c31 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:29.966778 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e0187-2f9b-4919-84c1-923f4ed90c31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:43:29.967321 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e0187-2f9b-4919-84c1-923f4ed90c31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:29.975358 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e0187-2f9b-4919-84c1-923f4ed90c31 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:29.990020 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5bad9-0270-46fa-8a24-7f038a9d5a9a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:29.991478 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-26b5bad9-0270-46fa-8a24-7f038a9d5a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:30.007171 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1193/2381] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:43:30.009400 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e0187-2f9b-4919-84c1-923f4ed90c31 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:30.011619 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5bad9-0270-46fa-8a24-7f038a9d5a9a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:30.024404 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bdc39-3e3f-4501-b57a-73a2132cd8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:30.025571 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bdc39-3e3f-4501-b57a-73a2132cd8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:30.025862 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bdc39-3e3f-4501-b57a-73a2132cd8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:30.026354 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bdc39-3e3f-4501-b57a-73a2132cd8e7 admin admin] PATH_INFO: `/v3/users/b46db588a5ee4272a0ebdc24c4f5dab7` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:30.027289 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e0187-2f9b-4919-84c1-923f4ed90c31 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:30.027978 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bdc39-3e3f-4501-b57a-73a2132cd8e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b46db588a5ee4272a0ebdc24c4f5dab7)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:30.030663 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bdc39-3e3f-4501-b57a-73a2132cd8e7 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:30.036756 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cf322-c83d-4385-9da4-9ef495da67f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:30.038167 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cf322-c83d-4385-9da4-9ef495da67f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:30.038495 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cf322-c83d-4385-9da4-9ef495da67f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:30.039088 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cf322-c83d-4385-9da4-9ef495da67f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:30.040033 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cf322-c83d-4385-9da4-9ef495da67f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:30.042279 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cf322-c83d-4385-9da4-9ef495da67f4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:30.095040 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1194/2382] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:43:30 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:43:30.099163 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cf322-c83d-4385-9da4-9ef495da67f4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:30.117495 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-809bdc39-3e3f-4501-b57a-73a2132cd8e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b46db588a5ee4272a0ebdc24c4f5dab7'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:30.131182 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-809bdc39-3e3f-4501-b57a-73a2132cd8e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b46db588a5ee4272a0ebdc24c4f5dab7'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:30.132063 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-809bdc39-3e3f-4501-b57a-73a2132cd8e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b46db588a5ee4272a0ebdc24c4f5dab7'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:30.173868 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-809bdc39-3e3f-4501-b57a-73a2132cd8e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b46db588a5ee4272a0ebdc24c4f5dab7'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:30.192400 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-809bdc39-3e3f-4501-b57a-73a2132cd8e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b46db588a5ee4272a0ebdc24c4f5dab7'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:30.206982 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1189/2383] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:43:29 2022] DELETE /identity/v3/users/b46db588a5ee4272a0ebdc24c4f5dab7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:43:30.212033 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cf322-c83d-4385-9da4-9ef495da67f4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:30.314591 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9016bbe-d4ec-48e5-b6e0-55a0a091ca75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:30.315370 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9016bbe-d4ec-48e5-b6e0-55a0a091ca75 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:30.315658 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9016bbe-d4ec-48e5-b6e0-55a0a091ca75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:30.315938 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9016bbe-d4ec-48e5-b6e0-55a0a091ca75 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:30.316740 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9016bbe-d4ec-48e5-b6e0-55a0a091ca75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:30.318843 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9016bbe-d4ec-48e5-b6e0-55a0a091ca75 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:30.346602 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1195/2384] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:43:30 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:43:30.349940 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bdc39-3e3f-4501-b57a-73a2132cd8e7 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:30.351344 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-809bdc39-3e3f-4501-b57a-73a2132cd8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:30.369702 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bdc39-3e3f-4501-b57a-73a2132cd8e7 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:30.377566 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4bcc1-7671-41f2-95d2-0d30b4908b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:30.378289 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4bcc1-7671-41f2-95d2-0d30b4908b76 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:30.378676 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4bcc1-7671-41f2-95d2-0d30b4908b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:30.378959 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4bcc1-7671-41f2-95d2-0d30b4908b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:30.381917 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4bcc1-7671-41f2-95d2-0d30b4908b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:30.384215 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4bcc1-7671-41f2-95d2-0d30b4908b76 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:30.402333 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1190/2385] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:43:30.403184 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9016bbe-d4ec-48e5-b6e0-55a0a091ca75 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:30.434938 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9016bbe-d4ec-48e5-b6e0-55a0a091ca75 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:30.456575 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfecb6c-8c47-45ab-a450-251b3badebff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:30.457346 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfecb6c-8c47-45ab-a450-251b3badebff admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:30.457629 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfecb6c-8c47-45ab-a450-251b3badebff admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:30.457902 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfecb6c-8c47-45ab-a450-251b3badebff admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:30.458649 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfecb6c-8c47-45ab-a450-251b3badebff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:30.460362 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfecb6c-8c47-45ab-a450-251b3badebff admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:30.473368 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1196/2386] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:43:30.477867 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4bcc1-7671-41f2-95d2-0d30b4908b76 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:30.492828 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfecb6c-8c47-45ab-a450-251b3badebff admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:30.494718 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9dfecb6c-8c47-45ab-a450-251b3badebff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:30.496343 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4bcc1-7671-41f2-95d2-0d30b4908b76 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:30.514233 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a478756-97da-4b09-af9f-6be80e4b2247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:30.515386 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a478756-97da-4b09-af9f-6be80e4b2247 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:30.516501 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a478756-97da-4b09-af9f-6be80e4b2247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:30.516921 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a478756-97da-4b09-af9f-6be80e4b2247 admin admin] PATH_INFO: `/v3/projects/2f5d73f1493f4b3eac37417338fe00d6/users/cfbb2d64bbae4df1a86a73bf84d4f84d/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:30.520093 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfecb6c-8c47-45ab-a450-251b3badebff admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:30.526986 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1df38-f734-4c88-bcdc-e154dc5bcb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:30.527859 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1df38-f734-4c88-bcdc-e154dc5bcb3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:30.528145 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1df38-f734-4c88-bcdc-e154dc5bcb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:30.528422 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1df38-f734-4c88-bcdc-e154dc5bcb3c admin admin] PATH_INFO: `/v3/projects/fe0573397e33469080b13d72e5da7438` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:30.529684 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1df38-f734-4c88-bcdc-e154dc5bcb3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe0573397e33469080b13d72e5da7438)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:30.533445 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1df38-f734-4c88-bcdc-e154dc5bcb3c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:30.545316 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a478756-97da-4b09-af9f-6be80e4b2247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5d73f1493f4b3eac37417338fe00d6, user_id=cfbb2d64bbae4df1a86a73bf84d4f84d, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:30.555313 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a478756-97da-4b09-af9f-6be80e4b2247 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:30.596481 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1191/2387] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:43:30 2022] PUT /identity/v3/projects/2f5d73f1493f4b3eac37417338fe00d6/users/cfbb2d64bbae4df1a86a73bf84d4f84d/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:43:30.615231 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae32e1-1979-4fa6-a4fb-bb9c2a4719e5 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:30.615231 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae32e1-1979-4fa6-a4fb-bb9c2a4719e5 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:30.615231 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae32e1-1979-4fa6-a4fb-bb9c2a4719e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:30.626788 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2cd1df38-f734-4c88-bcdc-e154dc5bcb3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe0573397e33469080b13d72e5da7438', 'request_id': 'req-2cd1df38-f734-4c88-bcdc-e154dc5bcb3c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:30.634330 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2cd1df38-f734-4c88-bcdc-e154dc5bcb3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe0573397e33469080b13d72e5da7438', 'request_id': 'req-2cd1df38-f734-4c88-bcdc-e154dc5bcb3c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:30.643460 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2cd1df38-f734-4c88-bcdc-e154dc5bcb3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe0573397e33469080b13d72e5da7438', 'request_id': 'req-2cd1df38-f734-4c88-bcdc-e154dc5bcb3c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:30.650818 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-86ae32e1-1979-4fa6-a4fb-bb9c2a4719e5 None None] MFA Rules not processed for user `cfbb2d64bbae4df1a86a73bf84d4f84d`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:43:30.652070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-86ae32e1-1979-4fa6-a4fb-bb9c2a4719e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:30.662874 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2cd1df38-f734-4c88-bcdc-e154dc5bcb3c admin admin] The token cache is being invalidate because project fe0573397e33469080b13d72e5da7438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:43:30.663174 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2cd1df38-f734-4c88-bcdc-e154dc5bcb3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:30.664147 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2cd1df38-f734-4c88-bcdc-e154dc5bcb3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:30.671059 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1197/2388] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:43:30 2022] DELETE /identity/v3/projects/fe0573397e33469080b13d72e5da7438 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:43:30.674366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b99c18-327b-4faa-a906-fcc840161ed2 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:30.674784 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b99c18-327b-4faa-a906-fcc840161ed2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:30.675240 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b99c18-327b-4faa-a906-fcc840161ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:30.699331 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-66b99c18-327b-4faa-a906-fcc840161ed2 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:43:30.700730 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-66b99c18-327b-4faa-a906-fcc840161ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:30.766104 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1192/2389] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:43:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:43:30.769906 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1198/2390] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:43:30.777909 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e809f-9e3b-4dc3-a987-8f4737c53014 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:30.778208 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e809f-9e3b-4dc3-a987-8f4737c53014 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:30.778495 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e809f-9e3b-4dc3-a987-8f4737c53014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:30.779298 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b99c18-327b-4faa-a906-fcc840161ed2 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:30.781147 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-66b99c18-327b-4faa-a906-fcc840161ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:30.798775 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-cb5e809f-9e3b-4dc3-a987-8f4737c53014 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:43:30.799972 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-cb5e809f-9e3b-4dc3-a987-8f4737c53014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:30.811621 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1193/2391] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:43:30.813259 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e809f-9e3b-4dc3-a987-8f4737c53014 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:30.822710 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e809f-9e3b-4dc3-a987-8f4737c53014 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:30.839424 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dcc25-0cbd-453a-9392-6dd147028481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:30.840199 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dcc25-0cbd-453a-9392-6dd147028481 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:30.840670 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dcc25-0cbd-453a-9392-6dd147028481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:30.840826 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720dcc25-0cbd-453a-9392-6dd147028481 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:30.841906 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dcc25-0cbd-453a-9392-6dd147028481 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:43:30.842222 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dcc25-0cbd-453a-9392-6dd147028481 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:30.846450 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720dcc25-0cbd-453a-9392-6dd147028481 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:30.865101 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1194/2392] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:43:30.865829 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dcc25-0cbd-453a-9392-6dd147028481 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:30.876033 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720dcc25-0cbd-453a-9392-6dd147028481 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:30.881954 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f17934-66db-45b1-aa9e-ea2381853a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:30.882509 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f17934-66db-45b1-aa9e-ea2381853a39 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:30.883155 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f17934-66db-45b1-aa9e-ea2381853a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:30.883535 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f17934-66db-45b1-aa9e-ea2381853a39 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:30.885243 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f17934-66db-45b1-aa9e-ea2381853a39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:30.887573 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f17934-66db-45b1-aa9e-ea2381853a39 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:30.899690 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b99c18-327b-4faa-a906-fcc840161ed2 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:30.913294 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd10502-7d5b-47dd-aab8-29dd18dbeb41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:30.915120 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd10502-7d5b-47dd-aab8-29dd18dbeb41 service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:30.915629 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd10502-7d5b-47dd-aab8-29dd18dbeb41 service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:30.915757 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd10502-7d5b-47dd-aab8-29dd18dbeb41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:30.925714 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd10502-7d5b-47dd-aab8-29dd18dbeb41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:30.927261 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd10502-7d5b-47dd-aab8-29dd18dbeb41 service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:30.929434 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1195/2393] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:43:30 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:43:30.933174 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f17934-66db-45b1-aa9e-ea2381853a39 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:30.942042 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1199/2394] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:43:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:43:31.021485 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f17934-66db-45b1-aa9e-ea2381853a39 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:31.026879 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474efb2-dfc7-4031-8dfb-12cd666a4a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:31.027622 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474efb2-dfc7-4031-8dfb-12cd666a4a9b admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:31.028000 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474efb2-dfc7-4031-8dfb-12cd666a4a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:31.028579 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474efb2-dfc7-4031-8dfb-12cd666a4a9b admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:31.029200 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474efb2-dfc7-4031-8dfb-12cd666a4a9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:31.031867 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474efb2-dfc7-4031-8dfb-12cd666a4a9b admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:31.057601 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1196/2395] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:43:30 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:43:31.061834 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd10502-7d5b-47dd-aab8-29dd18dbeb41 service nova] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:31.076390 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd10502-7d5b-47dd-aab8-29dd18dbeb41 service nova] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:31.084254 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f62f0d-4033-48ff-a9c5-5e02105243b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:31.085461 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f62f0d-4033-48ff-a9c5-5e02105243b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:31.086293 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f62f0d-4033-48ff-a9c5-5e02105243b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:31.086293 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f62f0d-4033-48ff-a9c5-5e02105243b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:31.087476 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f62f0d-4033-48ff-a9c5-5e02105243b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:31.090297 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f62f0d-4033-48ff-a9c5-5e02105243b5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:31.107641 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1200/2396] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:43:31.113451 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474efb2-dfc7-4031-8dfb-12cd666a4a9b admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:31.129769 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474efb2-dfc7-4031-8dfb-12cd666a4a9b admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:31.138744 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62304bfd-5fda-4403-9b98-49a3e73f03a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:31.139938 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62304bfd-5fda-4403-9b98-49a3e73f03a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:31.140584 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62304bfd-5fda-4403-9b98-49a3e73f03a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:31.141249 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62304bfd-5fda-4403-9b98-49a3e73f03a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:31.142443 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62304bfd-5fda-4403-9b98-49a3e73f03a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:31.144315 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62304bfd-5fda-4403-9b98-49a3e73f03a2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:31.157231 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1197/2397] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:43:31.161293 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f62f0d-4033-48ff-a9c5-5e02105243b5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:31.173497 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f62f0d-4033-48ff-a9c5-5e02105243b5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:31.179333 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cdd6a-4e7b-4a54-9cb6-9495570c75a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:31.180231 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cdd6a-4e7b-4a54-9cb6-9495570c75a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:31.180519 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cdd6a-4e7b-4a54-9cb6-9495570c75a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:31.180914 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cdd6a-4e7b-4a54-9cb6-9495570c75a7 admin admin] PATH_INFO: `/v3/projects/a7827bdc153a44a7a8118faf7ae0b02a/users/2c03733c29e44e72b3c90def97071b0a/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:31.203547 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cdd6a-4e7b-4a54-9cb6-9495570c75a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7827bdc153a44a7a8118faf7ae0b02a, user_id=2c03733c29e44e72b3c90def97071b0a, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:31.207725 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cdd6a-4e7b-4a54-9cb6-9495570c75a7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:31.226703 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1201/2398] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:43:31 2022] PUT /identity/v3/projects/a7827bdc153a44a7a8118faf7ae0b02a/users/2c03733c29e44e72b3c90def97071b0a/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:43:31.231934 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a749c-e0a5-47f1-89fb-4a3a88fec50c None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:31.232233 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a749c-e0a5-47f1-89fb-4a3a88fec50c None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:31.232517 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a749c-e0a5-47f1-89fb-4a3a88fec50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:31.268639 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-2c1a749c-e0a5-47f1-89fb-4a3a88fec50c None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:43:31.270864 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-2c1a749c-e0a5-47f1-89fb-4a3a88fec50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:31.370657 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1198/2399] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:43:31.383656 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cdd6a-4e7b-4a54-9cb6-9495570c75a7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:31.385934 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-041cdd6a-4e7b-4a54-9cb6-9495570c75a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:31.450488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cdd6a-4e7b-4a54-9cb6-9495570c75a7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:31.454650 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d6f08-cb84-418d-9ca9-0e7c36e34a57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:31.455286 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d6f08-cb84-418d-9ca9-0e7c36e34a57 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:31.455566 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d6f08-cb84-418d-9ca9-0e7c36e34a57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:31.455838 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d6f08-cb84-418d-9ca9-0e7c36e34a57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:31.464762 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d6f08-cb84-418d-9ca9-0e7c36e34a57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:31.466308 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872d6f08-cb84-418d-9ca9-0e7c36e34a57 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:31.477208 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1202/2400] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:43:33.897383 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a749c-e0a5-47f1-89fb-4a3a88fec50c None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:33.899795 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-2c1a749c-e0a5-47f1-89fb-4a3a88fec50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:33.915922 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a749c-e0a5-47f1-89fb-4a3a88fec50c None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:33.921971 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560e7e7-38ab-409f-b9cb-5ce93d01839a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:33.923114 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560e7e7-38ab-409f-b9cb-5ce93d01839a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:33.923558 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560e7e7-38ab-409f-b9cb-5ce93d01839a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:33.924004 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560e7e7-38ab-409f-b9cb-5ce93d01839a admin admin] PATH_INFO: `/v3/users/cfbb2d64bbae4df1a86a73bf84d4f84d` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:33.925520 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560e7e7-38ab-409f-b9cb-5ce93d01839a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfbb2d64bbae4df1a86a73bf84d4f84d)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:33.927642 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560e7e7-38ab-409f-b9cb-5ce93d01839a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:34.021704 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7560e7e7-38ab-409f-b9cb-5ce93d01839a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfbb2d64bbae4df1a86a73bf84d4f84d'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:34.036229 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7560e7e7-38ab-409f-b9cb-5ce93d01839a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfbb2d64bbae4df1a86a73bf84d4f84d'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:34.037768 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7560e7e7-38ab-409f-b9cb-5ce93d01839a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfbb2d64bbae4df1a86a73bf84d4f84d'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:34.076623 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7560e7e7-38ab-409f-b9cb-5ce93d01839a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfbb2d64bbae4df1a86a73bf84d4f84d'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:34.089444 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7560e7e7-38ab-409f-b9cb-5ce93d01839a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfbb2d64bbae4df1a86a73bf84d4f84d'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:34.099203 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1199/2401] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:43:33 2022] DELETE /identity/v3/users/cfbb2d64bbae4df1a86a73bf84d4f84d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:43:34.106056 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cfd17-4236-46b7-8bef-7ebdd8273de4 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:34.106637 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cfd17-4236-46b7-8bef-7ebdd8273de4 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:34.106720 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cfd17-4236-46b7-8bef-7ebdd8273de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:34.137863 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d56cfd17-4236-46b7-8bef-7ebdd8273de4 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:43:34.139126 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d56cfd17-4236-46b7-8bef-7ebdd8273de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:34.264296 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1203/2402] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:43:34.275455 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560e7e7-38ab-409f-b9cb-5ce93d01839a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:34.278154 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7560e7e7-38ab-409f-b9cb-5ce93d01839a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:34.399728 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560e7e7-38ab-409f-b9cb-5ce93d01839a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:34.404071 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f13ebe-5a4c-4684-9f9a-660fdb181ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:34.405197 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f13ebe-5a4c-4684-9f9a-660fdb181ced service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:34.405953 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f13ebe-5a4c-4684-9f9a-660fdb181ced service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:34.406476 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f13ebe-5a4c-4684-9f9a-660fdb181ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:34.417841 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f13ebe-5a4c-4684-9f9a-660fdb181ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:34.426721 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f13ebe-5a4c-4684-9f9a-660fdb181ced service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:34.445398 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1200/2403] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:43:34.852265 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cfd17-4236-46b7-8bef-7ebdd8273de4 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:34.854050 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d56cfd17-4236-46b7-8bef-7ebdd8273de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:34.880901 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cfd17-4236-46b7-8bef-7ebdd8273de4 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:34.908659 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b5e17-6106-4b6c-80e0-a41cb903ee7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:34.911357 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b5e17-6106-4b6c-80e0-a41cb903ee7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:34.911652 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b5e17-6106-4b6c-80e0-a41cb903ee7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:34.911937 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b5e17-6106-4b6c-80e0-a41cb903ee7e admin admin] PATH_INFO: `/v3/projects/2f5d73f1493f4b3eac37417338fe00d6` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:34.914932 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b5e17-6106-4b6c-80e0-a41cb903ee7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f5d73f1493f4b3eac37417338fe00d6)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:34.920622 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b5e17-6106-4b6c-80e0-a41cb903ee7e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:35.037851 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-207b5e17-6106-4b6c-80e0-a41cb903ee7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f5d73f1493f4b3eac37417338fe00d6', 'request_id': 'req-207b5e17-6106-4b6c-80e0-a41cb903ee7e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:35.049212 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-207b5e17-6106-4b6c-80e0-a41cb903ee7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f5d73f1493f4b3eac37417338fe00d6', 'request_id': 'req-207b5e17-6106-4b6c-80e0-a41cb903ee7e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:35.064771 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-207b5e17-6106-4b6c-80e0-a41cb903ee7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f5d73f1493f4b3eac37417338fe00d6', 'request_id': 'req-207b5e17-6106-4b6c-80e0-a41cb903ee7e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:35.082806 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-207b5e17-6106-4b6c-80e0-a41cb903ee7e admin admin] The token cache is being invalidate because project 2f5d73f1493f4b3eac37417338fe00d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:43:35.083519 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-207b5e17-6106-4b6c-80e0-a41cb903ee7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:35.084379 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-207b5e17-6106-4b6c-80e0-a41cb903ee7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:35.086008 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1204/2404] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:43:34 2022] DELETE /identity/v3/projects/2f5d73f1493f4b3eac37417338fe00d6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:43:35.092059 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c6e69-ed7d-428b-a89d-800cbb7d6947 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:35.092591 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c6e69-ed7d-428b-a89d-800cbb7d6947 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:35.092756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c6e69-ed7d-428b-a89d-800cbb7d6947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:35.113444 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-e58c6e69-ed7d-428b-a89d-800cbb7d6947 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:43:35.114902 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-e58c6e69-ed7d-428b-a89d-800cbb7d6947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:35.220949 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1201/2405] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:43:35.228677 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9357626-a4aa-4dce-b411-e929edcfb798 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:35.229715 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9357626-a4aa-4dce-b411-e929edcfb798 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:35.230177 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9357626-a4aa-4dce-b411-e929edcfb798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:35.253123 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-c9357626-a4aa-4dce-b411-e929edcfb798 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:43:35.254598 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c9357626-a4aa-4dce-b411-e929edcfb798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:35.269895 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c6e69-ed7d-428b-a89d-800cbb7d6947 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:35.276913 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1205/2406] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:43:35.281416 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c6e69-ed7d-428b-a89d-800cbb7d6947 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:35.290127 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8412c1c-3b5b-47c1-8e55-92456e4d1402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:35.290127 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8412c1c-3b5b-47c1-8e55-92456e4d1402 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:35.290432 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8412c1c-3b5b-47c1-8e55-92456e4d1402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:35.290512 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8412c1c-3b5b-47c1-8e55-92456e4d1402 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:35.291984 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8412c1c-3b5b-47c1-8e55-92456e4d1402 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:43:35.292723 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8412c1c-3b5b-47c1-8e55-92456e4d1402 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:35.294472 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8412c1c-3b5b-47c1-8e55-92456e4d1402 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:35.324499 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1202/2407] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:43:35.325984 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9357626-a4aa-4dce-b411-e929edcfb798 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:35.338864 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9357626-a4aa-4dce-b411-e929edcfb798 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:35.347932 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef4416-2993-4592-8d78-d502c7ce66cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:35.349644 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef4416-2993-4592-8d78-d502c7ce66cd admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:35.350255 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef4416-2993-4592-8d78-d502c7ce66cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:35.350746 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef4416-2993-4592-8d78-d502c7ce66cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:35.352060 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef4416-2993-4592-8d78-d502c7ce66cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:35.354391 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef4416-2993-4592-8d78-d502c7ce66cd admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:35.407360 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1206/2408] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:43:35 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:43:35.413053 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8412c1c-3b5b-47c1-8e55-92456e4d1402 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:35.434645 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8412c1c-3b5b-47c1-8e55-92456e4d1402 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:35.577474 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa433d-39cd-46c7-80e5-1a88b4773580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:35.579629 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa433d-39cd-46c7-80e5-1a88b4773580 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:35.580387 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa433d-39cd-46c7-80e5-1a88b4773580 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:35.580945 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa433d-39cd-46c7-80e5-1a88b4773580 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:35.582381 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa433d-39cd-46c7-80e5-1a88b4773580 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:35.585243 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa433d-39cd-46c7-80e5-1a88b4773580 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:35.636645 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1203/2409] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:43:35 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:43:35.637918 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef4416-2993-4592-8d78-d502c7ce66cd admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:35.652829 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef4416-2993-4592-8d78-d502c7ce66cd admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:35.658190 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497c5c8-321d-4fff-8585-a091d9a067fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:35.658867 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497c5c8-321d-4fff-8585-a091d9a067fa admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:35.659291 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497c5c8-321d-4fff-8585-a091d9a067fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:35.659579 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497c5c8-321d-4fff-8585-a091d9a067fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:35.660331 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497c5c8-321d-4fff-8585-a091d9a067fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:35.661991 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0497c5c8-321d-4fff-8585-a091d9a067fa admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:35.679878 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1207/2410] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:43:35.682663 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa433d-39cd-46c7-80e5-1a88b4773580 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:35.706956 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa433d-39cd-46c7-80e5-1a88b4773580 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:35.718772 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777fd412-7e7d-4205-99d2-e551d97fcdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:35.719472 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fd412-7e7d-4205-99d2-e551d97fcdd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:35.719769 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fd412-7e7d-4205-99d2-e551d97fcdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:35.720182 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777fd412-7e7d-4205-99d2-e551d97fcdd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:35.721037 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777fd412-7e7d-4205-99d2-e551d97fcdd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:35.722730 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777fd412-7e7d-4205-99d2-e551d97fcdd2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:35.738701 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1204/2411] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:43:35.740418 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497c5c8-321d-4fff-8585-a091d9a067fa admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:35.753105 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0497c5c8-321d-4fff-8585-a091d9a067fa admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:35.765676 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33de54d-0adc-4c39-8e15-4737042b2a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:35.766586 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33de54d-0adc-4c39-8e15-4737042b2a59 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:35.766893 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33de54d-0adc-4c39-8e15-4737042b2a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:35.767150 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33de54d-0adc-4c39-8e15-4737042b2a59 admin admin] PATH_INFO: `/v3/projects/2112ed3eb7634c7189d0239395daa0d5/users/5842a5d34e7e4758980ba4b6aac4e812/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:35.797907 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33de54d-0adc-4c39-8e15-4737042b2a59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2112ed3eb7634c7189d0239395daa0d5, user_id=5842a5d34e7e4758980ba4b6aac4e812, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:35.801516 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33de54d-0adc-4c39-8e15-4737042b2a59 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:35.867001 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1208/2412] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:43:35 2022] PUT /identity/v3/projects/2112ed3eb7634c7189d0239395daa0d5/users/5842a5d34e7e4758980ba4b6aac4e812/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:43:35.892006 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edb1ca-22e2-47cb-a20c-3bdd486781ef None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:35.892379 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edb1ca-22e2-47cb-a20c-3bdd486781ef None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:35.892654 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edb1ca-22e2-47cb-a20c-3bdd486781ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:35.936812 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-a7edb1ca-22e2-47cb-a20c-3bdd486781ef None None] MFA Rules not processed for user `5842a5d34e7e4758980ba4b6aac4e812`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:43:35.939414 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-a7edb1ca-22e2-47cb-a20c-3bdd486781ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:36.078425 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1205/2413] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:43:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:43:36.079739 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33de54d-0adc-4c39-8e15-4737042b2a59 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:36.178978 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33de54d-0adc-4c39-8e15-4737042b2a59 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:36.184190 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26e4c5-7fd6-40f0-bdca-26f0e09464ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:36.185435 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26e4c5-7fd6-40f0-bdca-26f0e09464ad admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:36.185714 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26e4c5-7fd6-40f0-bdca-26f0e09464ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:36.185993 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea26e4c5-7fd6-40f0-bdca-26f0e09464ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:36.187857 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26e4c5-7fd6-40f0-bdca-26f0e09464ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:36.190654 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea26e4c5-7fd6-40f0-bdca-26f0e09464ad admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:36.237989 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1209/2414] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:43:36 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:43:36.242134 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edb1ca-22e2-47cb-a20c-3bdd486781ef None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:36.254574 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edb1ca-22e2-47cb-a20c-3bdd486781ef None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:36.320967 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78536a-5889-448c-a1c5-171adad35371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:36.321837 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78536a-5889-448c-a1c5-171adad35371 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:36.322122 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78536a-5889-448c-a1c5-171adad35371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:36.322399 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78536a-5889-448c-a1c5-171adad35371 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:36.323107 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78536a-5889-448c-a1c5-171adad35371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:36.325303 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78536a-5889-448c-a1c5-171adad35371 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:36.352132 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1206/2415] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:43:36 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:43:36.353692 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26e4c5-7fd6-40f0-bdca-26f0e09464ad admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:36.365163 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea26e4c5-7fd6-40f0-bdca-26f0e09464ad admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:36.395732 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38395a67-939e-4ffd-8d0c-0abd095baa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:36.396735 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38395a67-939e-4ffd-8d0c-0abd095baa9d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:36.397237 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38395a67-939e-4ffd-8d0c-0abd095baa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:36.397515 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38395a67-939e-4ffd-8d0c-0abd095baa9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:36.398293 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38395a67-939e-4ffd-8d0c-0abd095baa9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:36.402298 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38395a67-939e-4ffd-8d0c-0abd095baa9d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:36.422227 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1210/2416] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:43:36.429260 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78536a-5889-448c-a1c5-171adad35371 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:36.439470 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78536a-5889-448c-a1c5-171adad35371 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:36.444753 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fbca4-4b12-4427-a956-a59036f9fb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:36.445682 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fbca4-4b12-4427-a956-a59036f9fb26 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:36.449084 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fbca4-4b12-4427-a956-a59036f9fb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:36.449489 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fbca4-4b12-4427-a956-a59036f9fb26 admin admin] PATH_INFO: `/v3/projects/149db8d78fd44b248c6adf34a41061e8/users/9ccc02334f0746fc8323d52688bb576d/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:36.473601 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fbca4-4b12-4427-a956-a59036f9fb26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=149db8d78fd44b248c6adf34a41061e8, user_id=9ccc02334f0746fc8323d52688bb576d, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:36.477132 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fbca4-4b12-4427-a956-a59036f9fb26 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:36.493500 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1207/2417] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:43:36 2022] PUT /identity/v3/projects/149db8d78fd44b248c6adf34a41061e8/users/9ccc02334f0746fc8323d52688bb576d/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:43:36.494972 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38395a67-939e-4ffd-8d0c-0abd095baa9d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:36.505764 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38395a67-939e-4ffd-8d0c-0abd095baa9d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:36.576580 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69b0b8-60c1-4d84-96dd-30ba12375831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:36.577672 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69b0b8-60c1-4d84-96dd-30ba12375831 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:36.578260 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69b0b8-60c1-4d84-96dd-30ba12375831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:36.578692 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69b0b8-60c1-4d84-96dd-30ba12375831 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:36.579700 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69b0b8-60c1-4d84-96dd-30ba12375831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:36.581566 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69b0b8-60c1-4d84-96dd-30ba12375831 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:36.594650 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1211/2418] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:43:36.599039 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fbca4-4b12-4427-a956-a59036f9fb26 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:36.611399 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fbca4-4b12-4427-a956-a59036f9fb26 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:36.617661 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac28835-37d7-4598-8de1-7cd9acd78d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:36.618804 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac28835-37d7-4598-8de1-7cd9acd78d10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:36.619126 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac28835-37d7-4598-8de1-7cd9acd78d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:36.619407 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac28835-37d7-4598-8de1-7cd9acd78d10 admin admin] PATH_INFO: `/v3/projects/149db8d78fd44b248c6adf34a41061e8/users/9ccc02334f0746fc8323d52688bb576d/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:36.621744 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac28835-37d7-4598-8de1-7cd9acd78d10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=149db8d78fd44b248c6adf34a41061e8, user_id=9ccc02334f0746fc8323d52688bb576d, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:36.624382 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac28835-37d7-4598-8de1-7cd9acd78d10 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:36.661954 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1208/2419] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:43:36 2022] PUT /identity/v3/projects/149db8d78fd44b248c6adf34a41061e8/users/9ccc02334f0746fc8323d52688bb576d/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:43:36.672483 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d3fa4-47c2-4416-897d-86284ebb12d4 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:36.672777 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d3fa4-47c2-4416-897d-86284ebb12d4 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:36.673099 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d3fa4-47c2-4416-897d-86284ebb12d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:36.721396 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-c49d3fa4-47c2-4416-897d-86284ebb12d4 None None] MFA Rules not processed for user `9ccc02334f0746fc8323d52688bb576d`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:43:36.722707 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c49d3fa4-47c2-4416-897d-86284ebb12d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:36.782755 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571f3f-4724-48c0-ad74-fbb35ead9a82 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:36.783117 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571f3f-4724-48c0-ad74-fbb35ead9a82 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:36.783406 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01571f3f-4724-48c0-ad74-fbb35ead9a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:36.859927 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1212/2420] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:43:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:43:36.864088 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-01571f3f-4724-48c0-ad74-fbb35ead9a82 None None] MFA Rules not processed for user `98a27dbe620c4aff967363a7d48c46e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:43:36.866602 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-01571f3f-4724-48c0-ad74-fbb35ead9a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:36.870192 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d3fa4-47c2-4416-897d-86284ebb12d4 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:36.873291 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c49d3fa4-47c2-4416-897d-86284ebb12d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:36.978162 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1209/2421] 10.222.0.36 () {58 vars in 967 bytes} [Wed Feb 9 04:43:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:43:36.989358 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ade6ba-caa7-4d6b-8deb-c02b8a22bcb8 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:36.989649 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ade6ba-caa7-4d6b-8deb-c02b8a22bcb8 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:36.990070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ade6ba-caa7-4d6b-8deb-c02b8a22bcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:36.992939 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d3fa4-47c2-4416-897d-86284ebb12d4 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:37.000468 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3b9c1-30a8-4954-858a-9657f5f660cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:37.000468 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3b9c1-30a8-4954-858a-9657f5f660cf service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:37.001145 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3b9c1-30a8-4954-858a-9657f5f660cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:37.001522 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3b9c1-30a8-4954-858a-9657f5f660cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:37.033745 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-23ade6ba-caa7-4d6b-8deb-c02b8a22bcb8 None None] MFA Rules not processed for user `2c03733c29e44e72b3c90def97071b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:43:37.035163 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-23ade6ba-caa7-4d6b-8deb-c02b8a22bcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:37.080156 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3b9c1-30a8-4954-858a-9657f5f660cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:37.081648 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3b9c1-30a8-4954-858a-9657f5f660cf service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:37.092440 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1213/2422] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:43:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:43:37.093829 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3b9c1-30a8-4954-858a-9657f5f660cf service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:37.095199 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-47c3b9c1-30a8-4954-858a-9657f5f660cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:37.123833 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1210/2423] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:43:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:43:37.132344 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ade6ba-caa7-4d6b-8deb-c02b8a22bcb8 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:37.140933 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-23ade6ba-caa7-4d6b-8deb-c02b8a22bcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:37.199827 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3b9c1-30a8-4954-858a-9657f5f660cf service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:37.235330 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921deef2-56f1-4758-ad0f-3cfd1a93f6e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66fd482451f743cdb692677e57508764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:37.236010 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921deef2-56f1-4758-ad0f-3cfd1a93f6e2 service swift] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:37.236296 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921deef2-56f1-4758-ad0f-3cfd1a93f6e2 service swift] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:37.236575 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921deef2-56f1-4758-ad0f-3cfd1a93f6e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:37.249634 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921deef2-56f1-4758-ad0f-3cfd1a93f6e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:37.251258 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921deef2-56f1-4758-ad0f-3cfd1a93f6e2 service swift] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:37.252169 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ade6ba-caa7-4d6b-8deb-c02b8a22bcb8 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:37.259620 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1214/2424] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Feb 9 04:43:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:43:37.260419 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee7ee1-9bcd-48f8-bb6c-cc8fda76cafa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:37.261351 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee7ee1-9bcd-48f8-bb6c-cc8fda76cafa service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:37.262397 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee7ee1-9bcd-48f8-bb6c-cc8fda76cafa service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:37.263656 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee7ee1-9bcd-48f8-bb6c-cc8fda76cafa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:37.294193 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee7ee1-9bcd-48f8-bb6c-cc8fda76cafa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:37.301280 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ee7ee1-9bcd-48f8-bb6c-cc8fda76cafa service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:37.324386 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1211/2425] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:43:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:43:39.178085 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc564df-1eb1-4b5c-be35-28d22baccf8c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:39.178606 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc564df-1eb1-4b5c-be35-28d22baccf8c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:39.178944 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc564df-1eb1-4b5c-be35-28d22baccf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:39.207453 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2cc564df-1eb1-4b5c-be35-28d22baccf8c None None] MFA Rules not processed for user `2c03733c29e44e72b3c90def97071b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:43:39.209562 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2cc564df-1eb1-4b5c-be35-28d22baccf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:39.224598 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1215/2426] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:43:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:43:39.687515 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee7ee1-9bcd-48f8-bb6c-cc8fda76cafa service nova] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:39.688994 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-56ee7ee1-9bcd-48f8-bb6c-cc8fda76cafa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:39.777879 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee7ee1-9bcd-48f8-bb6c-cc8fda76cafa service nova] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:39.783136 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d747002-c9e4-43ce-8bdb-4ec15ca80c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:39.784004 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d747002-c9e4-43ce-8bdb-4ec15ca80c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:39.784447 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d747002-c9e4-43ce-8bdb-4ec15ca80c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:39.784905 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d747002-c9e4-43ce-8bdb-4ec15ca80c8a admin admin] PATH_INFO: `/v3/users/f97812ad784a49bb93ab0ec91d8edd65` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:39.786361 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d747002-c9e4-43ce-8bdb-4ec15ca80c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f97812ad784a49bb93ab0ec91d8edd65)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:39.788442 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d747002-c9e4-43ce-8bdb-4ec15ca80c8a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:39.873587 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6d747002-c9e4-43ce-8bdb-4ec15ca80c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f97812ad784a49bb93ab0ec91d8edd65'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:39.882617 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6d747002-c9e4-43ce-8bdb-4ec15ca80c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f97812ad784a49bb93ab0ec91d8edd65'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:39.883770 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6d747002-c9e4-43ce-8bdb-4ec15ca80c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f97812ad784a49bb93ab0ec91d8edd65'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:39.897144 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6d747002-c9e4-43ce-8bdb-4ec15ca80c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f97812ad784a49bb93ab0ec91d8edd65'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:39.907495 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6d747002-c9e4-43ce-8bdb-4ec15ca80c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f97812ad784a49bb93ab0ec91d8edd65'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:39.913902 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1212/2427] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:43:39 2022] DELETE /identity/v3/users/f97812ad784a49bb93ab0ec91d8edd65 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:43:40.113942 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc564df-1eb1-4b5c-be35-28d22baccf8c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:40.129196 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc564df-1eb1-4b5c-be35-28d22baccf8c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:40.272877 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a966bc-ed69-4676-bc84-eab5267ec1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:40.273699 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a966bc-ed69-4676-bc84-eab5267ec1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:40.273982 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a966bc-ed69-4676-bc84-eab5267ec1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:40.274250 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a966bc-ed69-4676-bc84-eab5267ec1a3 admin admin] PATH_INFO: `/v3/projects/85b1c02b545d4272a79d2b1dfb6139f5` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:40.275838 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a966bc-ed69-4676-bc84-eab5267ec1a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85b1c02b545d4272a79d2b1dfb6139f5)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:40.278323 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a966bc-ed69-4676-bc84-eab5267ec1a3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:40.387989 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-87a966bc-ed69-4676-bc84-eab5267ec1a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b1c02b545d4272a79d2b1dfb6139f5', 'request_id': 'req-87a966bc-ed69-4676-bc84-eab5267ec1a3'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:40.416274 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-87a966bc-ed69-4676-bc84-eab5267ec1a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b1c02b545d4272a79d2b1dfb6139f5', 'request_id': 'req-87a966bc-ed69-4676-bc84-eab5267ec1a3'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:40.428204 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-87a966bc-ed69-4676-bc84-eab5267ec1a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b1c02b545d4272a79d2b1dfb6139f5', 'request_id': 'req-87a966bc-ed69-4676-bc84-eab5267ec1a3'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:40.483213 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-87a966bc-ed69-4676-bc84-eab5267ec1a3 admin admin] The token cache is being invalidate because project 85b1c02b545d4272a79d2b1dfb6139f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:43:40.488940 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-87a966bc-ed69-4676-bc84-eab5267ec1a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:40.490043 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-87a966bc-ed69-4676-bc84-eab5267ec1a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:43:40.492444 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1216/2428] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:43:40 2022] DELETE /identity/v3/projects/85b1c02b545d4272a79d2b1dfb6139f5 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:43:40.498678 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d4e7c-e74d-43ea-9849-0ca7d104c76a None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:40.499265 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d4e7c-e74d-43ea-9849-0ca7d104c76a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:40.500302 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d4e7c-e74d-43ea-9849-0ca7d104c76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:40.537267 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-d77d4e7c-e74d-43ea-9849-0ca7d104c76a None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:43:40.538796 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-d77d4e7c-e74d-43ea-9849-0ca7d104c76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:40.658936 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1213/2429] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:43:40.670114 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abf605-944f-4304-ada2-2d732bd5531f None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:40.670684 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abf605-944f-4304-ada2-2d732bd5531f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:40.670962 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06abf605-944f-4304-ada2-2d732bd5531f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:40.698013 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-06abf605-944f-4304-ada2-2d732bd5531f None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:43:40.699706 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-06abf605-944f-4304-ada2-2d732bd5531f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:40.714770 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1217/2430] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:43:40.719032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d4e7c-e74d-43ea-9849-0ca7d104c76a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:40.732096 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d4e7c-e74d-43ea-9849-0ca7d104c76a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:40.738985 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc8258-973b-47d1-a9c2-e376d1458bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:40.739885 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc8258-973b-47d1-a9c2-e376d1458bdc admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:40.740928 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc8258-973b-47d1-a9c2-e376d1458bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:40.741636 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc8258-973b-47d1-a9c2-e376d1458bdc admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:40.742543 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc8258-973b-47d1-a9c2-e376d1458bdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:43:40.743447 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc8258-973b-47d1-a9c2-e376d1458bdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:40.745242 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc8258-973b-47d1-a9c2-e376d1458bdc admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:40.761599 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1214/2431] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:43:40.765641 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abf605-944f-4304-ada2-2d732bd5531f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:40.779070 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06abf605-944f-4304-ada2-2d732bd5531f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:40.787208 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843110e8-b8e7-4761-8271-c18bfbb28c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:40.788374 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843110e8-b8e7-4761-8271-c18bfbb28c00 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:40.788927 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843110e8-b8e7-4761-8271-c18bfbb28c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:40.789607 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843110e8-b8e7-4761-8271-c18bfbb28c00 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:40.790575 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843110e8-b8e7-4761-8271-c18bfbb28c00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:40.793306 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843110e8-b8e7-4761-8271-c18bfbb28c00 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:40.832972 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1218/2432] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:43:40 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:43:40.837796 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc8258-973b-47d1-a9c2-e376d1458bdc admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:40.850467 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc8258-973b-47d1-a9c2-e376d1458bdc admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:40.920886 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36137a8c-ba62-4693-9e83-5e9f1503341b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:40.922310 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36137a8c-ba62-4693-9e83-5e9f1503341b admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:40.922685 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36137a8c-ba62-4693-9e83-5e9f1503341b admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:40.923053 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36137a8c-ba62-4693-9e83-5e9f1503341b admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:40.923864 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36137a8c-ba62-4693-9e83-5e9f1503341b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:40.926529 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36137a8c-ba62-4693-9e83-5e9f1503341b admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:40.950280 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1215/2433] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:43:40 2022] POST /identity/v3/users => generated 285 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:43:40.954483 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843110e8-b8e7-4761-8271-c18bfbb28c00 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:40.966167 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843110e8-b8e7-4761-8271-c18bfbb28c00 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:40.971703 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31d374-2258-4e51-95dd-99be3104dd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:40.972467 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31d374-2258-4e51-95dd-99be3104dd21 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:40.972753 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31d374-2258-4e51-95dd-99be3104dd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:40.973051 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31d374-2258-4e51-95dd-99be3104dd21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:40.975301 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31d374-2258-4e51-95dd-99be3104dd21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:40.976945 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31d374-2258-4e51-95dd-99be3104dd21 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:40.991269 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1219/2434] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:43:40.992545 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36137a8c-ba62-4693-9e83-5e9f1503341b admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:41.003507 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36137a8c-ba62-4693-9e83-5e9f1503341b admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:41.011202 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fe458-0f09-4fdd-8e2a-a5803377aad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:41.011887 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fe458-0f09-4fdd-8e2a-a5803377aad6 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:41.012175 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fe458-0f09-4fdd-8e2a-a5803377aad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:41.012596 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fe458-0f09-4fdd-8e2a-a5803377aad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:41.013385 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fe458-0f09-4fdd-8e2a-a5803377aad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:41.015413 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fe458-0f09-4fdd-8e2a-a5803377aad6 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:41.031979 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1216/2435] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:43:41.036133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31d374-2258-4e51-95dd-99be3104dd21 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:41.047886 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31d374-2258-4e51-95dd-99be3104dd21 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:41.052884 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b4039-a4fc-444e-afb2-3823685b68e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:41.054360 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b4039-a4fc-444e-afb2-3823685b68e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:41.054721 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b4039-a4fc-444e-afb2-3823685b68e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:41.055073 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b4039-a4fc-444e-afb2-3823685b68e4 admin admin] PATH_INFO: `/v3/projects/7ac71114ae494f2782f00eb9b98a4598/users/4dac6d7e81234d0aa933ea1f00459461/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:41.071757 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b4039-a4fc-444e-afb2-3823685b68e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac71114ae494f2782f00eb9b98a4598, user_id=4dac6d7e81234d0aa933ea1f00459461, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:41.075521 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226b4039-a4fc-444e-afb2-3823685b68e4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:41.091202 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1220/2436] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:43:41 2022] PUT /identity/v3/projects/7ac71114ae494f2782f00eb9b98a4598/users/4dac6d7e81234d0aa933ea1f00459461/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:43:41.103582 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805f825-65b9-4779-a574-b02f39e1a54f None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:41.103885 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805f825-65b9-4779-a574-b02f39e1a54f None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:41.104161 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805f825-65b9-4779-a574-b02f39e1a54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:41.134780 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-9805f825-65b9-4779-a574-b02f39e1a54f None None] MFA Rules not processed for user `4dac6d7e81234d0aa933ea1f00459461`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:43:41.136012 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-9805f825-65b9-4779-a574-b02f39e1a54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:41.201576 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1217/2437] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:43:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:43:41.213362 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b4039-a4fc-444e-afb2-3823685b68e4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:41.215081 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-226b4039-a4fc-444e-afb2-3823685b68e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:41.297024 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b4039-a4fc-444e-afb2-3823685b68e4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:41.300871 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63024310-e514-491e-aff5-b2ff20d4083c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6940472eb8e544c8aa3409328c804282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:41.301554 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63024310-e514-491e-aff5-b2ff20d4083c service glance] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:41.301843 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63024310-e514-491e-aff5-b2ff20d4083c service glance] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:41.302123 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63024310-e514-491e-aff5-b2ff20d4083c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:41.310885 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63024310-e514-491e-aff5-b2ff20d4083c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:41.312331 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63024310-e514-491e-aff5-b2ff20d4083c service glance] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:41.321702 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1221/2438] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:43:41 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:43:47.036845 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805f825-65b9-4779-a574-b02f39e1a54f None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:43:47.038586 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-9805f825-65b9-4779-a574-b02f39e1a54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:47.104378 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805f825-65b9-4779-a574-b02f39e1a54f None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:43:47.110478 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd71a2-bd99-4ef5-95d9-caf54324addd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:43:47.111313 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd71a2-bd99-4ef5-95d9-caf54324addd service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:43:47.111593 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd71a2-bd99-4ef5-95d9-caf54324addd service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:43:47.111867 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd71a2-bd99-4ef5-95d9-caf54324addd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:43:47.113645 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-bbfd71a2-bd99-4ef5-95d9-caf54324addd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:43:47.177857 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd71a2-bd99-4ef5-95d9-caf54324addd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:43:47.179197 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd71a2-bd99-4ef5-95d9-caf54324addd service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:43:47.189485 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1218/2439] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:43:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:44:43.748570 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63024310-e514-491e-aff5-b2ff20d4083c service glance] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:43.749995 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-63024310-e514-491e-aff5-b2ff20d4083c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:43.813492 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63024310-e514-491e-aff5-b2ff20d4083c service glance] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:43.817993 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77558619-45da-4630-a34b-0c13f833a520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:43.818859 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77558619-45da-4630-a34b-0c13f833a520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:43.819163 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77558619-45da-4630-a34b-0c13f833a520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:43.819446 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77558619-45da-4630-a34b-0c13f833a520 admin admin] PATH_INFO: `/v3/users/5842a5d34e7e4758980ba4b6aac4e812` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:43.820653 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77558619-45da-4630-a34b-0c13f833a520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5842a5d34e7e4758980ba4b6aac4e812)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:43.822635 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77558619-45da-4630-a34b-0c13f833a520 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:43.869379 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-77558619-45da-4630-a34b-0c13f833a520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5842a5d34e7e4758980ba4b6aac4e812'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:43.878988 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-77558619-45da-4630-a34b-0c13f833a520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5842a5d34e7e4758980ba4b6aac4e812'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:43.879628 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-77558619-45da-4630-a34b-0c13f833a520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5842a5d34e7e4758980ba4b6aac4e812'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:43.891177 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-77558619-45da-4630-a34b-0c13f833a520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5842a5d34e7e4758980ba4b6aac4e812'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:43.899053 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-77558619-45da-4630-a34b-0c13f833a520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5842a5d34e7e4758980ba4b6aac4e812'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:43.905151 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1222/2440] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:44:43 2022] DELETE /identity/v3/users/5842a5d34e7e4758980ba4b6aac4e812 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:44:43.909891 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc06f0-a420-4ef7-bb39-10dae8bcf663 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:43.910412 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc06f0-a420-4ef7-bb39-10dae8bcf663 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:43.910526 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc06f0-a420-4ef7-bb39-10dae8bcf663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:43.927247 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-bffc06f0-a420-4ef7-bb39-10dae8bcf663 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:44:43.928422 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-bffc06f0-a420-4ef7-bb39-10dae8bcf663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:43.986273 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1219/2441] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:44:43.995826 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77558619-45da-4630-a34b-0c13f833a520 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:43.998048 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-77558619-45da-4630-a34b-0c13f833a520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:44.055045 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77558619-45da-4630-a34b-0c13f833a520 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:44.058731 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f5c64-a9e2-470b-9e5b-f88c928d7e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:44.059423 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f5c64-a9e2-470b-9e5b-f88c928d7e23 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:44.060208 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f5c64-a9e2-470b-9e5b-f88c928d7e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:44.060487 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f5c64-a9e2-470b-9e5b-f88c928d7e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:44.071217 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f5c64-a9e2-470b-9e5b-f88c928d7e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:44.072940 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f5c64-a9e2-470b-9e5b-f88c928d7e23 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:44.083162 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1223/2442] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:44:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:44:44.352893 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc06f0-a420-4ef7-bb39-10dae8bcf663 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:44.354374 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-bffc06f0-a420-4ef7-bb39-10dae8bcf663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:44.366700 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc06f0-a420-4ef7-bb39-10dae8bcf663 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:44.372625 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfa618-df38-4831-9551-6bda8933a8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:44.373511 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfa618-df38-4831-9551-6bda8933a8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:44.373918 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfa618-df38-4831-9551-6bda8933a8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:44.374059 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfa618-df38-4831-9551-6bda8933a8c8 admin admin] PATH_INFO: `/v3/projects/2112ed3eb7634c7189d0239395daa0d5` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:44.375966 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfa618-df38-4831-9551-6bda8933a8c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2112ed3eb7634c7189d0239395daa0d5)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:44.378131 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfa618-df38-4831-9551-6bda8933a8c8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:44.426669 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a2cfa618-df38-4831-9551-6bda8933a8c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2112ed3eb7634c7189d0239395daa0d5', 'request_id': 'req-a2cfa618-df38-4831-9551-6bda8933a8c8'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:44.433864 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a2cfa618-df38-4831-9551-6bda8933a8c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2112ed3eb7634c7189d0239395daa0d5', 'request_id': 'req-a2cfa618-df38-4831-9551-6bda8933a8c8'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:44.440274 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a2cfa618-df38-4831-9551-6bda8933a8c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2112ed3eb7634c7189d0239395daa0d5', 'request_id': 'req-a2cfa618-df38-4831-9551-6bda8933a8c8'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:44.450694 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a2cfa618-df38-4831-9551-6bda8933a8c8 admin admin] The token cache is being invalidate because project 2112ed3eb7634c7189d0239395daa0d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:44:44.450978 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a2cfa618-df38-4831-9551-6bda8933a8c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:44.451765 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a2cfa618-df38-4831-9551-6bda8933a8c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:44.453336 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1220/2443] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:44:44 2022] DELETE /identity/v3/projects/2112ed3eb7634c7189d0239395daa0d5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:44:44.457243 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f5c64-a9e2-470b-9e5b-f88c928d7e23 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:44.467192 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f5c64-a9e2-470b-9e5b-f88c928d7e23 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:44.521280 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7de1c-24f4-4c7d-93ae-ffc0772c75e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:44.522129 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7de1c-24f4-4c7d-93ae-ffc0772c75e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:44.522409 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7de1c-24f4-4c7d-93ae-ffc0772c75e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:44.522680 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7de1c-24f4-4c7d-93ae-ffc0772c75e4 admin admin] PATH_INFO: `/v3/users/9ccc02334f0746fc8323d52688bb576d` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:44.523847 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7de1c-24f4-4c7d-93ae-ffc0772c75e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ccc02334f0746fc8323d52688bb576d)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:44.525804 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7de1c-24f4-4c7d-93ae-ffc0772c75e4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:44.569765 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5ee7de1c-24f4-4c7d-93ae-ffc0772c75e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ccc02334f0746fc8323d52688bb576d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:44.576892 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5ee7de1c-24f4-4c7d-93ae-ffc0772c75e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ccc02334f0746fc8323d52688bb576d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:44.577594 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5ee7de1c-24f4-4c7d-93ae-ffc0772c75e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ccc02334f0746fc8323d52688bb576d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:44.588593 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5ee7de1c-24f4-4c7d-93ae-ffc0772c75e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ccc02334f0746fc8323d52688bb576d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:44.596407 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-5ee7de1c-24f4-4c7d-93ae-ffc0772c75e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ccc02334f0746fc8323d52688bb576d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:44.602776 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1224/2444] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:44:44 2022] DELETE /identity/v3/users/9ccc02334f0746fc8323d52688bb576d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:44:44.866866 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfa618-df38-4831-9551-6bda8933a8c8 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:44.868321 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-a2cfa618-df38-4831-9551-6bda8933a8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:44.881579 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfa618-df38-4831-9551-6bda8933a8c8 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:44.935582 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61dd41-0f13-4db0-a3c9-f7ea23647afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:44.936432 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61dd41-0f13-4db0-a3c9-f7ea23647afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:44.936718 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61dd41-0f13-4db0-a3c9-f7ea23647afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:44.936995 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61dd41-0f13-4db0-a3c9-f7ea23647afa admin admin] PATH_INFO: `/v3/projects/149db8d78fd44b248c6adf34a41061e8` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:44.938208 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61dd41-0f13-4db0-a3c9-f7ea23647afa admin admin] RBAC: Authorizing `identity:delete_project(project_id=149db8d78fd44b248c6adf34a41061e8)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:44.940125 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61dd41-0f13-4db0-a3c9-f7ea23647afa admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:44.984277 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-5a61dd41-0f13-4db0-a3c9-f7ea23647afa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '149db8d78fd44b248c6adf34a41061e8', 'request_id': 'req-5a61dd41-0f13-4db0-a3c9-f7ea23647afa'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:44.991529 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-5a61dd41-0f13-4db0-a3c9-f7ea23647afa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '149db8d78fd44b248c6adf34a41061e8', 'request_id': 'req-5a61dd41-0f13-4db0-a3c9-f7ea23647afa'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:44.997991 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-5a61dd41-0f13-4db0-a3c9-f7ea23647afa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '149db8d78fd44b248c6adf34a41061e8', 'request_id': 'req-5a61dd41-0f13-4db0-a3c9-f7ea23647afa'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:45.007797 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-5a61dd41-0f13-4db0-a3c9-f7ea23647afa admin admin] The token cache is being invalidate because project 149db8d78fd44b248c6adf34a41061e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:44:45.008085 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-5a61dd41-0f13-4db0-a3c9-f7ea23647afa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:45.008752 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-5a61dd41-0f13-4db0-a3c9-f7ea23647afa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:45.010285 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1221/2445] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:44:44 2022] DELETE /identity/v3/projects/149db8d78fd44b248c6adf34a41061e8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:44:45.016518 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a146b-ede8-4b91-9b1d-7c1e86709661 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:45.016979 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a146b-ede8-4b91-9b1d-7c1e86709661 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:45.017124 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a146b-ede8-4b91-9b1d-7c1e86709661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:45.034833 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a09a146b-ede8-4b91-9b1d-7c1e86709661 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:44:45.036023 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a09a146b-ede8-4b91-9b1d-7c1e86709661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:45.091714 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1225/2446] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:44:45.100415 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee7c24-0a8d-437b-8d49-f25d89c0bbfd None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:45.100706 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee7c24-0a8d-437b-8d49-f25d89c0bbfd None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:45.100987 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ee7c24-0a8d-437b-8d49-f25d89c0bbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:45.118953 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-40ee7c24-0a8d-437b-8d49-f25d89c0bbfd None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:44:45.120081 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-40ee7c24-0a8d-437b-8d49-f25d89c0bbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:45.128341 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1222/2447] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:44:45.132333 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a146b-ede8-4b91-9b1d-7c1e86709661 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:45.142601 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a146b-ede8-4b91-9b1d-7c1e86709661 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:45.147540 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35835c9b-6ab1-4abf-a451-f7fbc7c9ad96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:45.148192 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35835c9b-6ab1-4abf-a451-f7fbc7c9ad96 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:45.148575 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35835c9b-6ab1-4abf-a451-f7fbc7c9ad96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:45.148751 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35835c9b-6ab1-4abf-a451-f7fbc7c9ad96 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:45.149525 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35835c9b-6ab1-4abf-a451-f7fbc7c9ad96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:44:45.149832 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35835c9b-6ab1-4abf-a451-f7fbc7c9ad96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:45.151429 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35835c9b-6ab1-4abf-a451-f7fbc7c9ad96 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:45.163112 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1226/2448] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:44:45.167422 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee7c24-0a8d-437b-8d49-f25d89c0bbfd None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:45.176357 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ee7c24-0a8d-437b-8d49-f25d89c0bbfd None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:45.180945 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b032c6-8edf-4348-9389-5424533eaf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:45.181621 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b032c6-8edf-4348-9389-5424533eaf75 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:45.181903 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b032c6-8edf-4348-9389-5424533eaf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:45.182183 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b032c6-8edf-4348-9389-5424533eaf75 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:45.182876 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b032c6-8edf-4348-9389-5424533eaf75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:45.185289 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b032c6-8edf-4348-9389-5424533eaf75 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:45.209923 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1223/2449] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:44:45 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:44:45.213970 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35835c9b-6ab1-4abf-a451-f7fbc7c9ad96 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:45.223694 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35835c9b-6ab1-4abf-a451-f7fbc7c9ad96 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:45.277892 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec615576-0233-4307-a94d-6a26416f2e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:45.278559 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec615576-0233-4307-a94d-6a26416f2e0e admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:45.278844 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec615576-0233-4307-a94d-6a26416f2e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:45.279150 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec615576-0233-4307-a94d-6a26416f2e0e admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:45.279862 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec615576-0233-4307-a94d-6a26416f2e0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:45.281858 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec615576-0233-4307-a94d-6a26416f2e0e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:45.300313 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1227/2450] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:44:45 2022] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:44:45.304318 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b032c6-8edf-4348-9389-5424533eaf75 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:45.317901 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b032c6-8edf-4348-9389-5424533eaf75 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:45.322534 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64353bd1-bad1-4d6b-8dfa-7a262d7ad7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:45.323191 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64353bd1-bad1-4d6b-8dfa-7a262d7ad7ac admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:45.323476 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64353bd1-bad1-4d6b-8dfa-7a262d7ad7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:45.323755 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64353bd1-bad1-4d6b-8dfa-7a262d7ad7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:45.324489 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64353bd1-bad1-4d6b-8dfa-7a262d7ad7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:45.326458 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64353bd1-bad1-4d6b-8dfa-7a262d7ad7ac admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:45.336586 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1224/2451] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:44:45.340352 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec615576-0233-4307-a94d-6a26416f2e0e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:45.350163 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec615576-0233-4307-a94d-6a26416f2e0e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:45.354764 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2a314-b569-4ccb-b104-f8259878e71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:45.355414 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2a314-b569-4ccb-b104-f8259878e71c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:45.355693 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2a314-b569-4ccb-b104-f8259878e71c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:45.355967 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2a314-b569-4ccb-b104-f8259878e71c admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:45.357270 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2a314-b569-4ccb-b104-f8259878e71c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:45.358857 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2a314-b569-4ccb-b104-f8259878e71c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:45.368411 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1228/2452] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:44:45.373390 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64353bd1-bad1-4d6b-8dfa-7a262d7ad7ac admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:45.382882 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64353bd1-bad1-4d6b-8dfa-7a262d7ad7ac admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:45.387508 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d05b1-32de-4c3f-a741-fa1d5ffc1e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:45.388367 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d05b1-32de-4c3f-a741-fa1d5ffc1e5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:45.388644 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d05b1-32de-4c3f-a741-fa1d5ffc1e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:45.388915 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d05b1-32de-4c3f-a741-fa1d5ffc1e5b admin admin] PATH_INFO: `/v3/projects/65fd2f08bf364f42b93e0aa50b3806c1/users/163903a3b6a0478385f44693dfd56606/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:45.403583 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d05b1-32de-4c3f-a741-fa1d5ffc1e5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=65fd2f08bf364f42b93e0aa50b3806c1, user_id=163903a3b6a0478385f44693dfd56606, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:45.406260 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d05b1-32de-4c3f-a741-fa1d5ffc1e5b admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:45.418615 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1225/2453] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:44:45 2022] PUT /identity/v3/projects/65fd2f08bf364f42b93e0aa50b3806c1/users/163903a3b6a0478385f44693dfd56606/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:44:45.429037 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d9380-86b9-4215-8f00-e467ada3cb9a None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:45.429324 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d9380-86b9-4215-8f00-e467ada3cb9a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:45.429604 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d9380-86b9-4215-8f00-e467ada3cb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:45.455234 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-f24d9380-86b9-4215-8f00-e467ada3cb9a None None] MFA Rules not processed for user `163903a3b6a0478385f44693dfd56606`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:44:45.456418 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f24d9380-86b9-4215-8f00-e467ada3cb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:45.515697 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1229/2454] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:44:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:44:45.520369 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d05b1-32de-4c3f-a741-fa1d5ffc1e5b admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:45.580008 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d05b1-32de-4c3f-a741-fa1d5ffc1e5b admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:45.584791 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db723189-1a4f-48b7-95bd-d5cde6cf82a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:45.585472 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db723189-1a4f-48b7-95bd-d5cde6cf82a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:45.585757 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db723189-1a4f-48b7-95bd-d5cde6cf82a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:45.586035 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db723189-1a4f-48b7-95bd-d5cde6cf82a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:45.586735 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db723189-1a4f-48b7-95bd-d5cde6cf82a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:45.588644 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db723189-1a4f-48b7-95bd-d5cde6cf82a6 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:45.614389 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1226/2455] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:44:45 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:44:45.618332 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d9380-86b9-4215-8f00-e467ada3cb9a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:45.628605 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d9380-86b9-4215-8f00-e467ada3cb9a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:45.684040 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7adb4-2f6c-456a-85b7-fb501b7c0fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:45.684712 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7adb4-2f6c-456a-85b7-fb501b7c0fcc admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:45.684993 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7adb4-2f6c-456a-85b7-fb501b7c0fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:45.685298 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7adb4-2f6c-456a-85b7-fb501b7c0fcc admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:45.685995 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7adb4-2f6c-456a-85b7-fb501b7c0fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:45.687899 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7adb4-2f6c-456a-85b7-fb501b7c0fcc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:45.706274 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1230/2456] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:44:45 2022] POST /identity/v3/users => generated 300 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:44:45.710150 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db723189-1a4f-48b7-95bd-d5cde6cf82a6 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:45.720816 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db723189-1a4f-48b7-95bd-d5cde6cf82a6 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:45.725500 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa67e17-5e54-4ec6-a6e9-d2ab08c0e584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:45.726157 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa67e17-5e54-4ec6-a6e9-d2ab08c0e584 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:45.726441 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa67e17-5e54-4ec6-a6e9-d2ab08c0e584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:45.726719 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa67e17-5e54-4ec6-a6e9-d2ab08c0e584 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:45.727458 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa67e17-5e54-4ec6-a6e9-d2ab08c0e584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:45.729058 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa67e17-5e54-4ec6-a6e9-d2ab08c0e584 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:45.740046 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1227/2457] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:44:45.744154 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7adb4-2f6c-456a-85b7-fb501b7c0fcc admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:45.753973 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7adb4-2f6c-456a-85b7-fb501b7c0fcc admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:45.758481 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42231323-b636-4a6d-afb7-f200f22bc289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:45.759346 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42231323-b636-4a6d-afb7-f200f22bc289 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:45.759626 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42231323-b636-4a6d-afb7-f200f22bc289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:45.759895 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42231323-b636-4a6d-afb7-f200f22bc289 admin admin] PATH_INFO: `/v3/projects/dae9a12012704df89dcd34f0c9814adf/users/6234489fa50042db88d1f104fa8220c1/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:45.773952 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42231323-b636-4a6d-afb7-f200f22bc289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae9a12012704df89dcd34f0c9814adf, user_id=6234489fa50042db88d1f104fa8220c1, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:45.776585 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42231323-b636-4a6d-afb7-f200f22bc289 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:45.789900 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1231/2458] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:44:45 2022] PUT /identity/v3/projects/dae9a12012704df89dcd34f0c9814adf/users/6234489fa50042db88d1f104fa8220c1/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:44:45.794659 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa67e17-5e54-4ec6-a6e9-d2ab08c0e584 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:45.804360 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa67e17-5e54-4ec6-a6e9-d2ab08c0e584 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:45.857479 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ae0e2-df5f-46c7-a245-ec8d7264ed94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:45.858134 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ae0e2-df5f-46c7-a245-ec8d7264ed94 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:45.858417 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ae0e2-df5f-46c7-a245-ec8d7264ed94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:45.858695 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ae0e2-df5f-46c7-a245-ec8d7264ed94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:45.859421 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ae0e2-df5f-46c7-a245-ec8d7264ed94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:45.860999 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ae0e2-df5f-46c7-a245-ec8d7264ed94 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:45.870294 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1228/2459] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:44:45.874254 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42231323-b636-4a6d-afb7-f200f22bc289 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:45.884332 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42231323-b636-4a6d-afb7-f200f22bc289 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:45.888928 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68e605-902d-4f38-a3a7-472134b8678f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:45.889837 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68e605-902d-4f38-a3a7-472134b8678f admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:45.890123 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68e605-902d-4f38-a3a7-472134b8678f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:45.890401 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68e605-902d-4f38-a3a7-472134b8678f admin admin] PATH_INFO: `/v3/projects/dae9a12012704df89dcd34f0c9814adf/users/6234489fa50042db88d1f104fa8220c1/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:45.892368 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68e605-902d-4f38-a3a7-472134b8678f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae9a12012704df89dcd34f0c9814adf, user_id=6234489fa50042db88d1f104fa8220c1, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:45.895315 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68e605-902d-4f38-a3a7-472134b8678f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:45.905738 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1232/2460] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:44:45 2022] PUT /identity/v3/projects/dae9a12012704df89dcd34f0c9814adf/users/6234489fa50042db88d1f104fa8220c1/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:44:45.916503 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055eabb7-1785-46ff-8712-8e92f92ca11f None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:45.916790 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055eabb7-1785-46ff-8712-8e92f92ca11f None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:45.917100 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055eabb7-1785-46ff-8712-8e92f92ca11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:45.942756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-055eabb7-1785-46ff-8712-8e92f92ca11f None None] MFA Rules not processed for user `6234489fa50042db88d1f104fa8220c1`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:44:45.943937 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-055eabb7-1785-46ff-8712-8e92f92ca11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:46.007878 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1229/2461] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:44:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:44:46.017768 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68e605-902d-4f38-a3a7-472134b8678f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:46.019805 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-bc68e605-902d-4f38-a3a7-472134b8678f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:46.076490 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68e605-902d-4f38-a3a7-472134b8678f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:46.080148 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be86a2-0165-4408-a54f-a2aed5505a5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:46.080790 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be86a2-0165-4408-a54f-a2aed5505a5c service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:46.081101 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be86a2-0165-4408-a54f-a2aed5505a5c service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:46.081380 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be86a2-0165-4408-a54f-a2aed5505a5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:46.090146 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be86a2-0165-4408-a54f-a2aed5505a5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:46.092231 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be86a2-0165-4408-a54f-a2aed5505a5c service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:46.101361 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1233/2462] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:44:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:44:46.580184 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055eabb7-1785-46ff-8712-8e92f92ca11f None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:46.638788 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055eabb7-1785-46ff-8712-8e92f92ca11f None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:46.643280 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc220e3-ba97-4cfa-9611-39e5b82176b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:46.644385 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc220e3-ba97-4cfa-9611-39e5b82176b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:46.644668 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc220e3-ba97-4cfa-9611-39e5b82176b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:46.644941 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc220e3-ba97-4cfa-9611-39e5b82176b6 admin admin] PATH_INFO: `/v3/users/163903a3b6a0478385f44693dfd56606` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:46.646164 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc220e3-ba97-4cfa-9611-39e5b82176b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=163903a3b6a0478385f44693dfd56606)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:46.648078 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc220e3-ba97-4cfa-9611-39e5b82176b6 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:46.691507 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7dc220e3-ba97-4cfa-9611-39e5b82176b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '163903a3b6a0478385f44693dfd56606'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:46.698022 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7dc220e3-ba97-4cfa-9611-39e5b82176b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '163903a3b6a0478385f44693dfd56606'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:46.698675 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7dc220e3-ba97-4cfa-9611-39e5b82176b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '163903a3b6a0478385f44693dfd56606'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:46.710403 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7dc220e3-ba97-4cfa-9611-39e5b82176b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '163903a3b6a0478385f44693dfd56606'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:46.718387 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7dc220e3-ba97-4cfa-9611-39e5b82176b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '163903a3b6a0478385f44693dfd56606'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:46.724231 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1230/2463] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:44:46 2022] DELETE /identity/v3/users/163903a3b6a0478385f44693dfd56606 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:44:46.728644 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debe973-f518-4bb0-a7ac-33a675156f0f None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:46.728938 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debe973-f518-4bb0-a7ac-33a675156f0f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:46.729277 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debe973-f518-4bb0-a7ac-33a675156f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:46.747843 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-8debe973-f518-4bb0-a7ac-33a675156f0f None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:44:46.749069 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8debe973-f518-4bb0-a7ac-33a675156f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:46.805453 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1234/2464] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:44:46.815579 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc220e3-ba97-4cfa-9611-39e5b82176b6 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:46.816950 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7dc220e3-ba97-4cfa-9611-39e5b82176b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:46.870939 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc220e3-ba97-4cfa-9611-39e5b82176b6 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:46.875213 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e2b9d-31cf-478a-9458-4a65f07791ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:46.875846 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e2b9d-31cf-478a-9458-4a65f07791ee service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:46.876133 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e2b9d-31cf-478a-9458-4a65f07791ee service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:46.876411 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e2b9d-31cf-478a-9458-4a65f07791ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:46.885229 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e2b9d-31cf-478a-9458-4a65f07791ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:46.886694 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e2b9d-31cf-478a-9458-4a65f07791ee service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:46.896161 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1231/2465] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:44:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:44:47.147049 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debe973-f518-4bb0-a7ac-33a675156f0f None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:47.148724 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8debe973-f518-4bb0-a7ac-33a675156f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:47.162432 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debe973-f518-4bb0-a7ac-33a675156f0f None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:47.167272 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985c747-d993-4218-9ca2-7515a8b04985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:47.168449 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985c747-d993-4218-9ca2-7515a8b04985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:47.169655 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985c747-d993-4218-9ca2-7515a8b04985 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:47.170079 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985c747-d993-4218-9ca2-7515a8b04985 admin admin] PATH_INFO: `/v3/projects/65fd2f08bf364f42b93e0aa50b3806c1` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:47.171513 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985c747-d993-4218-9ca2-7515a8b04985 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65fd2f08bf364f42b93e0aa50b3806c1)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:47.173676 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985c747-d993-4218-9ca2-7515a8b04985 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:47.220712 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d985c747-d993-4218-9ca2-7515a8b04985 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65fd2f08bf364f42b93e0aa50b3806c1', 'request_id': 'req-d985c747-d993-4218-9ca2-7515a8b04985'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:47.227197 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d985c747-d993-4218-9ca2-7515a8b04985 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65fd2f08bf364f42b93e0aa50b3806c1', 'request_id': 'req-d985c747-d993-4218-9ca2-7515a8b04985'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:47.238450 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d985c747-d993-4218-9ca2-7515a8b04985 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65fd2f08bf364f42b93e0aa50b3806c1', 'request_id': 'req-d985c747-d993-4218-9ca2-7515a8b04985'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:47.250229 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d985c747-d993-4218-9ca2-7515a8b04985 admin admin] The token cache is being invalidate because project 65fd2f08bf364f42b93e0aa50b3806c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:44:47.250660 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d985c747-d993-4218-9ca2-7515a8b04985 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:47.251611 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-d985c747-d993-4218-9ca2-7515a8b04985 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:47.253751 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1235/2466] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:44:47 2022] DELETE /identity/v3/projects/65fd2f08bf364f42b93e0aa50b3806c1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:44:47.257666 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e2b9d-31cf-478a-9458-4a65f07791ee service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:47.269071 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e2b9d-31cf-478a-9458-4a65f07791ee service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:47.326669 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8593d-9a57-4f86-9107-e4522585fed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:47.327511 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8593d-9a57-4f86-9107-e4522585fed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:47.327789 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8593d-9a57-4f86-9107-e4522585fed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:47.328058 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8593d-9a57-4f86-9107-e4522585fed7 admin admin] PATH_INFO: `/v3/users/6234489fa50042db88d1f104fa8220c1` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:47.329261 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8593d-9a57-4f86-9107-e4522585fed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6234489fa50042db88d1f104fa8220c1)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:47.331156 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8593d-9a57-4f86-9107-e4522585fed7 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:47.375819 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-36d8593d-9a57-4f86-9107-e4522585fed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6234489fa50042db88d1f104fa8220c1'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:47.382249 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-36d8593d-9a57-4f86-9107-e4522585fed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6234489fa50042db88d1f104fa8220c1'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:47.382899 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-36d8593d-9a57-4f86-9107-e4522585fed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6234489fa50042db88d1f104fa8220c1'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:47.394491 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-36d8593d-9a57-4f86-9107-e4522585fed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6234489fa50042db88d1f104fa8220c1'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:47.401288 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-36d8593d-9a57-4f86-9107-e4522585fed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6234489fa50042db88d1f104fa8220c1'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:47.407453 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1232/2467] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:44:47 2022] DELETE /identity/v3/users/6234489fa50042db88d1f104fa8220c1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:44:47.668534 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985c747-d993-4218-9ca2-7515a8b04985 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:47.670238 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d985c747-d993-4218-9ca2-7515a8b04985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:47.684077 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985c747-d993-4218-9ca2-7515a8b04985 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:47.737980 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb249fd-f4a1-45c0-b2b2-513cd0fb9bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:47.738826 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb249fd-f4a1-45c0-b2b2-513cd0fb9bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:47.739104 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb249fd-f4a1-45c0-b2b2-513cd0fb9bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:47.739374 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb249fd-f4a1-45c0-b2b2-513cd0fb9bf8 admin admin] PATH_INFO: `/v3/projects/dae9a12012704df89dcd34f0c9814adf` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:47.740546 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb249fd-f4a1-45c0-b2b2-513cd0fb9bf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae9a12012704df89dcd34f0c9814adf)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:47.742490 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb249fd-f4a1-45c0-b2b2-513cd0fb9bf8 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:47.787688 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2fb249fd-f4a1-45c0-b2b2-513cd0fb9bf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae9a12012704df89dcd34f0c9814adf', 'request_id': 'req-2fb249fd-f4a1-45c0-b2b2-513cd0fb9bf8'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:47.793864 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2fb249fd-f4a1-45c0-b2b2-513cd0fb9bf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae9a12012704df89dcd34f0c9814adf', 'request_id': 'req-2fb249fd-f4a1-45c0-b2b2-513cd0fb9bf8'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:47.800858 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2fb249fd-f4a1-45c0-b2b2-513cd0fb9bf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae9a12012704df89dcd34f0c9814adf', 'request_id': 'req-2fb249fd-f4a1-45c0-b2b2-513cd0fb9bf8'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:47.810527 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2fb249fd-f4a1-45c0-b2b2-513cd0fb9bf8 admin admin] The token cache is being invalidate because project dae9a12012704df89dcd34f0c9814adf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:44:47.811342 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2fb249fd-f4a1-45c0-b2b2-513cd0fb9bf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:47.811946 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2fb249fd-f4a1-45c0-b2b2-513cd0fb9bf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:47.813524 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1236/2468] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:44:47 2022] DELETE /identity/v3/projects/dae9a12012704df89dcd34f0c9814adf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:44:47.819020 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c8b27-be23-402d-b23b-0d1888527335 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:47.819306 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c8b27-be23-402d-b23b-0d1888527335 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:47.819583 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c8b27-be23-402d-b23b-0d1888527335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:47.836378 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-a75c8b27-be23-402d-b23b-0d1888527335 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:44:47.837604 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-a75c8b27-be23-402d-b23b-0d1888527335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:47.894980 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1233/2469] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:44:47.902863 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce0063-0356-4071-b951-9d9ba447d8f0 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:47.903156 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce0063-0356-4071-b951-9d9ba447d8f0 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:47.903433 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce0063-0356-4071-b951-9d9ba447d8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:47.921088 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-02ce0063-0356-4071-b951-9d9ba447d8f0 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:44:47.922269 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-02ce0063-0356-4071-b951-9d9ba447d8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:47.929906 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1237/2470] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:44:47.933763 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c8b27-be23-402d-b23b-0d1888527335 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:47.943698 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c8b27-be23-402d-b23b-0d1888527335 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:47.948302 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefd22b-6830-44d3-a911-5e32aeab9b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:47.948943 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefd22b-6830-44d3-a911-5e32aeab9b11 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:47.949255 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefd22b-6830-44d3-a911-5e32aeab9b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:47.949538 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcefd22b-6830-44d3-a911-5e32aeab9b11 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:47.950356 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefd22b-6830-44d3-a911-5e32aeab9b11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:44:47.950661 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefd22b-6830-44d3-a911-5e32aeab9b11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:47.952250 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcefd22b-6830-44d3-a911-5e32aeab9b11 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:47.963534 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1234/2471] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 09 04:44:47.968147 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce0063-0356-4071-b951-9d9ba447d8f0 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:47.976988 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce0063-0356-4071-b951-9d9ba447d8f0 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:47.982371 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf401ad-44c5-4957-9e5d-f6da87dc0cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:47.983009 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf401ad-44c5-4957-9e5d-f6da87dc0cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:47.983290 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf401ad-44c5-4957-9e5d-f6da87dc0cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:47.983591 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf401ad-44c5-4957-9e5d-f6da87dc0cf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:47.984296 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf401ad-44c5-4957-9e5d-f6da87dc0cf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:47.986250 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf401ad-44c5-4957-9e5d-f6da87dc0cf5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:48.010658 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1238/2472] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:44:47 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:44:48.014766 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefd22b-6830-44d3-a911-5e32aeab9b11 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:48.024761 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcefd22b-6830-44d3-a911-5e32aeab9b11 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:48.076897 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad89bfd-87e3-40ad-9953-d95ab7dde70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:48.077578 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad89bfd-87e3-40ad-9953-d95ab7dde70f admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:48.077860 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad89bfd-87e3-40ad-9953-d95ab7dde70f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:48.078135 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad89bfd-87e3-40ad-9953-d95ab7dde70f admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:48.078834 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad89bfd-87e3-40ad-9953-d95ab7dde70f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:48.080782 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad89bfd-87e3-40ad-9953-d95ab7dde70f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:48.099591 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1235/2473] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:44:48 2022] POST /identity/v3/users => generated 288 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:44:48.103596 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf401ad-44c5-4957-9e5d-f6da87dc0cf5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:48.114559 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf401ad-44c5-4957-9e5d-f6da87dc0cf5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:48.119121 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f635438-0701-4632-8154-13272c32f615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:48.119766 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f635438-0701-4632-8154-13272c32f615 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:48.120047 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f635438-0701-4632-8154-13272c32f615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:48.120318 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f635438-0701-4632-8154-13272c32f615 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:48.121068 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f635438-0701-4632-8154-13272c32f615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:48.122660 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f635438-0701-4632-8154-13272c32f615 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:48.132622 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1239/2474] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:44:48.136346 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad89bfd-87e3-40ad-9953-d95ab7dde70f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:48.146302 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad89bfd-87e3-40ad-9953-d95ab7dde70f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:48.150842 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b845e64-022d-443e-9015-7b8a32e6217f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:48.151476 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b845e64-022d-443e-9015-7b8a32e6217f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:48.151758 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b845e64-022d-443e-9015-7b8a32e6217f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:48.152033 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b845e64-022d-443e-9015-7b8a32e6217f admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:48.152760 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b845e64-022d-443e-9015-7b8a32e6217f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:48.154926 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b845e64-022d-443e-9015-7b8a32e6217f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:48.164329 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1236/2475] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:44:48.167948 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f635438-0701-4632-8154-13272c32f615 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:48.178014 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f635438-0701-4632-8154-13272c32f615 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:48.182482 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e0078-aa2d-41a7-b666-1c903155a95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:48.183329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e0078-aa2d-41a7-b666-1c903155a95f admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:48.183609 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e0078-aa2d-41a7-b666-1c903155a95f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:48.183887 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e0078-aa2d-41a7-b666-1c903155a95f admin admin] PATH_INFO: `/v3/projects/5dfbfffad2b842599b7c61bb4c557933/users/f473cc1c8d82436a90c34e4c65906108/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:48.197708 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e0078-aa2d-41a7-b666-1c903155a95f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dfbfffad2b842599b7c61bb4c557933, user_id=f473cc1c8d82436a90c34e4c65906108, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:48.200853 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e0078-aa2d-41a7-b666-1c903155a95f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:48.213910 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1240/2476] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:44:48 2022] PUT /identity/v3/projects/5dfbfffad2b842599b7c61bb4c557933/users/f473cc1c8d82436a90c34e4c65906108/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:44:48.224693 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5305c-3f36-4f23-83d6-c6ef2dcfc193 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:48.224987 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5305c-3f36-4f23-83d6-c6ef2dcfc193 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:48.225305 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5305c-3f36-4f23-83d6-c6ef2dcfc193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:48.251161 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-5aa5305c-3f36-4f23-83d6-c6ef2dcfc193 None None] MFA Rules not processed for user `f473cc1c8d82436a90c34e4c65906108`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:44:48.252373 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-5aa5305c-3f36-4f23-83d6-c6ef2dcfc193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:48.321263 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1237/2477] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:44:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:44:48.331110 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e0078-aa2d-41a7-b666-1c903155a95f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:48.332826 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-945e0078-aa2d-41a7-b666-1c903155a95f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:48.386347 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e0078-aa2d-41a7-b666-1c903155a95f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:48.390533 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4923f-4257-4f94-8d7f-fbdc2dba6983 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:48.391192 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4923f-4257-4f94-8d7f-fbdc2dba6983 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:48.391461 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4923f-4257-4f94-8d7f-fbdc2dba6983 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:48.391740 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4923f-4257-4f94-8d7f-fbdc2dba6983 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:48.400370 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f4923f-4257-4f94-8d7f-fbdc2dba6983 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:48.401835 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f4923f-4257-4f94-8d7f-fbdc2dba6983 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:48.411113 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1241/2478] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:44:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:44:57.606604 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5305c-3f36-4f23-83d6-c6ef2dcfc193 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:57.666051 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5305c-3f36-4f23-83d6-c6ef2dcfc193 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:57.671149 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650b4be-3020-4232-b4e4-8d117175d2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:57.671998 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650b4be-3020-4232-b4e4-8d117175d2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:57.672277 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650b4be-3020-4232-b4e4-8d117175d2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:57.672549 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7650b4be-3020-4232-b4e4-8d117175d2ee admin admin] PATH_INFO: `/v3/users/f473cc1c8d82436a90c34e4c65906108` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:57.673750 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650b4be-3020-4232-b4e4-8d117175d2ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f473cc1c8d82436a90c34e4c65906108)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:57.675654 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7650b4be-3020-4232-b4e4-8d117175d2ee admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:57.719115 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7650b4be-3020-4232-b4e4-8d117175d2ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f473cc1c8d82436a90c34e4c65906108'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:57.725564 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7650b4be-3020-4232-b4e4-8d117175d2ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f473cc1c8d82436a90c34e4c65906108'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:57.726212 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7650b4be-3020-4232-b4e4-8d117175d2ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f473cc1c8d82436a90c34e4c65906108'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:57.737655 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7650b4be-3020-4232-b4e4-8d117175d2ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f473cc1c8d82436a90c34e4c65906108'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:57.744420 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7650b4be-3020-4232-b4e4-8d117175d2ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f473cc1c8d82436a90c34e4c65906108'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:57.752759 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1238/2479] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:44:57 2022] DELETE /identity/v3/users/f473cc1c8d82436a90c34e4c65906108 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:44:57.757398 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4aa2a-42fd-4cd4-a778-feee9e49d959 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:57.757881 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4aa2a-42fd-4cd4-a778-feee9e49d959 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:57.757985 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4aa2a-42fd-4cd4-a778-feee9e49d959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:57.775891 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-e6f4aa2a-42fd-4cd4-a778-feee9e49d959 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:44:57.777121 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e6f4aa2a-42fd-4cd4-a778-feee9e49d959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:57.832401 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1242/2480] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:44:57.842441 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650b4be-3020-4232-b4e4-8d117175d2ee admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:57.843802 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7650b4be-3020-4232-b4e4-8d117175d2ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:57.898436 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7650b4be-3020-4232-b4e4-8d117175d2ee admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:57.903461 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80cb21c-3111-4b21-a166-9491d99a180a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:57.904099 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cb21c-3111-4b21-a166-9491d99a180a service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:57.904381 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cb21c-3111-4b21-a166-9491d99a180a service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:57.904655 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cb21c-3111-4b21-a166-9491d99a180a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:57.913597 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80cb21c-3111-4b21-a166-9491d99a180a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:57.915016 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80cb21c-3111-4b21-a166-9491d99a180a service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:57.925872 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1239/2481] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:44:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:44:58.188628 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4aa2a-42fd-4cd4-a778-feee9e49d959 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:58.190072 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e6f4aa2a-42fd-4cd4-a778-feee9e49d959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:58.204820 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4aa2a-42fd-4cd4-a778-feee9e49d959 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:58.210907 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b7f54-a750-47a8-b85e-e8c46d9363ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:58.211830 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b7f54-a750-47a8-b85e-e8c46d9363ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:58.212117 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b7f54-a750-47a8-b85e-e8c46d9363ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:58.212403 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b7f54-a750-47a8-b85e-e8c46d9363ac admin admin] PATH_INFO: `/v3/projects/5dfbfffad2b842599b7c61bb4c557933` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:58.213741 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b7f54-a750-47a8-b85e-e8c46d9363ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dfbfffad2b842599b7c61bb4c557933)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:58.216405 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b7f54-a750-47a8-b85e-e8c46d9363ac admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:58.265807 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-125b7f54-a750-47a8-b85e-e8c46d9363ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dfbfffad2b842599b7c61bb4c557933', 'request_id': 'req-125b7f54-a750-47a8-b85e-e8c46d9363ac'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:58.272309 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-125b7f54-a750-47a8-b85e-e8c46d9363ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dfbfffad2b842599b7c61bb4c557933', 'request_id': 'req-125b7f54-a750-47a8-b85e-e8c46d9363ac'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:58.280475 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-125b7f54-a750-47a8-b85e-e8c46d9363ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dfbfffad2b842599b7c61bb4c557933', 'request_id': 'req-125b7f54-a750-47a8-b85e-e8c46d9363ac'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:58.292557 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-125b7f54-a750-47a8-b85e-e8c46d9363ac admin admin] The token cache is being invalidate because project 5dfbfffad2b842599b7c61bb4c557933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:44:58.292873 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-125b7f54-a750-47a8-b85e-e8c46d9363ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:58.293663 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-125b7f54-a750-47a8-b85e-e8c46d9363ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:58.295490 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1243/2482] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:44:58 2022] DELETE /identity/v3/projects/5dfbfffad2b842599b7c61bb4c557933 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:44:58.303533 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e36ac2-8019-4835-ade8-8e42de965713 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:58.303774 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e36ac2-8019-4835-ade8-8e42de965713 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:58.304113 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e36ac2-8019-4835-ade8-8e42de965713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:58.321522 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-38e36ac2-8019-4835-ade8-8e42de965713 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:44:58.322746 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-38e36ac2-8019-4835-ade8-8e42de965713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:58.387703 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1240/2483] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:44:58.396429 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022849b-b777-462d-809c-fc379b7f6845 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:58.396718 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022849b-b777-462d-809c-fc379b7f6845 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:58.396995 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022849b-b777-462d-809c-fc379b7f6845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:58.416269 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-8022849b-b777-462d-809c-fc379b7f6845 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:44:58.417546 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8022849b-b777-462d-809c-fc379b7f6845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:58.426073 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1244/2484] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:44:58.430177 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e36ac2-8019-4835-ade8-8e42de965713 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:58.440549 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e36ac2-8019-4835-ade8-8e42de965713 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:58.445612 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede7475-2f38-457e-854f-b4f90724060f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:58.446272 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede7475-2f38-457e-854f-b4f90724060f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:58.446559 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede7475-2f38-457e-854f-b4f90724060f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:58.446883 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede7475-2f38-457e-854f-b4f90724060f admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:58.447601 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede7475-2f38-457e-854f-b4f90724060f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:44:58.447910 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede7475-2f38-457e-854f-b4f90724060f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:58.450105 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede7475-2f38-457e-854f-b4f90724060f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:58.463393 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1241/2485] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:44:58.467496 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022849b-b777-462d-809c-fc379b7f6845 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:58.477068 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022849b-b777-462d-809c-fc379b7f6845 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:58.481892 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb90cf-3064-46f7-82eb-3258d20d60d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:58.482555 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb90cf-3064-46f7-82eb-3258d20d60d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:58.482841 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb90cf-3064-46f7-82eb-3258d20d60d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:58.483119 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb90cf-3064-46f7-82eb-3258d20d60d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:58.483840 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb90cf-3064-46f7-82eb-3258d20d60d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:58.485819 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eb90cf-3064-46f7-82eb-3258d20d60d9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:58.517107 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1245/2486] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:44:58 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:44:58.518733 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede7475-2f38-457e-854f-b4f90724060f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:58.528683 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede7475-2f38-457e-854f-b4f90724060f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:58.582057 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646025c8-1b3c-48cd-bc03-ac8bbf7f2b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:58.582730 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646025c8-1b3c-48cd-bc03-ac8bbf7f2b25 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:58.583014 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646025c8-1b3c-48cd-bc03-ac8bbf7f2b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:58.583369 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646025c8-1b3c-48cd-bc03-ac8bbf7f2b25 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:58.583993 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646025c8-1b3c-48cd-bc03-ac8bbf7f2b25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:58.585935 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646025c8-1b3c-48cd-bc03-ac8bbf7f2b25 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:58.603934 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1242/2487] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:44:58 2022] POST /identity/v3/users => generated 287 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:44:58.608028 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb90cf-3064-46f7-82eb-3258d20d60d9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:58.618003 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb90cf-3064-46f7-82eb-3258d20d60d9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:58.623082 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a09209-9512-4580-be00-3f29fca47dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:58.623732 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a09209-9512-4580-be00-3f29fca47dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:58.624016 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a09209-9512-4580-be00-3f29fca47dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:58.624298 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a09209-9512-4580-be00-3f29fca47dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:58.625059 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a09209-9512-4580-be00-3f29fca47dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:58.626660 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a09209-9512-4580-be00-3f29fca47dd5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:58.636668 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1246/2488] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:44:58.640884 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646025c8-1b3c-48cd-bc03-ac8bbf7f2b25 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:58.650661 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646025c8-1b3c-48cd-bc03-ac8bbf7f2b25 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:58.655247 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df1e10-797e-4681-a608-d402626e7aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:58.655886 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df1e10-797e-4681-a608-d402626e7aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:58.656171 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df1e10-797e-4681-a608-d402626e7aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:58.656450 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df1e10-797e-4681-a608-d402626e7aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:58.657210 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df1e10-797e-4681-a608-d402626e7aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:58.658797 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df1e10-797e-4681-a608-d402626e7aa1 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:58.668264 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1243/2489] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:44:58.672035 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a09209-9512-4580-be00-3f29fca47dd5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:58.681821 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a09209-9512-4580-be00-3f29fca47dd5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:58.687183 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3fddd-759c-4fd6-bbbb-ab3775733589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:58.688036 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3fddd-759c-4fd6-bbbb-ab3775733589 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:58.688335 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3fddd-759c-4fd6-bbbb-ab3775733589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:58.688611 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3fddd-759c-4fd6-bbbb-ab3775733589 admin admin] PATH_INFO: `/v3/projects/4a683a336a734ffc9ec25b67b85f16e3/users/80627e13d15e42458634ba64a1e22b2a/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:58.704334 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3fddd-759c-4fd6-bbbb-ab3775733589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a683a336a734ffc9ec25b67b85f16e3, user_id=80627e13d15e42458634ba64a1e22b2a, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:58.707027 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3fddd-759c-4fd6-bbbb-ab3775733589 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:58.720058 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1247/2490] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:44:58 2022] PUT /identity/v3/projects/4a683a336a734ffc9ec25b67b85f16e3/users/80627e13d15e42458634ba64a1e22b2a/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:44:58.731094 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04163e39-67aa-423d-9718-5bc7383fc695 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:58.731402 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04163e39-67aa-423d-9718-5bc7383fc695 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:58.731683 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04163e39-67aa-423d-9718-5bc7383fc695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:58.757890 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-04163e39-67aa-423d-9718-5bc7383fc695 None None] MFA Rules not processed for user `80627e13d15e42458634ba64a1e22b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:44:58.759097 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-04163e39-67aa-423d-9718-5bc7383fc695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:58.819889 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1244/2491] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:44:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:44:58.829873 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3fddd-759c-4fd6-bbbb-ab3775733589 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:58.831563 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-74c3fddd-759c-4fd6-bbbb-ab3775733589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:58.885315 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3fddd-759c-4fd6-bbbb-ab3775733589 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:58.888846 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1493c-ff34-4b9b-a22a-78f3350e0e67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:58.889508 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1493c-ff34-4b9b-a22a-78f3350e0e67 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:58.889808 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1493c-ff34-4b9b-a22a-78f3350e0e67 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:58.890066 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1493c-ff34-4b9b-a22a-78f3350e0e67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:58.898297 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1493c-ff34-4b9b-a22a-78f3350e0e67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:58.899722 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1493c-ff34-4b9b-a22a-78f3350e0e67 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:58.908223 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1248/2492] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:44:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:44:58.932156 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04163e39-67aa-423d-9718-5bc7383fc695 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:58.992511 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04163e39-67aa-423d-9718-5bc7383fc695 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:58.997786 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4519b-b26c-46f8-812b-44af876935c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:58.998643 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4519b-b26c-46f8-812b-44af876935c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:58.998923 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4519b-b26c-46f8-812b-44af876935c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:58.999192 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4519b-b26c-46f8-812b-44af876935c2 admin admin] PATH_INFO: `/v3/users/80627e13d15e42458634ba64a1e22b2a` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:59.000381 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4519b-b26c-46f8-812b-44af876935c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80627e13d15e42458634ba64a1e22b2a)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:59.002364 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb4519b-b26c-46f8-812b-44af876935c2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:59.051108 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3bb4519b-b26c-46f8-812b-44af876935c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80627e13d15e42458634ba64a1e22b2a'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:59.057710 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3bb4519b-b26c-46f8-812b-44af876935c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80627e13d15e42458634ba64a1e22b2a'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:59.058392 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3bb4519b-b26c-46f8-812b-44af876935c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80627e13d15e42458634ba64a1e22b2a'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:59.070373 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3bb4519b-b26c-46f8-812b-44af876935c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80627e13d15e42458634ba64a1e22b2a'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:59.077381 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3bb4519b-b26c-46f8-812b-44af876935c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80627e13d15e42458634ba64a1e22b2a'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:59.083220 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1245/2493] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:44:58 2022] DELETE /identity/v3/users/80627e13d15e42458634ba64a1e22b2a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:44:59.087772 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5cee4-db57-4b9a-a0bc-ef2688964552 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:59.088060 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5cee4-db57-4b9a-a0bc-ef2688964552 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:59.088335 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5cee4-db57-4b9a-a0bc-ef2688964552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:59.106345 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-35f5cee4-db57-4b9a-a0bc-ef2688964552 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:44:59.107533 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-35f5cee4-db57-4b9a-a0bc-ef2688964552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:59.165977 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1249/2494] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:44:59.179308 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4519b-b26c-46f8-812b-44af876935c2 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:59.180781 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-3bb4519b-b26c-46f8-812b-44af876935c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:59.246871 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4519b-b26c-46f8-812b-44af876935c2 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:59.251589 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3772162-8028-4391-a51d-21fdb240a229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:59.252321 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3772162-8028-4391-a51d-21fdb240a229 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:59.252605 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3772162-8028-4391-a51d-21fdb240a229 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:59.252887 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3772162-8028-4391-a51d-21fdb240a229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:59.263175 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3772162-8028-4391-a51d-21fdb240a229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:59.264610 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3772162-8028-4391-a51d-21fdb240a229 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:59.274883 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1246/2495] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:44:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:44:59.546517 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5cee4-db57-4b9a-a0bc-ef2688964552 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:59.546680 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-35f5cee4-db57-4b9a-a0bc-ef2688964552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:59.569661 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5cee4-db57-4b9a-a0bc-ef2688964552 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:59.576791 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c9ddb-edba-4623-ac0a-1268ccc90a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:59.577693 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c9ddb-edba-4623-ac0a-1268ccc90a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:59.577975 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c9ddb-edba-4623-ac0a-1268ccc90a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:59.578250 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c9ddb-edba-4623-ac0a-1268ccc90a4b admin admin] PATH_INFO: `/v3/projects/4a683a336a734ffc9ec25b67b85f16e3` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:59.579458 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c9ddb-edba-4623-ac0a-1268ccc90a4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a683a336a734ffc9ec25b67b85f16e3)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:59.581425 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c9ddb-edba-4623-ac0a-1268ccc90a4b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:59.628848 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9a8c9ddb-edba-4623-ac0a-1268ccc90a4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a683a336a734ffc9ec25b67b85f16e3', 'request_id': 'req-9a8c9ddb-edba-4623-ac0a-1268ccc90a4b'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:59.635042 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9a8c9ddb-edba-4623-ac0a-1268ccc90a4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a683a336a734ffc9ec25b67b85f16e3', 'request_id': 'req-9a8c9ddb-edba-4623-ac0a-1268ccc90a4b'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:59.642527 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9a8c9ddb-edba-4623-ac0a-1268ccc90a4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a683a336a734ffc9ec25b67b85f16e3', 'request_id': 'req-9a8c9ddb-edba-4623-ac0a-1268ccc90a4b'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:59.654747 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9a8c9ddb-edba-4623-ac0a-1268ccc90a4b admin admin] The token cache is being invalidate because project 4a683a336a734ffc9ec25b67b85f16e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:44:59.655038 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9a8c9ddb-edba-4623-ac0a-1268ccc90a4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:59.655674 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-9a8c9ddb-edba-4623-ac0a-1268ccc90a4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:44:59.657632 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1250/2496] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:44:59 2022] DELETE /identity/v3/projects/4a683a336a734ffc9ec25b67b85f16e3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:44:59.663310 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82319a79-365a-49d8-b98d-2870b78e5a58 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:59.663821 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82319a79-365a-49d8-b98d-2870b78e5a58 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:59.663821 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82319a79-365a-49d8-b98d-2870b78e5a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:59.683774 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-82319a79-365a-49d8-b98d-2870b78e5a58 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:44:59.685038 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-82319a79-365a-49d8-b98d-2870b78e5a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:59.742663 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1247/2497] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:44:59.750585 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566376f-8e65-410c-bde4-aa79fdd06259 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:59.750883 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566376f-8e65-410c-bde4-aa79fdd06259 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:59.751170 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566376f-8e65-410c-bde4-aa79fdd06259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:59.770041 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-8566376f-8e65-410c-bde4-aa79fdd06259 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:44:59.771255 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8566376f-8e65-410c-bde4-aa79fdd06259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:44:59.779763 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1251/2498] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:44:59.784033 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82319a79-365a-49d8-b98d-2870b78e5a58 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:59.793433 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82319a79-365a-49d8-b98d-2870b78e5a58 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:59.798003 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ac7a7-3071-4bfb-8a99-6a82b4b3f2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:59.798664 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ac7a7-3071-4bfb-8a99-6a82b4b3f2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:59.798948 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ac7a7-3071-4bfb-8a99-6a82b4b3f2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:59.799225 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ac7a7-3071-4bfb-8a99-6a82b4b3f2e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:59.799979 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ac7a7-3071-4bfb-8a99-6a82b4b3f2e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:44:59.800287 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ac7a7-3071-4bfb-8a99-6a82b4b3f2e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:59.802884 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ac7a7-3071-4bfb-8a99-6a82b4b3f2e5 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:59.816283 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1248/2499] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:44:59.820324 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566376f-8e65-410c-bde4-aa79fdd06259 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:59.829984 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566376f-8e65-410c-bde4-aa79fdd06259 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:59.834798 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24612f6c-3756-4767-bbfe-7682745733ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:59.835281 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24612f6c-3756-4767-bbfe-7682745733ed admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:59.835559 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24612f6c-3756-4767-bbfe-7682745733ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:59.835828 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24612f6c-3756-4767-bbfe-7682745733ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:59.836525 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24612f6c-3756-4767-bbfe-7682745733ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:59.838443 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24612f6c-3756-4767-bbfe-7682745733ed admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:59.864006 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1252/2500] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:44:59 2022] POST /identity/v3/projects => generated 389 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:44:59.868000 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ac7a7-3071-4bfb-8a99-6a82b4b3f2e5 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:59.878171 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ac7a7-3071-4bfb-8a99-6a82b4b3f2e5 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:59.932817 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c40885-481a-4621-8c39-ff3e7325c95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:59.933431 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c40885-481a-4621-8c39-ff3e7325c95d admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:59.934245 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c40885-481a-4621-8c39-ff3e7325c95d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:59.934514 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c40885-481a-4621-8c39-ff3e7325c95d admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:59.935208 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c40885-481a-4621-8c39-ff3e7325c95d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:59.937201 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c40885-481a-4621-8c39-ff3e7325c95d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:59.956660 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1249/2501] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:44:59 2022] POST /identity/v3/users => generated 295 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:44:59.960647 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24612f6c-3756-4767-bbfe-7682745733ed admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:44:59.970554 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24612f6c-3756-4767-bbfe-7682745733ed admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:44:59.975090 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271fb60-a493-462b-b66a-5409ee7e008c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:44:59.975735 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271fb60-a493-462b-b66a-5409ee7e008c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:44:59.976019 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271fb60-a493-462b-b66a-5409ee7e008c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:44:59.976292 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a271fb60-a493-462b-b66a-5409ee7e008c admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:44:59.977046 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271fb60-a493-462b-b66a-5409ee7e008c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:44:59.978631 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a271fb60-a493-462b-b66a-5409ee7e008c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:44:59.988957 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1253/2502] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:44:59.993047 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c40885-481a-4621-8c39-ff3e7325c95d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:00.003448 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c40885-481a-4621-8c39-ff3e7325c95d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:00.007989 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2223b1-66a3-4130-81ad-05abfbbf1dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:00.008624 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2223b1-66a3-4130-81ad-05abfbbf1dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:00.008901 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2223b1-66a3-4130-81ad-05abfbbf1dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:00.009204 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2223b1-66a3-4130-81ad-05abfbbf1dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:00.009932 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2223b1-66a3-4130-81ad-05abfbbf1dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:00.011485 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2223b1-66a3-4130-81ad-05abfbbf1dd2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:00.021677 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1250/2503] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:45:00.025622 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271fb60-a493-462b-b66a-5409ee7e008c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:00.035272 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a271fb60-a493-462b-b66a-5409ee7e008c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:00.039887 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab380a-9007-4c7d-8faa-9f0862eb64d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:00.040753 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab380a-9007-4c7d-8faa-9f0862eb64d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:00.041074 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab380a-9007-4c7d-8faa-9f0862eb64d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:00.041356 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab380a-9007-4c7d-8faa-9f0862eb64d1 admin admin] PATH_INFO: `/v3/projects/d6fd753505ec4cc28d986449ad198242/users/508b1ad8e8fe4a43b55b7f58c8e3828a/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:00.055135 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab380a-9007-4c7d-8faa-9f0862eb64d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6fd753505ec4cc28d986449ad198242, user_id=508b1ad8e8fe4a43b55b7f58c8e3828a, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:00.057846 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab380a-9007-4c7d-8faa-9f0862eb64d1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:00.071081 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1254/2504] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:45:00 2022] PUT /identity/v3/projects/d6fd753505ec4cc28d986449ad198242/users/508b1ad8e8fe4a43b55b7f58c8e3828a/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:45:00.082776 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d93426-71c6-4d49-afe4-b6c84bcb1cb6 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:00.083064 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d93426-71c6-4d49-afe4-b6c84bcb1cb6 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:00.083341 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d93426-71c6-4d49-afe4-b6c84bcb1cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:00.109164 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-c4d93426-71c6-4d49-afe4-b6c84bcb1cb6 None None] MFA Rules not processed for user `508b1ad8e8fe4a43b55b7f58c8e3828a`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:45:00.110371 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-c4d93426-71c6-4d49-afe4-b6c84bcb1cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:00.173107 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1251/2505] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:45:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:45:00.182928 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab380a-9007-4c7d-8faa-9f0862eb64d1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:00.185195 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-06ab380a-9007-4c7d-8faa-9f0862eb64d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:00.240010 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab380a-9007-4c7d-8faa-9f0862eb64d1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:00.243637 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1730820-f678-4717-81fb-92519dc976c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:00.244274 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1730820-f678-4717-81fb-92519dc976c0 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:00.244559 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1730820-f678-4717-81fb-92519dc976c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:00.244835 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1730820-f678-4717-81fb-92519dc976c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:00.254580 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1730820-f678-4717-81fb-92519dc976c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:00.256180 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1730820-f678-4717-81fb-92519dc976c0 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:00.265271 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1255/2506] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:45:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:45:00.964332 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d93426-71c6-4d49-afe4-b6c84bcb1cb6 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:00.965801 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-c4d93426-71c6-4d49-afe4-b6c84bcb1cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:01.019772 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d93426-71c6-4d49-afe4-b6c84bcb1cb6 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:01.023294 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257e3b3-51c1-43db-9e58-815ce417fcab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:01.023926 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257e3b3-51c1-43db-9e58-815ce417fcab service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:01.024207 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257e3b3-51c1-43db-9e58-815ce417fcab service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:01.024483 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257e3b3-51c1-43db-9e58-815ce417fcab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:01.026229 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-6257e3b3-51c1-43db-9e58-815ce417fcab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:01.091791 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257e3b3-51c1-43db-9e58-815ce417fcab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:01.093167 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257e3b3-51c1-43db-9e58-815ce417fcab service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:01.103682 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1252/2507] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:45:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:45:02.224497 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1730820-f678-4717-81fb-92519dc976c0 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:02.226298 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e1730820-f678-4717-81fb-92519dc976c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:02.239808 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1730820-f678-4717-81fb-92519dc976c0 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:02.243421 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee27fe-6d61-4d7e-9db5-82f8593158eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:02.244060 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee27fe-6d61-4d7e-9db5-82f8593158eb service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:02.244343 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee27fe-6d61-4d7e-9db5-82f8593158eb service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:02.244620 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee27fe-6d61-4d7e-9db5-82f8593158eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:02.246424 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-29ee27fe-6d61-4d7e-9db5-82f8593158eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:02.259481 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee27fe-6d61-4d7e-9db5-82f8593158eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:02.260904 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee27fe-6d61-4d7e-9db5-82f8593158eb service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:02.272150 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1256/2508] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:45:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:45:02.533290 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257e3b3-51c1-43db-9e58-815ce417fcab service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:02.535740 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-6257e3b3-51c1-43db-9e58-815ce417fcab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:02.596793 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257e3b3-51c1-43db-9e58-815ce417fcab service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:02.601307 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebed83-5301-4a7d-9466-5cc1fdc1eda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:02.602157 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebed83-5301-4a7d-9466-5cc1fdc1eda4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:02.602436 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebed83-5301-4a7d-9466-5cc1fdc1eda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:02.602707 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebed83-5301-4a7d-9466-5cc1fdc1eda4 admin admin] PATH_INFO: `/v3/users/4dac6d7e81234d0aa933ea1f00459461` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:02.603987 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feebed83-5301-4a7d-9466-5cc1fdc1eda4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dac6d7e81234d0aa933ea1f00459461)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:02.605923 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feebed83-5301-4a7d-9466-5cc1fdc1eda4 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:02.648830 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-feebed83-5301-4a7d-9466-5cc1fdc1eda4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dac6d7e81234d0aa933ea1f00459461'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:45:02.655800 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-feebed83-5301-4a7d-9466-5cc1fdc1eda4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dac6d7e81234d0aa933ea1f00459461'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:45:02.656442 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-feebed83-5301-4a7d-9466-5cc1fdc1eda4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dac6d7e81234d0aa933ea1f00459461'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:45:02.667393 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-feebed83-5301-4a7d-9466-5cc1fdc1eda4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dac6d7e81234d0aa933ea1f00459461'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:45:02.674555 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-feebed83-5301-4a7d-9466-5cc1fdc1eda4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dac6d7e81234d0aa933ea1f00459461'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:45:02.680330 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1253/2509] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:45:02 2022] DELETE /identity/v3/users/4dac6d7e81234d0aa933ea1f00459461 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:45:02.684837 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeddcd-9a37-4ee8-ab6e-a68ddcc6e9c9 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:02.685257 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeddcd-9a37-4ee8-ab6e-a68ddcc6e9c9 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:02.685801 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeddcd-9a37-4ee8-ab6e-a68ddcc6e9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:02.704212 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-60eeddcd-9a37-4ee8-ab6e-a68ddcc6e9c9 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:45:02.705437 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-60eeddcd-9a37-4ee8-ab6e-a68ddcc6e9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:02.762998 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1257/2510] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:45:02.772793 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebed83-5301-4a7d-9466-5cc1fdc1eda4 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:02.774211 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-feebed83-5301-4a7d-9466-5cc1fdc1eda4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:02.829712 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebed83-5301-4a7d-9466-5cc1fdc1eda4 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:02.833379 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f394e8-f2a1-4271-8d01-245cd772d6ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:02.834024 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f394e8-f2a1-4271-8d01-245cd772d6ed service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:02.834309 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f394e8-f2a1-4271-8d01-245cd772d6ed service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:02.834608 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f394e8-f2a1-4271-8d01-245cd772d6ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:02.844235 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f394e8-f2a1-4271-8d01-245cd772d6ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:02.845729 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f394e8-f2a1-4271-8d01-245cd772d6ed service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:02.855186 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1254/2511] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:45:03.107566 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eeddcd-9a37-4ee8-ab6e-a68ddcc6e9c9 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:03.109077 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-60eeddcd-9a37-4ee8-ab6e-a68ddcc6e9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:03.121729 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eeddcd-9a37-4ee8-ab6e-a68ddcc6e9c9 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:03.126392 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04530a45-d8fe-47b3-8782-74b5e596125a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:03.127709 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04530a45-d8fe-47b3-8782-74b5e596125a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:03.128003 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04530a45-d8fe-47b3-8782-74b5e596125a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:03.128439 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04530a45-d8fe-47b3-8782-74b5e596125a admin admin] PATH_INFO: `/v3/projects/7ac71114ae494f2782f00eb9b98a4598` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:03.129766 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04530a45-d8fe-47b3-8782-74b5e596125a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ac71114ae494f2782f00eb9b98a4598)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:03.131638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04530a45-d8fe-47b3-8782-74b5e596125a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:03.178799 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-04530a45-d8fe-47b3-8782-74b5e596125a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ac71114ae494f2782f00eb9b98a4598', 'request_id': 'req-04530a45-d8fe-47b3-8782-74b5e596125a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:45:03.185435 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-04530a45-d8fe-47b3-8782-74b5e596125a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ac71114ae494f2782f00eb9b98a4598', 'request_id': 'req-04530a45-d8fe-47b3-8782-74b5e596125a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:45:03.193617 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-04530a45-d8fe-47b3-8782-74b5e596125a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ac71114ae494f2782f00eb9b98a4598', 'request_id': 'req-04530a45-d8fe-47b3-8782-74b5e596125a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:45:03.204077 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-04530a45-d8fe-47b3-8782-74b5e596125a admin admin] The token cache is being invalidate because project 7ac71114ae494f2782f00eb9b98a4598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:45:03.204366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-04530a45-d8fe-47b3-8782-74b5e596125a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:45:03.204986 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-04530a45-d8fe-47b3-8782-74b5e596125a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:45:03.206615 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1258/2512] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:45:03 2022] DELETE /identity/v3/projects/7ac71114ae494f2782f00eb9b98a4598 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:45:25.567729 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ea57d-c8b6-40df-a878-847607566508 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:25.568262 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ea57d-c8b6-40df-a878-847607566508 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:25.568358 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ea57d-c8b6-40df-a878-847607566508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:25.585656 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-e52ea57d-c8b6-40df-a878-847607566508 None None] MFA Rules not processed for user `48e475a79c524d6d9829c148bdec7d08`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:45:25.586833 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-e52ea57d-c8b6-40df-a878-847607566508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:25.638623 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1255/2513] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:45:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:45:25.860182 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04530a45-d8fe-47b3-8782-74b5e596125a admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:25.861667 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-04530a45-d8fe-47b3-8782-74b5e596125a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:25.929417 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04530a45-d8fe-47b3-8782-74b5e596125a admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:25.932976 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50170a0-325f-4443-8b40-63d65e756893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:25.934308 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50170a0-325f-4443-8b40-63d65e756893 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:25.934591 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50170a0-325f-4443-8b40-63d65e756893 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:25.934866 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50170a0-325f-4443-8b40-63d65e756893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:25.936671 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d50170a0-325f-4443-8b40-63d65e756893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:25.946010 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50170a0-325f-4443-8b40-63d65e756893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:25.947440 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50170a0-325f-4443-8b40-63d65e756893 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:25.955175 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1259/2514] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:45:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:45:26.258721 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ea57d-c8b6-40df-a878-847607566508 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:26.261575 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-e52ea57d-c8b6-40df-a878-847607566508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:26.356038 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ea57d-c8b6-40df-a878-847607566508 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:26.364929 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f7779-cb4c-450d-8d84-19a06467dd15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add56fc0cfd8403b86c5ef23fd374a5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:26.365586 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f7779-cb4c-450d-8d84-19a06467dd15 service placement] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:26.365866 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f7779-cb4c-450d-8d84-19a06467dd15 service placement] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:26.366145 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f7779-cb4c-450d-8d84-19a06467dd15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:26.367925 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-6f4f7779-cb4c-450d-8d84-19a06467dd15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:26.379561 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f7779-cb4c-450d-8d84-19a06467dd15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:26.381087 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f7779-cb4c-450d-8d84-19a06467dd15 service placement] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:26.391296 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1256/2515] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:45:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:45:28.605339 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50170a0-325f-4443-8b40-63d65e756893 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:28.606799 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d50170a0-325f-4443-8b40-63d65e756893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:28.617554 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50170a0-325f-4443-8b40-63d65e756893 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:28.622640 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdd1d8-10f3-4be0-a7d6-8b33f0bf9dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:28.623291 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdd1d8-10f3-4be0-a7d6-8b33f0bf9dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:28.623632 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdd1d8-10f3-4be0-a7d6-8b33f0bf9dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:28.623917 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdd1d8-10f3-4be0-a7d6-8b33f0bf9dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:28.625791 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b1bdd1d8-10f3-4be0-a7d6-8b33f0bf9dd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:28.635937 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdd1d8-10f3-4be0-a7d6-8b33f0bf9dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:28.638543 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdd1d8-10f3-4be0-a7d6-8b33f0bf9dd6 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:28.649139 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1260/2516] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:45:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:45:29.619995 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f7779-cb4c-450d-8d84-19a06467dd15 service placement] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:29.621457 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-6f4f7779-cb4c-450d-8d84-19a06467dd15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:29.684037 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f7779-cb4c-450d-8d84-19a06467dd15 service placement] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:29.688651 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb3039-8b1d-4005-b4e7-910c3504a1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:29.689545 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb3039-8b1d-4005-b4e7-910c3504a1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:29.689823 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb3039-8b1d-4005-b4e7-910c3504a1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:29.690096 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb3039-8b1d-4005-b4e7-910c3504a1c3 admin admin] PATH_INFO: `/v3/users/508b1ad8e8fe4a43b55b7f58c8e3828a` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:29.691396 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb3039-8b1d-4005-b4e7-910c3504a1c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=508b1ad8e8fe4a43b55b7f58c8e3828a)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:29.693348 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb3039-8b1d-4005-b4e7-910c3504a1c3 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:29.742722 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9ebb3039-8b1d-4005-b4e7-910c3504a1c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '508b1ad8e8fe4a43b55b7f58c8e3828a'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:45:29.749288 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9ebb3039-8b1d-4005-b4e7-910c3504a1c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '508b1ad8e8fe4a43b55b7f58c8e3828a'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:45:29.749945 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9ebb3039-8b1d-4005-b4e7-910c3504a1c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '508b1ad8e8fe4a43b55b7f58c8e3828a'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:45:29.761111 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9ebb3039-8b1d-4005-b4e7-910c3504a1c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '508b1ad8e8fe4a43b55b7f58c8e3828a'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:45:29.769524 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9ebb3039-8b1d-4005-b4e7-910c3504a1c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '508b1ad8e8fe4a43b55b7f58c8e3828a'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:45:29.775537 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1257/2517] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:45:29 2022] DELETE /identity/v3/users/508b1ad8e8fe4a43b55b7f58c8e3828a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:45:29.780555 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bcf1c-f60e-4237-aed1-15e8c7f6f300 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:29.781121 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bcf1c-f60e-4237-aed1-15e8c7f6f300 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:29.781222 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081bcf1c-f60e-4237-aed1-15e8c7f6f300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:29.928795 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-081bcf1c-f60e-4237-aed1-15e8c7f6f300 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:45:29.930024 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-081bcf1c-f60e-4237-aed1-15e8c7f6f300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:29.987008 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1261/2518] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:45:29.997219 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb3039-8b1d-4005-b4e7-910c3504a1c3 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:29.998586 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-9ebb3039-8b1d-4005-b4e7-910c3504a1c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:30.055414 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb3039-8b1d-4005-b4e7-910c3504a1c3 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:30.059473 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fdcd2-3b3b-4e75-b4fe-d46cdd702027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:30.060104 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fdcd2-3b3b-4e75-b4fe-d46cdd702027 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:30.060383 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fdcd2-3b3b-4e75-b4fe-d46cdd702027 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:30.060653 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fdcd2-3b3b-4e75-b4fe-d46cdd702027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:30.069316 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553fdcd2-3b3b-4e75-b4fe-d46cdd702027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:30.070735 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553fdcd2-3b3b-4e75-b4fe-d46cdd702027 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:30.080493 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1258/2519] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:45:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:45:30.341138 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081bcf1c-f60e-4237-aed1-15e8c7f6f300 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:30.342711 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-081bcf1c-f60e-4237-aed1-15e8c7f6f300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:30.354857 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081bcf1c-f60e-4237-aed1-15e8c7f6f300 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:30.359978 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f35d90-87fb-40d4-a88e-c98a7efb76a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:30.360824 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f35d90-87fb-40d4-a88e-c98a7efb76a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:30.361133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f35d90-87fb-40d4-a88e-c98a7efb76a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:30.361406 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f35d90-87fb-40d4-a88e-c98a7efb76a6 admin admin] PATH_INFO: `/v3/projects/d6fd753505ec4cc28d986449ad198242` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:30.362599 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f35d90-87fb-40d4-a88e-c98a7efb76a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6fd753505ec4cc28d986449ad198242)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:30.364514 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f35d90-87fb-40d4-a88e-c98a7efb76a6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:30.409126 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-54f35d90-87fb-40d4-a88e-c98a7efb76a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6fd753505ec4cc28d986449ad198242', 'request_id': 'req-54f35d90-87fb-40d4-a88e-c98a7efb76a6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:45:30.415565 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-54f35d90-87fb-40d4-a88e-c98a7efb76a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6fd753505ec4cc28d986449ad198242', 'request_id': 'req-54f35d90-87fb-40d4-a88e-c98a7efb76a6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:45:30.422936 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-54f35d90-87fb-40d4-a88e-c98a7efb76a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6fd753505ec4cc28d986449ad198242', 'request_id': 'req-54f35d90-87fb-40d4-a88e-c98a7efb76a6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:45:30.433076 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-54f35d90-87fb-40d4-a88e-c98a7efb76a6 admin admin] The token cache is being invalidate because project d6fd753505ec4cc28d986449ad198242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:45:30.433932 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-54f35d90-87fb-40d4-a88e-c98a7efb76a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:45:30.434535 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-54f35d90-87fb-40d4-a88e-c98a7efb76a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:45:30.436074 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1262/2520] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:45:30 2022] DELETE /identity/v3/projects/d6fd753505ec4cc28d986449ad198242 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:45:30.441743 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534d027-6873-4b27-9f9a-dba6a2e8d8c4 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:30.442032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534d027-6873-4b27-9f9a-dba6a2e8d8c4 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:30.442311 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534d027-6873-4b27-9f9a-dba6a2e8d8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:30.459668 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-c534d027-6873-4b27-9f9a-dba6a2e8d8c4 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:45:30.460848 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-c534d027-6873-4b27-9f9a-dba6a2e8d8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:30.516090 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1259/2521] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:45:30.523887 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3521e-f083-4098-8978-d5d764ef4269 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:30.524175 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3521e-f083-4098-8978-d5d764ef4269 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:30.524452 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3521e-f083-4098-8978-d5d764ef4269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:30.541881 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-0ef3521e-f083-4098-8978-d5d764ef4269 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:45:30.543549 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0ef3521e-f083-4098-8978-d5d764ef4269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:30.551404 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1263/2522] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:45:30.555632 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534d027-6873-4b27-9f9a-dba6a2e8d8c4 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:30.566781 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534d027-6873-4b27-9f9a-dba6a2e8d8c4 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:30.571495 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c34f7-ea12-4819-b476-301a17791b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:30.572144 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c34f7-ea12-4819-b476-301a17791b5a admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:30.572423 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c34f7-ea12-4819-b476-301a17791b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:30.572694 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c34f7-ea12-4819-b476-301a17791b5a admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:30.573465 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c34f7-ea12-4819-b476-301a17791b5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:45:30.573768 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c34f7-ea12-4819-b476-301a17791b5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:30.575377 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c34f7-ea12-4819-b476-301a17791b5a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:30.586755 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1260/2523] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:45:30.591517 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3521e-f083-4098-8978-d5d764ef4269 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:30.600812 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3521e-f083-4098-8978-d5d764ef4269 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:30.606867 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da120c64-1be2-41ff-a903-6f1f0d7550f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:30.607547 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da120c64-1be2-41ff-a903-6f1f0d7550f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:30.607854 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da120c64-1be2-41ff-a903-6f1f0d7550f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:30.608132 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da120c64-1be2-41ff-a903-6f1f0d7550f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:30.609437 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da120c64-1be2-41ff-a903-6f1f0d7550f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:30.611615 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da120c64-1be2-41ff-a903-6f1f0d7550f7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:30.636424 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1264/2524] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:45:30 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:45:30.640628 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c34f7-ea12-4819-b476-301a17791b5a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:30.650691 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c34f7-ea12-4819-b476-301a17791b5a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:30.704593 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584bec4-b307-4033-9776-f26ac0321807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:30.705221 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584bec4-b307-4033-9776-f26ac0321807 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:30.705505 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584bec4-b307-4033-9776-f26ac0321807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:30.705779 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584bec4-b307-4033-9776-f26ac0321807 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:30.706485 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584bec4-b307-4033-9776-f26ac0321807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:30.708384 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584bec4-b307-4033-9776-f26ac0321807 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:30.728291 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1261/2525] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:45:30 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:45:30.732989 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da120c64-1be2-41ff-a903-6f1f0d7550f7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:30.742777 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da120c64-1be2-41ff-a903-6f1f0d7550f7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:30.747290 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb11862-8527-44bd-81c3-da0c84cae54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:30.747940 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb11862-8527-44bd-81c3-da0c84cae54b admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:30.748224 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb11862-8527-44bd-81c3-da0c84cae54b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:30.749166 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb11862-8527-44bd-81c3-da0c84cae54b admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:30.749909 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb11862-8527-44bd-81c3-da0c84cae54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:30.751497 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb11862-8527-44bd-81c3-da0c84cae54b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:30.761542 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1265/2526] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:45:30.765648 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584bec4-b307-4033-9776-f26ac0321807 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:30.775543 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584bec4-b307-4033-9776-f26ac0321807 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:30.780643 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70edc5-4413-408e-bcd1-f26a37857223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:30.781328 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70edc5-4413-408e-bcd1-f26a37857223 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:30.781615 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70edc5-4413-408e-bcd1-f26a37857223 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:30.781895 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70edc5-4413-408e-bcd1-f26a37857223 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:30.782651 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70edc5-4413-408e-bcd1-f26a37857223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:30.784224 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70edc5-4413-408e-bcd1-f26a37857223 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:30.794409 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1262/2527] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:45:30.798173 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb11862-8527-44bd-81c3-da0c84cae54b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:30.807863 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb11862-8527-44bd-81c3-da0c84cae54b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:30.812350 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43781efe-e054-4b93-ba56-d812fc1230e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:30.813244 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43781efe-e054-4b93-ba56-d812fc1230e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:30.813541 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43781efe-e054-4b93-ba56-d812fc1230e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:30.813803 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43781efe-e054-4b93-ba56-d812fc1230e0 admin admin] PATH_INFO: `/v3/projects/43da58ef4ca24912874bc7f61edd0eae/users/cda96d365b9f49269f9c50e79e27decd/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:30.827709 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43781efe-e054-4b93-ba56-d812fc1230e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43da58ef4ca24912874bc7f61edd0eae, user_id=cda96d365b9f49269f9c50e79e27decd, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:30.830371 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43781efe-e054-4b93-ba56-d812fc1230e0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:30.842892 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1266/2528] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:45:30 2022] PUT /identity/v3/projects/43da58ef4ca24912874bc7f61edd0eae/users/cda96d365b9f49269f9c50e79e27decd/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:45:30.847731 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629c978-cea4-4cb2-9e06-3642ca8863f4 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:30.848024 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629c978-cea4-4cb2-9e06-3642ca8863f4 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:30.848328 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629c978-cea4-4cb2-9e06-3642ca8863f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:30.866274 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-7629c978-cea4-4cb2-9e06-3642ca8863f4 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:45:30.867476 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7629c978-cea4-4cb2-9e06-3642ca8863f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:30.931873 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1263/2529] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:45:30.938738 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43781efe-e054-4b93-ba56-d812fc1230e0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:30.940545 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-43781efe-e054-4b93-ba56-d812fc1230e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:30.999379 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43781efe-e054-4b93-ba56-d812fc1230e0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:31.003482 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e4eaa-56a0-4e35-8ea3-7b8299f8f910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:31.004130 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e4eaa-56a0-4e35-8ea3-7b8299f8f910 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:31.004414 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e4eaa-56a0-4e35-8ea3-7b8299f8f910 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:31.004689 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e4eaa-56a0-4e35-8ea3-7b8299f8f910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:31.015612 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e4eaa-56a0-4e35-8ea3-7b8299f8f910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:31.018082 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059e4eaa-56a0-4e35-8ea3-7b8299f8f910 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:31.029605 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1267/2530] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:45:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:45:35.352101 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b620e-143a-4e57-9fd6-ca74a77454cb None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:35.352976 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b620e-143a-4e57-9fd6-ca74a77454cb None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:35.353893 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b620e-143a-4e57-9fd6-ca74a77454cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:35.380817 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-9c8b620e-143a-4e57-9fd6-ca74a77454cb None None] MFA Rules not processed for user `cda96d365b9f49269f9c50e79e27decd`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:45:35.381927 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-9c8b620e-143a-4e57-9fd6-ca74a77454cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:35.446474 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1264/2531] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:45:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:45:35.451746 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e4eaa-56a0-4e35-8ea3-7b8299f8f910 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:35.461425 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e4eaa-56a0-4e35-8ea3-7b8299f8f910 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:35.467009 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c0e9d-017c-4f32-a19c-e741efcbcd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:35.467674 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c0e9d-017c-4f32-a19c-e741efcbcd17 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:35.467957 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c0e9d-017c-4f32-a19c-e741efcbcd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:35.468233 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c0e9d-017c-4f32-a19c-e741efcbcd17 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:35.468943 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c0e9d-017c-4f32-a19c-e741efcbcd17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:35.470871 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c0e9d-017c-4f32-a19c-e741efcbcd17 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:35.499477 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1268/2532] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:45:35 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:45:35.503732 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b620e-143a-4e57-9fd6-ca74a77454cb None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:35.515108 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b620e-143a-4e57-9fd6-ca74a77454cb None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:35.594612 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd5759-fdc3-44ec-87f9-13910f9da90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:35.595291 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd5759-fdc3-44ec-87f9-13910f9da90b admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:35.595575 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd5759-fdc3-44ec-87f9-13910f9da90b admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:35.595852 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd5759-fdc3-44ec-87f9-13910f9da90b admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:35.596727 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd5759-fdc3-44ec-87f9-13910f9da90b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:35.598719 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd5759-fdc3-44ec-87f9-13910f9da90b admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:35.619935 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1265/2533] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:45:35 2022] POST /identity/v3/users => generated 299 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:45:35.624771 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c0e9d-017c-4f32-a19c-e741efcbcd17 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:35.635290 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c0e9d-017c-4f32-a19c-e741efcbcd17 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:35.640320 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ea174-cd3f-44b9-aa14-e47ab60fb16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:35.641022 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ea174-cd3f-44b9-aa14-e47ab60fb16f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:35.641323 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ea174-cd3f-44b9-aa14-e47ab60fb16f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:35.641600 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ea174-cd3f-44b9-aa14-e47ab60fb16f admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:35.642639 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ea174-cd3f-44b9-aa14-e47ab60fb16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:35.644266 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ea174-cd3f-44b9-aa14-e47ab60fb16f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:35.655586 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1269/2534] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:45:35.659890 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd5759-fdc3-44ec-87f9-13910f9da90b admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:35.672202 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd5759-fdc3-44ec-87f9-13910f9da90b admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:35.677368 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f039e1-a8f5-4af0-aabd-3d36e95ddb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:35.678334 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f039e1-a8f5-4af0-aabd-3d36e95ddb7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:35.678676 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f039e1-a8f5-4af0-aabd-3d36e95ddb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:35.679013 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f039e1-a8f5-4af0-aabd-3d36e95ddb7a admin admin] PATH_INFO: `/v3/projects/2bf18929e4f04d279cd8c35d2f85b75a/users/355766eface5425db5b954675fdfd9aa/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:35.695067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f039e1-a8f5-4af0-aabd-3d36e95ddb7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf18929e4f04d279cd8c35d2f85b75a, user_id=355766eface5425db5b954675fdfd9aa, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:35.697751 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f039e1-a8f5-4af0-aabd-3d36e95ddb7a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:35.710988 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1266/2535] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:45:35 2022] PUT /identity/v3/projects/2bf18929e4f04d279cd8c35d2f85b75a/users/355766eface5425db5b954675fdfd9aa/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:45:35.715121 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ea174-cd3f-44b9-aa14-e47ab60fb16f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:35.725294 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ea174-cd3f-44b9-aa14-e47ab60fb16f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:35.782336 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7feed-7c2a-4f1a-a1b3-0e8d70025571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:35.782939 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7feed-7c2a-4f1a-a1b3-0e8d70025571 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:35.783219 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7feed-7c2a-4f1a-a1b3-0e8d70025571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:35.783496 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7feed-7c2a-4f1a-a1b3-0e8d70025571 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:35.784234 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7feed-7c2a-4f1a-a1b3-0e8d70025571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:35.785883 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7feed-7c2a-4f1a-a1b3-0e8d70025571 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:35.796623 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1270/2536] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:45:35.800998 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f039e1-a8f5-4af0-aabd-3d36e95ddb7a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:35.811930 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f039e1-a8f5-4af0-aabd-3d36e95ddb7a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:35.816555 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de9ce7-46d5-49f9-aad8-d4f35b771325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:35.817473 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de9ce7-46d5-49f9-aad8-d4f35b771325 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:35.817760 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de9ce7-46d5-49f9-aad8-d4f35b771325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:35.818029 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de9ce7-46d5-49f9-aad8-d4f35b771325 admin admin] PATH_INFO: `/v3/projects/2bf18929e4f04d279cd8c35d2f85b75a/users/355766eface5425db5b954675fdfd9aa/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:35.819994 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de9ce7-46d5-49f9-aad8-d4f35b771325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf18929e4f04d279cd8c35d2f85b75a, user_id=355766eface5425db5b954675fdfd9aa, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:35.822690 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de9ce7-46d5-49f9-aad8-d4f35b771325 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:35.833358 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1267/2537] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:45:35 2022] PUT /identity/v3/projects/2bf18929e4f04d279cd8c35d2f85b75a/users/355766eface5425db5b954675fdfd9aa/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:45:40.758975 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a4423-b6d1-4cad-9bf2-aa68abce6ba4 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:40.759413 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a4423-b6d1-4cad-9bf2-aa68abce6ba4 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:40.759534 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a4423-b6d1-4cad-9bf2-aa68abce6ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:40.785932 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2c4a4423-b6d1-4cad-9bf2-aa68abce6ba4 None None] MFA Rules not processed for user `355766eface5425db5b954675fdfd9aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:45:40.787151 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2c4a4423-b6d1-4cad-9bf2-aa68abce6ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:40.856897 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1271/2538] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:45:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:45:40.868290 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de9ce7-46d5-49f9-aad8-d4f35b771325 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:40.870146 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-29de9ce7-46d5-49f9-aad8-d4f35b771325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:40.927713 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de9ce7-46d5-49f9-aad8-d4f35b771325 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:40.931318 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716efa0c-a658-412c-ab8d-2a867cbde632 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6940472eb8e544c8aa3409328c804282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:40.931966 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716efa0c-a658-412c-ab8d-2a867cbde632 service glance] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:40.932274 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716efa0c-a658-412c-ab8d-2a867cbde632 service glance] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:40.932546 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716efa0c-a658-412c-ab8d-2a867cbde632 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:40.997846 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716efa0c-a658-412c-ab8d-2a867cbde632 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:40.999291 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716efa0c-a658-412c-ab8d-2a867cbde632 service glance] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:41.009864 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1268/2539] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:45:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:45:41.147949 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e751b61-3766-458a-95ef-cbf06db5758b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:41.148332 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e751b61-3766-458a-95ef-cbf06db5758b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:41.148684 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e751b61-3766-458a-95ef-cbf06db5758b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:41.168676 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-5e751b61-3766-458a-95ef-cbf06db5758b None None] MFA Rules not processed for user `98a27dbe620c4aff967363a7d48c46e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:45:41.170018 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5e751b61-3766-458a-95ef-cbf06db5758b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:41.225841 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1272/2540] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Feb 9 04:45:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:45:41.273957 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716efa0c-a658-412c-ab8d-2a867cbde632 service glance] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:41.275343 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-716efa0c-a658-412c-ab8d-2a867cbde632 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:41.351184 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716efa0c-a658-412c-ab8d-2a867cbde632 service glance] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:41.357078 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718380b-c903-4b4d-b0d4-3718fa3b73f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66fd482451f743cdb692677e57508764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:41.357742 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718380b-c903-4b4d-b0d4-3718fa3b73f7 service swift] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:41.358024 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718380b-c903-4b4d-b0d4-3718fa3b73f7 service swift] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:41.358296 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718380b-c903-4b4d-b0d4-3718fa3b73f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:41.367503 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718380b-c903-4b4d-b0d4-3718fa3b73f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:41.369277 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718380b-c903-4b4d-b0d4-3718fa3b73f7 service swift] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:41.377549 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1269/2541] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Feb 9 04:45:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:45:46.602267 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e751b61-3766-458a-95ef-cbf06db5758b None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:46.603820 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5e751b61-3766-458a-95ef-cbf06db5758b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:46.695612 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e751b61-3766-458a-95ef-cbf06db5758b None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:46.703437 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55006419-dae9-456e-9593-c64fa7775cd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:46.704385 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55006419-dae9-456e-9593-c64fa7775cd5 service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:46.705054 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55006419-dae9-456e-9593-c64fa7775cd5 service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:46.705562 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55006419-dae9-456e-9593-c64fa7775cd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:46.708266 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-55006419-dae9-456e-9593-c64fa7775cd5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:46.731236 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55006419-dae9-456e-9593-c64fa7775cd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:46.732905 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55006419-dae9-456e-9593-c64fa7775cd5 service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:46.758836 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1273/2542] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:45:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:45:47.427071 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d229803-4e93-43a2-9e15-5cc06bb190b9 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:47.427531 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d229803-4e93-43a2-9e15-5cc06bb190b9 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:47.427635 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d229803-4e93-43a2-9e15-5cc06bb190b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:47.446060 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-2d229803-4e93-43a2-9e15-5cc06bb190b9 None None] MFA Rules not processed for user `98a27dbe620c4aff967363a7d48c46e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:45:47.447581 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-2d229803-4e93-43a2-9e15-5cc06bb190b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:47.457142 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1270/2543] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Feb 9 04:45:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:45:47.474628 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55006419-dae9-456e-9593-c64fa7775cd5 service nova] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:47.495928 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55006419-dae9-456e-9593-c64fa7775cd5 service nova] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:47.501261 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79670312-0bf0-4cb8-ac48-3b7fa511c288 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66fd482451f743cdb692677e57508764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:47.501774 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79670312-0bf0-4cb8-ac48-3b7fa511c288 service swift] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:47.502062 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79670312-0bf0-4cb8-ac48-3b7fa511c288 service swift] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:47.502337 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79670312-0bf0-4cb8-ac48-3b7fa511c288 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:47.511982 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79670312-0bf0-4cb8-ac48-3b7fa511c288 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:47.513802 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79670312-0bf0-4cb8-ac48-3b7fa511c288 service swift] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:47.528074 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1274/2544] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Feb 9 04:45:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:45:52.269583 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111d68e-878a-4846-a236-96608d5bd9ac None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:52.270192 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111d68e-878a-4846-a236-96608d5bd9ac None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:52.270409 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111d68e-878a-4846-a236-96608d5bd9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:52.299810 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-9111d68e-878a-4846-a236-96608d5bd9ac None None] MFA Rules not processed for user `cda96d365b9f49269f9c50e79e27decd`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:45:52.299810 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-9111d68e-878a-4846-a236-96608d5bd9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:52.308277 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1271/2545] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:45:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:45:52.602762 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79670312-0bf0-4cb8-ac48-3b7fa511c288 service swift] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:52.605226 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-79670312-0bf0-4cb8-ac48-3b7fa511c288 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:52.663331 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79670312-0bf0-4cb8-ac48-3b7fa511c288 service swift] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:52.667570 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe16db-cf8a-4a20-b72c-aa1722184b7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:52.668214 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe16db-cf8a-4a20-b72c-aa1722184b7c service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:52.668531 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe16db-cf8a-4a20-b72c-aa1722184b7c service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:52.668822 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe16db-cf8a-4a20-b72c-aa1722184b7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:52.670708 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f8fe16db-cf8a-4a20-b72c-aa1722184b7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:52.682860 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe16db-cf8a-4a20-b72c-aa1722184b7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:52.684391 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe16db-cf8a-4a20-b72c-aa1722184b7c service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:52.694199 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1275/2546] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:45:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:45:58.949088 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a6e70-31de-416d-a5cc-87cab6272a7b None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:58.950807 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a6e70-31de-416d-a5cc-87cab6272a7b None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:58.951217 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a6e70-31de-416d-a5cc-87cab6272a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:58.976300 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-718a6e70-31de-416d-a5cc-87cab6272a7b None None] MFA Rules not processed for user `98a27dbe620c4aff967363a7d48c46e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:45:58.978710 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-718a6e70-31de-416d-a5cc-87cab6272a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:58.988274 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1272/2547] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Feb 9 04:45:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:45:59.001716 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe16db-cf8a-4a20-b72c-aa1722184b7c service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:59.015420 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe16db-cf8a-4a20-b72c-aa1722184b7c service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:59.021553 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b49f30-74f8-4c88-bf38-e3888a8575df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66fd482451f743cdb692677e57508764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:59.022473 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b49f30-74f8-4c88-bf38-e3888a8575df service swift] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:59.022831 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b49f30-74f8-4c88-bf38-e3888a8575df service swift] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:59.023244 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b49f30-74f8-4c88-bf38-e3888a8575df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:59.033482 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b49f30-74f8-4c88-bf38-e3888a8575df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:59.035269 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b49f30-74f8-4c88-bf38-e3888a8575df service swift] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:59.049421 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1276/2548] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Feb 9 04:45:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:45:59.222504 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a6e70-31de-416d-a5cc-87cab6272a7b None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:45:59.231879 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-718a6e70-31de-416d-a5cc-87cab6272a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:59.272155 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a6e70-31de-416d-a5cc-87cab6272a7b None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:45:59.290770 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7c977-6a9c-4c75-9a63-0206d1fbf121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:45:59.292118 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7c977-6a9c-4c75-9a63-0206d1fbf121 service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:45:59.292619 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7c977-6a9c-4c75-9a63-0206d1fbf121 service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:45:59.293150 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7c977-6a9c-4c75-9a63-0206d1fbf121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:45:59.301929 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-03a7c977-6a9c-4c75-9a63-0206d1fbf121 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:45:59.324918 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7c977-6a9c-4c75-9a63-0206d1fbf121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:45:59.331944 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7c977-6a9c-4c75-9a63-0206d1fbf121 service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:45:59.386031 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1273/2549] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:45:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:46:16.794521 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df1ed9-15aa-48fe-93b8-bc6e72818b1b None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:46:16.795135 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df1ed9-15aa-48fe-93b8-bc6e72818b1b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:46:16.795135 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75df1ed9-15aa-48fe-93b8-bc6e72818b1b None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:46:16.797611 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1277/2550] 10.222.0.36 () {54 vars in 921 bytes} [Wed Feb 9 04:46:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:46:16.804210 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c0b1c-eae8-493e-af39-64d20d23c92b None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:46:16.804755 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c0b1c-eae8-493e-af39-64d20d23c92b None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:46:16.804755 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c0b1c-eae8-493e-af39-64d20d23c92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:46:16.846615 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-ad7c0b1c-eae8-493e-af39-64d20d23c92b None None] MFA Rules not processed for user `63fe98c10e974c019e05a2f68d012ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:46:16.847962 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-ad7c0b1c-eae8-493e-af39-64d20d23c92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:46:16.860068 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1274/2551] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Feb 9 04:46:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:46:16.873331 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df1ed9-15aa-48fe-93b8-bc6e72818b1b None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:46:16.875480 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-75df1ed9-15aa-48fe-93b8-bc6e72818b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:46:16.893438 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75df1ed9-15aa-48fe-93b8-bc6e72818b1b None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:46:16.897607 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e137b5-af9c-499c-8235-7635136a7ea6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6940472eb8e544c8aa3409328c804282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:46:16.898990 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e137b5-af9c-499c-8235-7635136a7ea6 service glance] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:46:16.899449 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e137b5-af9c-499c-8235-7635136a7ea6 service glance] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:46:16.899886 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e137b5-af9c-499c-8235-7635136a7ea6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:46:16.913911 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e137b5-af9c-499c-8235-7635136a7ea6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:46:16.916695 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e137b5-af9c-499c-8235-7635136a7ea6 service glance] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:46:16.930274 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1278/2552] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:46:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:46:17.008105 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff4a39-8835-4110-bfca-b079623620db None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:46:17.008479 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff4a39-8835-4110-bfca-b079623620db None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:46:17.008763 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff4a39-8835-4110-bfca-b079623620db None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:46:17.010853 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1275/2553] 10.222.0.36 () {54 vars in 921 bytes} [Wed Feb 9 04:46:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:46:17.016277 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6398e-7893-49c8-b1d2-a48ef425d74f None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:46:17.016663 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6398e-7893-49c8-b1d2-a48ef425d74f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:46:17.017018 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6398e-7893-49c8-b1d2-a48ef425d74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:46:17.037638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-36e6398e-7893-49c8-b1d2-a48ef425d74f None None] MFA Rules not processed for user `80015d086ec24caf9414d2ef5f660f08`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:46:17.038845 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-36e6398e-7893-49c8-b1d2-a48ef425d74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:46:17.046702 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1279/2554] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Feb 9 04:46:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:46:17.060948 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff4a39-8835-4110-bfca-b079623620db None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:46:17.072562 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff4a39-8835-4110-bfca-b079623620db None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:46:17.076664 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4644563-0670-4770-a47f-39d11491291f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:46:17.077344 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4644563-0670-4770-a47f-39d11491291f service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:46:17.077629 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4644563-0670-4770-a47f-39d11491291f service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:46:17.077907 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4644563-0670-4770-a47f-39d11491291f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:46:17.088687 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4644563-0670-4770-a47f-39d11491291f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:46:17.094511 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4644563-0670-4770-a47f-39d11491291f service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:46:17.104138 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1276/2555] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:46:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:46:22.901224 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f2656-dc38-4908-94b4-d63603c104e1 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:46:22.901692 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f2656-dc38-4908-94b4-d63603c104e1 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:46:22.901797 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f2656-dc38-4908-94b4-d63603c104e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:46:22.919501 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-cd4f2656-dc38-4908-94b4-d63603c104e1 None None] MFA Rules not processed for user `98a27dbe620c4aff967363a7d48c46e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:46:22.920607 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-cd4f2656-dc38-4908-94b4-d63603c104e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:46:22.927573 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1280/2556] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Feb 9 04:46:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:46:22.939737 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4644563-0670-4770-a47f-39d11491291f service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:46:22.951501 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4644563-0670-4770-a47f-39d11491291f service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:46:22.956327 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2c3d5-f0e1-4fa1-87e7-64ce9a0ed8d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66fd482451f743cdb692677e57508764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:46:22.956953 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2c3d5-f0e1-4fa1-87e7-64ce9a0ed8d6 service swift] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:46:22.957290 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2c3d5-f0e1-4fa1-87e7-64ce9a0ed8d6 service swift] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:46:22.957570 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2c3d5-f0e1-4fa1-87e7-64ce9a0ed8d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:46:22.965406 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2c3d5-f0e1-4fa1-87e7-64ce9a0ed8d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:46:22.966953 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2c3d5-f0e1-4fa1-87e7-64ce9a0ed8d6 service swift] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:46:22.974822 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1277/2557] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Feb 9 04:46:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:46:45.648010 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f2656-dc38-4908-94b4-d63603c104e1 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:46:45.650528 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-cd4f2656-dc38-4908-94b4-d63603c104e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:46:45.715874 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f2656-dc38-4908-94b4-d63603c104e1 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:46:45.720544 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc1330-fe8a-4571-8020-e024b10d8557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:46:45.721460 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc1330-fe8a-4571-8020-e024b10d8557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:46:45.721737 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc1330-fe8a-4571-8020-e024b10d8557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:46:45.722004 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc1330-fe8a-4571-8020-e024b10d8557 admin admin] PATH_INFO: `/v3/users/48e475a79c524d6d9829c148bdec7d08` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:46:45.723217 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc1330-fe8a-4571-8020-e024b10d8557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48e475a79c524d6d9829c148bdec7d08)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:46:45.725247 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc1330-fe8a-4571-8020-e024b10d8557 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:46:45.780615 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-61fc1330-fe8a-4571-8020-e024b10d8557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e475a79c524d6d9829c148bdec7d08'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:46:45.787457 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-61fc1330-fe8a-4571-8020-e024b10d8557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e475a79c524d6d9829c148bdec7d08'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:46:45.788112 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-61fc1330-fe8a-4571-8020-e024b10d8557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e475a79c524d6d9829c148bdec7d08'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:46:45.799623 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-61fc1330-fe8a-4571-8020-e024b10d8557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e475a79c524d6d9829c148bdec7d08'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:46:45.806223 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-61fc1330-fe8a-4571-8020-e024b10d8557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e475a79c524d6d9829c148bdec7d08'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:46:45.812439 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1281/2558] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:46:45 2022] DELETE /identity/v3/users/48e475a79c524d6d9829c148bdec7d08 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:46:45.975830 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2c3d5-f0e1-4fa1-87e7-64ce9a0ed8d6 service swift] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:46:45.987040 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2c3d5-f0e1-4fa1-87e7-64ce9a0ed8d6 service swift] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:46:46.046386 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27c59b-ac11-4411-a4dc-dc8ddb213f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:46:46.047234 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27c59b-ac11-4411-a4dc-dc8ddb213f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:46:46.047516 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27c59b-ac11-4411-a4dc-dc8ddb213f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:46:46.047794 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27c59b-ac11-4411-a4dc-dc8ddb213f97 admin admin] PATH_INFO: `/v3/projects/f7cafc3f57fd4a7c88a12a997beae8be` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:46:46.048991 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27c59b-ac11-4411-a4dc-dc8ddb213f97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7cafc3f57fd4a7c88a12a997beae8be)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:46:46.050921 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a27c59b-ac11-4411-a4dc-dc8ddb213f97 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:46:46.099675 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-5a27c59b-ac11-4411-a4dc-dc8ddb213f97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7cafc3f57fd4a7c88a12a997beae8be', 'request_id': 'req-5a27c59b-ac11-4411-a4dc-dc8ddb213f97'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:46:46.109246 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-5a27c59b-ac11-4411-a4dc-dc8ddb213f97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7cafc3f57fd4a7c88a12a997beae8be', 'request_id': 'req-5a27c59b-ac11-4411-a4dc-dc8ddb213f97'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:46:46.116876 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-5a27c59b-ac11-4411-a4dc-dc8ddb213f97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7cafc3f57fd4a7c88a12a997beae8be', 'request_id': 'req-5a27c59b-ac11-4411-a4dc-dc8ddb213f97'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:46:46.127852 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-5a27c59b-ac11-4411-a4dc-dc8ddb213f97 admin admin] The token cache is being invalidate because project f7cafc3f57fd4a7c88a12a997beae8be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:46:46.128142 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-5a27c59b-ac11-4411-a4dc-dc8ddb213f97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:46:46.128971 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-5a27c59b-ac11-4411-a4dc-dc8ddb213f97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:46:46.130519 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1278/2559] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:46:45 2022] DELETE /identity/v3/projects/f7cafc3f57fd4a7c88a12a997beae8be => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:46:49.100335 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc1330-fe8a-4571-8020-e024b10d8557 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:46:49.101896 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-61fc1330-fe8a-4571-8020-e024b10d8557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:46:49.175843 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc1330-fe8a-4571-8020-e024b10d8557 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:46:49.236945 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75824635-742a-4c5c-a468-052a6939e167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:46:49.237632 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75824635-742a-4c5c-a468-052a6939e167 service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:46:49.237919 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75824635-742a-4c5c-a468-052a6939e167 service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:46:49.238197 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75824635-742a-4c5c-a468-052a6939e167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:46:49.240002 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-75824635-742a-4c5c-a468-052a6939e167 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:46:49.297352 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75824635-742a-4c5c-a468-052a6939e167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:46:49.298634 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27c59b-ac11-4411-a4dc-dc8ddb213f97 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:46:49.299131 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75824635-742a-4c5c-a468-052a6939e167 service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:46:49.300069 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-5a27c59b-ac11-4411-a4dc-dc8ddb213f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:46:49.308467 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1282/2560] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:46:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:46:49.360651 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27c59b-ac11-4411-a4dc-dc8ddb213f97 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:46:49.364273 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c049c24-0c41-48e9-b2a0-41b4fd9e56e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:46:49.364847 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c049c24-0c41-48e9-b2a0-41b4fd9e56e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:46:49.365153 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c049c24-0c41-48e9-b2a0-41b4fd9e56e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:46:49.365426 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c049c24-0c41-48e9-b2a0-41b4fd9e56e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:46:49.367206 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-0c049c24-0c41-48e9-b2a0-41b4fd9e56e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:46:49.427687 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c049c24-0c41-48e9-b2a0-41b4fd9e56e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:46:49.429187 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c049c24-0c41-48e9-b2a0-41b4fd9e56e3 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:46:49.438714 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1279/2561] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:46:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:46:50.658276 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1397cb-9916-499f-acda-b9091ebe0e0e None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:46:50.659116 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1397cb-9916-499f-acda-b9091ebe0e0e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:46:50.659550 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1397cb-9916-499f-acda-b9091ebe0e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:46:50.678052 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-fc1397cb-9916-499f-acda-b9091ebe0e0e None None] MFA Rules not processed for user `98a27dbe620c4aff967363a7d48c46e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:46:50.679463 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fc1397cb-9916-499f-acda-b9091ebe0e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:46:50.735522 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1283/2562] 10.222.0.36 () {58 vars in 967 bytes} [Wed Feb 9 04:46:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:46:50.756490 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c049c24-0c41-48e9-b2a0-41b4fd9e56e3 service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:46:50.757913 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-0c049c24-0c41-48e9-b2a0-41b4fd9e56e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:46:50.825643 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c049c24-0c41-48e9-b2a0-41b4fd9e56e3 service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:46:50.830874 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e13933-8de6-4c0a-8cce-b8e148c4cb56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66fd482451f743cdb692677e57508764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:46:50.831531 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e13933-8de6-4c0a-8cce-b8e148c4cb56 service swift] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:46:50.831842 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e13933-8de6-4c0a-8cce-b8e148c4cb56 service swift] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:46:50.832163 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e13933-8de6-4c0a-8cce-b8e148c4cb56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:46:50.840981 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e13933-8de6-4c0a-8cce-b8e148c4cb56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:46:50.842580 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e13933-8de6-4c0a-8cce-b8e148c4cb56 service swift] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:46:50.850725 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1280/2563] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Feb 9 04:46:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:48:04.321031 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37d08d-9c3c-45fa-ad51-df324a93b79d None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:48:04.321570 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37d08d-9c3c-45fa-ad51-df324a93b79d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:48:04.321570 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37d08d-9c3c-45fa-ad51-df324a93b79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:48:04.339109 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-bd37d08d-9c3c-45fa-ad51-df324a93b79d None None] MFA Rules not processed for user `c373e13cbd6c40ed9434caf0d2dec4b9`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:48:04.340249 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-bd37d08d-9c3c-45fa-ad51-df324a93b79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:48:04.347796 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1284/2564] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:48:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:48:20.199191 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e13933-8de6-4c0a-8cce-b8e148c4cb56 service swift] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:48:20.200672 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-02e13933-8de6-4c0a-8cce-b8e148c4cb56 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:48:20.271230 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e13933-8de6-4c0a-8cce-b8e148c4cb56 service swift] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:48:20.276305 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc42d1-2d62-44cc-a400-0be9cac6565d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add56fc0cfd8403b86c5ef23fd374a5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:48:20.276953 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc42d1-2d62-44cc-a400-0be9cac6565d service placement] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:48:20.277269 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc42d1-2d62-44cc-a400-0be9cac6565d service placement] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:48:20.277548 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc42d1-2d62-44cc-a400-0be9cac6565d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:48:20.279361 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-6cfc42d1-2d62-44cc-a400-0be9cac6565d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:48:20.294740 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc42d1-2d62-44cc-a400-0be9cac6565d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:48:20.296331 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc42d1-2d62-44cc-a400-0be9cac6565d service placement] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:48:20.306445 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1281/2565] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:48:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:48:22.400279 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37d08d-9c3c-45fa-ad51-df324a93b79d None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:48:22.401725 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-bd37d08d-9c3c-45fa-ad51-df324a93b79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:48:22.416846 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37d08d-9c3c-45fa-ad51-df324a93b79d None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:48:22.422150 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a01b6-6e7f-4d67-819e-0d541d82dd65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:48:22.422789 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a01b6-6e7f-4d67-819e-0d541d82dd65 service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:48:22.423071 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a01b6-6e7f-4d67-819e-0d541d82dd65 service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:48:22.423346 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a01b6-6e7f-4d67-819e-0d541d82dd65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:48:22.425147 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-615a01b6-6e7f-4d67-819e-0d541d82dd65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:48:22.436966 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a01b6-6e7f-4d67-819e-0d541d82dd65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:48:22.438502 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a01b6-6e7f-4d67-819e-0d541d82dd65 service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:48:22.449458 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1285/2566] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:48:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:49:25.902224 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc42d1-2d62-44cc-a400-0be9cac6565d service placement] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:49:25.903537 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-6cfc42d1-2d62-44cc-a400-0be9cac6565d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:49:25.957412 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc42d1-2d62-44cc-a400-0be9cac6565d service placement] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:49:25.960923 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d8c08-f88a-47f9-ba4b-1f5b61ac9a63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:49:25.961578 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d8c08-f88a-47f9-ba4b-1f5b61ac9a63 service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:49:25.961854 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d8c08-f88a-47f9-ba4b-1f5b61ac9a63 service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:49:25.962124 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d8c08-f88a-47f9-ba4b-1f5b61ac9a63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:49:25.963846 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-021d8c08-f88a-47f9-ba4b-1f5b61ac9a63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:49:26.019370 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021d8c08-f88a-47f9-ba4b-1f5b61ac9a63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:49:26.020776 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021d8c08-f88a-47f9-ba4b-1f5b61ac9a63 service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:49:26.029304 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1282/2567] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:49:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:49:32.099743 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50492aa-9023-4eca-8d0d-c1d8176d6cc8 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:49:32.100325 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50492aa-9023-4eca-8d0d-c1d8176d6cc8 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:49:32.101109 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50492aa-9023-4eca-8d0d-c1d8176d6cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:49:32.136555 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a50492aa-9023-4eca-8d0d-c1d8176d6cc8 None None] MFA Rules not processed for user `2c03733c29e44e72b3c90def97071b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:49:32.142261 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a50492aa-9023-4eca-8d0d-c1d8176d6cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:49:32.151009 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1286/2568] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:49:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:49:38.170928 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876f0f7-b304-469b-b1ae-b611d582a5fd None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:49:38.171368 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876f0f7-b304-469b-b1ae-b611d582a5fd None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:49:38.171548 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876f0f7-b304-469b-b1ae-b611d582a5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:49:38.189075 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-7876f0f7-b304-469b-b1ae-b611d582a5fd None None] MFA Rules not processed for user `98a27dbe620c4aff967363a7d48c46e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:49:38.190290 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7876f0f7-b304-469b-b1ae-b611d582a5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:49:38.197370 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1283/2569] 10.222.0.36 () {58 vars in 967 bytes} [Wed Feb 9 04:49:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:49:38.242744 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50492aa-9023-4eca-8d0d-c1d8176d6cc8 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:49:38.254289 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50492aa-9023-4eca-8d0d-c1d8176d6cc8 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:49:38.259079 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e9647-9699-451e-a08b-f6a05dad5b1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66fd482451f743cdb692677e57508764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:49:38.259706 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e9647-9699-451e-a08b-f6a05dad5b1b service swift] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:49:38.260254 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e9647-9699-451e-a08b-f6a05dad5b1b service swift] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:49:38.260525 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e9647-9699-451e-a08b-f6a05dad5b1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:49:38.268491 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e9647-9699-451e-a08b-f6a05dad5b1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:49:38.270136 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e9647-9699-451e-a08b-f6a05dad5b1b service swift] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:49:38.280431 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1287/2570] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Feb 9 04:49:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:49:45.847068 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876f0f7-b304-469b-b1ae-b611d582a5fd None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:49:45.851611 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7876f0f7-b304-469b-b1ae-b611d582a5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:49:45.939375 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876f0f7-b304-469b-b1ae-b611d582a5fd None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:49:45.945346 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5637e-6b80-4334-9f18-bb5c3361371a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:49:45.946234 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5637e-6b80-4334-9f18-bb5c3361371a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:49:45.946733 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5637e-6b80-4334-9f18-bb5c3361371a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:49:45.947181 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5637e-6b80-4334-9f18-bb5c3361371a admin admin] PATH_INFO: `/v3/users/cda96d365b9f49269f9c50e79e27decd` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:49:45.948614 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5637e-6b80-4334-9f18-bb5c3361371a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cda96d365b9f49269f9c50e79e27decd)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:49:45.950941 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5637e-6b80-4334-9f18-bb5c3361371a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:49:46.004038 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-bba5637e-6b80-4334-9f18-bb5c3361371a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda96d365b9f49269f9c50e79e27decd'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:49:46.011558 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-bba5637e-6b80-4334-9f18-bb5c3361371a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda96d365b9f49269f9c50e79e27decd'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:49:46.012470 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-bba5637e-6b80-4334-9f18-bb5c3361371a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda96d365b9f49269f9c50e79e27decd'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:49:46.027085 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-bba5637e-6b80-4334-9f18-bb5c3361371a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda96d365b9f49269f9c50e79e27decd'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:49:46.036101 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-bba5637e-6b80-4334-9f18-bb5c3361371a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda96d365b9f49269f9c50e79e27decd'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:49:46.044034 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1284/2571] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:49:45 2022] DELETE /identity/v3/users/cda96d365b9f49269f9c50e79e27decd => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:49:46.386198 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e9647-9699-451e-a08b-f6a05dad5b1b service swift] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:49:46.407423 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e9647-9699-451e-a08b-f6a05dad5b1b service swift] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:49:46.482926 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4242a29-b73b-4752-acac-1d04667fb73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:49:46.483778 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4242a29-b73b-4752-acac-1d04667fb73f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:49:46.484057 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4242a29-b73b-4752-acac-1d04667fb73f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:49:46.484356 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4242a29-b73b-4752-acac-1d04667fb73f admin admin] PATH_INFO: `/v3/projects/43da58ef4ca24912874bc7f61edd0eae` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:49:46.485549 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4242a29-b73b-4752-acac-1d04667fb73f admin admin] RBAC: Authorizing `identity:delete_project(project_id=43da58ef4ca24912874bc7f61edd0eae)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:49:46.488054 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4242a29-b73b-4752-acac-1d04667fb73f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:49:46.532861 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b4242a29-b73b-4752-acac-1d04667fb73f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43da58ef4ca24912874bc7f61edd0eae', 'request_id': 'req-b4242a29-b73b-4752-acac-1d04667fb73f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:49:46.539329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b4242a29-b73b-4752-acac-1d04667fb73f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43da58ef4ca24912874bc7f61edd0eae', 'request_id': 'req-b4242a29-b73b-4752-acac-1d04667fb73f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:49:46.546879 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b4242a29-b73b-4752-acac-1d04667fb73f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43da58ef4ca24912874bc7f61edd0eae', 'request_id': 'req-b4242a29-b73b-4752-acac-1d04667fb73f'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:49:46.558788 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b4242a29-b73b-4752-acac-1d04667fb73f admin admin] The token cache is being invalidate because project 43da58ef4ca24912874bc7f61edd0eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:49:46.559816 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b4242a29-b73b-4752-acac-1d04667fb73f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:49:46.560465 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-b4242a29-b73b-4752-acac-1d04667fb73f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:49:46.562050 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1288/2572] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:49:46 2022] DELETE /identity/v3/projects/43da58ef4ca24912874bc7f61edd0eae => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:49:46.566149 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5637e-6b80-4334-9f18-bb5c3361371a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:49:46.567616 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-bba5637e-6b80-4334-9f18-bb5c3361371a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:49:46.582314 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5637e-6b80-4334-9f18-bb5c3361371a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:49:46.646612 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91162b-7713-4c17-80c1-760a3c8bdf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:49:46.647534 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91162b-7713-4c17-80c1-760a3c8bdf54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:49:46.647815 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91162b-7713-4c17-80c1-760a3c8bdf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:49:46.648089 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91162b-7713-4c17-80c1-760a3c8bdf54 admin admin] PATH_INFO: `/v3/users/355766eface5425db5b954675fdfd9aa` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:49:46.649339 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91162b-7713-4c17-80c1-760a3c8bdf54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=355766eface5425db5b954675fdfd9aa)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:49:46.651283 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91162b-7713-4c17-80c1-760a3c8bdf54 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:49:46.703635 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-8d91162b-7713-4c17-80c1-760a3c8bdf54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '355766eface5425db5b954675fdfd9aa'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:49:46.710942 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-8d91162b-7713-4c17-80c1-760a3c8bdf54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '355766eface5425db5b954675fdfd9aa'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:49:46.711610 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-8d91162b-7713-4c17-80c1-760a3c8bdf54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '355766eface5425db5b954675fdfd9aa'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:49:46.723123 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-8d91162b-7713-4c17-80c1-760a3c8bdf54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '355766eface5425db5b954675fdfd9aa'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:49:46.730785 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-8d91162b-7713-4c17-80c1-760a3c8bdf54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '355766eface5425db5b954675fdfd9aa'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:49:46.737174 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1285/2573] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:49:46 2022] DELETE /identity/v3/users/355766eface5425db5b954675fdfd9aa => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:49:46.912675 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4242a29-b73b-4752-acac-1d04667fb73f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:49:46.914307 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b4242a29-b73b-4752-acac-1d04667fb73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:49:46.940326 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4242a29-b73b-4752-acac-1d04667fb73f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:49:47.012736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3882d-5408-4eca-a1d1-eecd1a48a7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:49:47.013769 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3882d-5408-4eca-a1d1-eecd1a48a7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:49:47.014114 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3882d-5408-4eca-a1d1-eecd1a48a7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:49:47.014451 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3882d-5408-4eca-a1d1-eecd1a48a7bf admin admin] PATH_INFO: `/v3/projects/2bf18929e4f04d279cd8c35d2f85b75a` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:49:47.015841 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3882d-5408-4eca-a1d1-eecd1a48a7bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bf18929e4f04d279cd8c35d2f85b75a)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:49:47.017982 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3882d-5408-4eca-a1d1-eecd1a48a7bf admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:49:47.071231 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6cb3882d-5408-4eca-a1d1-eecd1a48a7bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bf18929e4f04d279cd8c35d2f85b75a', 'request_id': 'req-6cb3882d-5408-4eca-a1d1-eecd1a48a7bf'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:49:47.078059 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6cb3882d-5408-4eca-a1d1-eecd1a48a7bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bf18929e4f04d279cd8c35d2f85b75a', 'request_id': 'req-6cb3882d-5408-4eca-a1d1-eecd1a48a7bf'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:49:47.087807 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6cb3882d-5408-4eca-a1d1-eecd1a48a7bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bf18929e4f04d279cd8c35d2f85b75a', 'request_id': 'req-6cb3882d-5408-4eca-a1d1-eecd1a48a7bf'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:49:47.098755 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6cb3882d-5408-4eca-a1d1-eecd1a48a7bf admin admin] The token cache is being invalidate because project 2bf18929e4f04d279cd8c35d2f85b75a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:49:47.099048 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6cb3882d-5408-4eca-a1d1-eecd1a48a7bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:49:47.099698 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6cb3882d-5408-4eca-a1d1-eecd1a48a7bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:49:47.101261 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1289/2574] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:49:46 2022] DELETE /identity/v3/projects/2bf18929e4f04d279cd8c35d2f85b75a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:50:00.615886 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd3f3e-236f-4714-ac1c-2648807c27c4 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:50:00.616353 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd3f3e-236f-4714-ac1c-2648807c27c4 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:50:00.616618 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd3f3e-236f-4714-ac1c-2648807c27c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:50:00.634002 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-f7bd3f3e-236f-4714-ac1c-2648807c27c4 None None] MFA Rules not processed for user `98a27dbe620c4aff967363a7d48c46e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:50:00.635389 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-f7bd3f3e-236f-4714-ac1c-2648807c27c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:50:00.687718 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1286/2575] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Feb 9 04:50:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:50:00.699674 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3882d-5408-4eca-a1d1-eecd1a48a7bf admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:50:00.701124 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6cb3882d-5408-4eca-a1d1-eecd1a48a7bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:50:00.770763 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3882d-5408-4eca-a1d1-eecd1a48a7bf admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:50:00.776197 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb70e5-e1d2-40fc-bc33-9dd676d26095 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66fd482451f743cdb692677e57508764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:50:00.776849 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb70e5-e1d2-40fc-bc33-9dd676d26095 service swift] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:50:00.777176 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb70e5-e1d2-40fc-bc33-9dd676d26095 service swift] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:50:00.777456 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb70e5-e1d2-40fc-bc33-9dd676d26095 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:50:00.785877 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb70e5-e1d2-40fc-bc33-9dd676d26095 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:50:00.787474 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb70e5-e1d2-40fc-bc33-9dd676d26095 service swift] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:50:00.795287 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1290/2576] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Feb 9 04:50:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:50:02.827007 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd3f3e-236f-4714-ac1c-2648807c27c4 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:50:02.828737 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-f7bd3f3e-236f-4714-ac1c-2648807c27c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:50:02.891722 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd3f3e-236f-4714-ac1c-2648807c27c4 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:50:02.895918 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e7eb4-0600-48c9-9aba-00210b52396e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:50:02.896574 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e7eb4-0600-48c9-9aba-00210b52396e service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:50:02.896861 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e7eb4-0600-48c9-9aba-00210b52396e service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:50:02.897167 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e7eb4-0600-48c9-9aba-00210b52396e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:50:02.898987 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-ce1e7eb4-0600-48c9-9aba-00210b52396e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:50:02.983840 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e7eb4-0600-48c9-9aba-00210b52396e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:50:02.985349 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e7eb4-0600-48c9-9aba-00210b52396e service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:50:02.997213 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1287/2577] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:50:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:50:04.239321 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb70e5-e1d2-40fc-bc33-9dd676d26095 service swift] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:50:04.247062 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-35eb70e5-e1d2-40fc-bc33-9dd676d26095 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:50:04.275024 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb70e5-e1d2-40fc-bc33-9dd676d26095 service swift] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:50:04.282815 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92589be-3703-470d-b4ed-e98b352c1728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:50:04.283770 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92589be-3703-470d-b4ed-e98b352c1728 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:50:04.284166 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92589be-3703-470d-b4ed-e98b352c1728 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:50:04.284550 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92589be-3703-470d-b4ed-e98b352c1728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:50:04.286786 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b92589be-3703-470d-b4ed-e98b352c1728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:50:04.303202 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92589be-3703-470d-b4ed-e98b352c1728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:50:04.304811 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92589be-3703-470d-b4ed-e98b352c1728 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:50:04.325863 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1291/2578] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:50:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:50:14.724987 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac873a4-d3ed-4310-9120-89d2c3f47b5a None None] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:50:14.725583 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac873a4-d3ed-4310-9120-89d2c3f47b5a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:50:14.725583 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac873a4-d3ed-4310-9120-89d2c3f47b5a None None] PATH_INFO: `/` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:50:14.727336 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1288/2579] 10.222.0.36 () {54 vars in 921 bytes} [Wed Feb 9 04:50:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:50:14.733227 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9923b6-241d-4a65-90d0-c96643d6ac30 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:50:14.733716 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9923b6-241d-4a65-90d0-c96643d6ac30 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:50:14.733925 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9923b6-241d-4a65-90d0-c96643d6ac30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:50:14.752771 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-1c9923b6-241d-4a65-90d0-c96643d6ac30 None None] MFA Rules not processed for user `63fe98c10e974c019e05a2f68d012ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:50:14.754094 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1c9923b6-241d-4a65-90d0-c96643d6ac30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:50:14.764145 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1292/2580] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Feb 9 04:50:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:50:14.777642 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac873a4-d3ed-4310-9120-89d2c3f47b5a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:50:14.778686 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-bac873a4-d3ed-4310-9120-89d2c3f47b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:50:14.835441 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac873a4-d3ed-4310-9120-89d2c3f47b5a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:50:14.838939 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57cb43-11ed-4f16-aa02-db7f4ac61d9d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6940472eb8e544c8aa3409328c804282', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:50:14.839576 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57cb43-11ed-4f16-aa02-db7f4ac61d9d service glance] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:50:14.839855 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57cb43-11ed-4f16-aa02-db7f4ac61d9d service glance] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:50:14.840217 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57cb43-11ed-4f16-aa02-db7f4ac61d9d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:50:14.850489 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57cb43-11ed-4f16-aa02-db7f4ac61d9d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:50:14.851894 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57cb43-11ed-4f16-aa02-db7f4ac61d9d service glance] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:50:14.863538 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1289/2581] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:50:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:50:14.932981 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274917b-ca37-4338-8613-7386e4796cb7 None None] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:50:14.933298 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274917b-ca37-4338-8613-7386e4796cb7 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:50:14.933577 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274917b-ca37-4338-8613-7386e4796cb7 None None] PATH_INFO: `/` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:50:14.935364 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1293/2582] 10.222.0.36 () {54 vars in 921 bytes} [Wed Feb 9 04:50:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 09 04:50:14.940671 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801b51e-ec25-4ca0-873c-f5df78850914 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:50:14.940965 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801b51e-ec25-4ca0-873c-f5df78850914 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:50:14.941281 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801b51e-ec25-4ca0-873c-f5df78850914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:50:14.982606 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-9801b51e-ec25-4ca0-873c-f5df78850914 None None] MFA Rules not processed for user `80015d086ec24caf9414d2ef5f660f08`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:50:14.983864 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-9801b51e-ec25-4ca0-873c-f5df78850914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:50:14.990446 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1290/2583] 10.222.0.36 () {58 vars in 1018 bytes} [Wed Feb 9 04:50:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:50:15.002386 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274917b-ca37-4338-8613-7386e4796cb7 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:50:15.013070 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274917b-ca37-4338-8613-7386e4796cb7 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:50:15.018005 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ab3d8-4a3e-474f-91ba-eb69ed7d1f84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:50:15.018668 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ab3d8-4a3e-474f-91ba-eb69ed7d1f84 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:50:15.018946 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ab3d8-4a3e-474f-91ba-eb69ed7d1f84 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:50:15.019223 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ab3d8-4a3e-474f-91ba-eb69ed7d1f84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:50:15.025952 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ab3d8-4a3e-474f-91ba-eb69ed7d1f84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:50:15.027366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ab3d8-4a3e-474f-91ba-eb69ed7d1f84 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:50:15.034741 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1294/2584] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:50:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:50:16.614039 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7efd10-eb3d-480a-8a90-3f3c91d107f1 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:50:16.614490 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7efd10-eb3d-480a-8a90-3f3c91d107f1 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:50:16.614600 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7efd10-eb3d-480a-8a90-3f3c91d107f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:50:16.631845 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-aa7efd10-eb3d-480a-8a90-3f3c91d107f1 None None] MFA Rules not processed for user `98a27dbe620c4aff967363a7d48c46e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:50:16.633028 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-aa7efd10-eb3d-480a-8a90-3f3c91d107f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:50:16.640201 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1291/2585] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Feb 9 04:50:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:50:16.652426 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ab3d8-4a3e-474f-91ba-eb69ed7d1f84 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:50:16.665043 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ab3d8-4a3e-474f-91ba-eb69ed7d1f84 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:50:16.669885 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314a5f0-517b-45a6-a034-34306dc0471b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66fd482451f743cdb692677e57508764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:50:16.670514 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314a5f0-517b-45a6-a034-34306dc0471b service swift] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:50:16.670802 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314a5f0-517b-45a6-a034-34306dc0471b service swift] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:50:16.671081 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314a5f0-517b-45a6-a034-34306dc0471b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:50:16.679101 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314a5f0-517b-45a6-a034-34306dc0471b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:50:16.680736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314a5f0-517b-45a6-a034-34306dc0471b service swift] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:50:16.688488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1295/2586] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Feb 9 04:50:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 09 04:50:28.317476 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7efd10-eb3d-480a-8a90-3f3c91d107f1 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:50:28.326600 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7efd10-eb3d-480a-8a90-3f3c91d107f1 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:50:28.330052 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752169e1-26c3-462a-aa3c-1a1f0bf89442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:50:28.330674 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752169e1-26c3-462a-aa3c-1a1f0bf89442 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:50:28.330951 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752169e1-26c3-462a-aa3c-1a1f0bf89442 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:50:28.331224 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752169e1-26c3-462a-aa3c-1a1f0bf89442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:50:28.332994 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-752169e1-26c3-462a-aa3c-1a1f0bf89442 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:50:28.345288 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752169e1-26c3-462a-aa3c-1a1f0bf89442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:50:28.347678 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752169e1-26c3-462a-aa3c-1a1f0bf89442 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:50:28.358318 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1292/2587] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:50:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:50:35.585086 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd27f8-5012-4f7e-9625-7b0ca9e989c9 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:50:35.585546 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd27f8-5012-4f7e-9625-7b0ca9e989c9 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:50:35.585659 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd27f8-5012-4f7e-9625-7b0ca9e989c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:50:35.602661 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-26bd27f8-5012-4f7e-9625-7b0ca9e989c9 None None] MFA Rules not processed for user `98a27dbe620c4aff967363a7d48c46e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:50:35.603844 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-26bd27f8-5012-4f7e-9625-7b0ca9e989c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:50:35.611322 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1296/2588] 10.222.0.36 () {58 vars in 967 bytes} [Wed Feb 9 04:50:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:50:35.623303 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752169e1-26c3-462a-aa3c-1a1f0bf89442 service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:50:35.637377 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752169e1-26c3-462a-aa3c-1a1f0bf89442 service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:50:35.643167 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7acc6-5dcd-48e3-a994-a190c0bd8bbf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66fd482451f743cdb692677e57508764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:50:35.643791 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7acc6-5dcd-48e3-a994-a190c0bd8bbf service swift] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:50:35.644075 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7acc6-5dcd-48e3-a994-a190c0bd8bbf service swift] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:50:35.644348 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7acc6-5dcd-48e3-a994-a190c0bd8bbf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:50:35.652164 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7acc6-5dcd-48e3-a994-a190c0bd8bbf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:50:35.653757 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade7acc6-5dcd-48e3-a994-a190c0bd8bbf service swift] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:50:35.661374 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1293/2589] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Feb 9 04:50:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:51:09.151755 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd27f8-5012-4f7e-9625-7b0ca9e989c9 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:09.153516 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-26bd27f8-5012-4f7e-9625-7b0ca9e989c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:09.170641 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd27f8-5012-4f7e-9625-7b0ca9e989c9 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:09.177217 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00a02d-f20c-4e87-8d1e-a3d136d2d04a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:09.177878 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00a02d-f20c-4e87-8d1e-a3d136d2d04a service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:09.178160 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00a02d-f20c-4e87-8d1e-a3d136d2d04a service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:09.178436 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00a02d-f20c-4e87-8d1e-a3d136d2d04a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:09.180208 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fe00a02d-f20c-4e87-8d1e-a3d136d2d04a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:09.206656 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00a02d-f20c-4e87-8d1e-a3d136d2d04a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:09.208988 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00a02d-f20c-4e87-8d1e-a3d136d2d04a service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:09.221553 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1297/2590] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:51:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:51:14.725649 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7acc6-5dcd-48e3-a994-a190c0bd8bbf service swift] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:14.734827 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade7acc6-5dcd-48e3-a994-a190c0bd8bbf service swift] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:14.738402 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e99d68-da2c-4430-8d33-ec4f6cc30000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:14.739030 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e99d68-da2c-4430-8d33-ec4f6cc30000 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:14.739312 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e99d68-da2c-4430-8d33-ec4f6cc30000 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:14.739585 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e99d68-da2c-4430-8d33-ec4f6cc30000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:14.741399 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-62e99d68-da2c-4430-8d33-ec4f6cc30000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:14.801364 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e99d68-da2c-4430-8d33-ec4f6cc30000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:14.802714 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e99d68-da2c-4430-8d33-ec4f6cc30000 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:14.811944 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1294/2591] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:51:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:51:17.919310 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00a02d-f20c-4e87-8d1e-a3d136d2d04a service nova] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:17.920884 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fe00a02d-f20c-4e87-8d1e-a3d136d2d04a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:17.937186 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00a02d-f20c-4e87-8d1e-a3d136d2d04a service nova] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:17.942291 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cefe341-a1e5-48de-b3b3-132845fa2ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:17.943382 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefe341-a1e5-48de-b3b3-132845fa2ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:17.943736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefe341-a1e5-48de-b3b3-132845fa2ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:17.944017 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cefe341-a1e5-48de-b3b3-132845fa2ba0 admin admin] PATH_INFO: `/v3/users/2c03733c29e44e72b3c90def97071b0a` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:17.945277 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefe341-a1e5-48de-b3b3-132845fa2ba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c03733c29e44e72b3c90def97071b0a)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:17.947205 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cefe341-a1e5-48de-b3b3-132845fa2ba0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:17.992653 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6cefe341-a1e5-48de-b3b3-132845fa2ba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c03733c29e44e72b3c90def97071b0a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:17.999247 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6cefe341-a1e5-48de-b3b3-132845fa2ba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c03733c29e44e72b3c90def97071b0a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:17.999929 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6cefe341-a1e5-48de-b3b3-132845fa2ba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c03733c29e44e72b3c90def97071b0a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:18.011593 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6cefe341-a1e5-48de-b3b3-132845fa2ba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c03733c29e44e72b3c90def97071b0a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:18.019516 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6cefe341-a1e5-48de-b3b3-132845fa2ba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c03733c29e44e72b3c90def97071b0a'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:18.025483 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1298/2592] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:51:17 2022] DELETE /identity/v3/users/2c03733c29e44e72b3c90def97071b0a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:18.195165 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e99d68-da2c-4430-8d33-ec4f6cc30000 service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:18.212119 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e99d68-da2c-4430-8d33-ec4f6cc30000 service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:18.268450 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e54f4-9cc1-4c21-bcf8-2afaaf8a0bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:18.269337 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e54f4-9cc1-4c21-bcf8-2afaaf8a0bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:18.269621 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e54f4-9cc1-4c21-bcf8-2afaaf8a0bee admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:18.269906 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e54f4-9cc1-4c21-bcf8-2afaaf8a0bee admin admin] PATH_INFO: `/v3/projects/a7827bdc153a44a7a8118faf7ae0b02a` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:18.271102 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e54f4-9cc1-4c21-bcf8-2afaaf8a0bee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7827bdc153a44a7a8118faf7ae0b02a)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:18.273033 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e54f4-9cc1-4c21-bcf8-2afaaf8a0bee admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:18.316625 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a89e54f4-9cc1-4c21-bcf8-2afaaf8a0bee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7827bdc153a44a7a8118faf7ae0b02a', 'request_id': 'req-a89e54f4-9cc1-4c21-bcf8-2afaaf8a0bee'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:18.323033 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a89e54f4-9cc1-4c21-bcf8-2afaaf8a0bee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7827bdc153a44a7a8118faf7ae0b02a', 'request_id': 'req-a89e54f4-9cc1-4c21-bcf8-2afaaf8a0bee'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:18.329388 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a89e54f4-9cc1-4c21-bcf8-2afaaf8a0bee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7827bdc153a44a7a8118faf7ae0b02a', 'request_id': 'req-a89e54f4-9cc1-4c21-bcf8-2afaaf8a0bee'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:18.339218 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a89e54f4-9cc1-4c21-bcf8-2afaaf8a0bee admin admin] The token cache is being invalidate because project a7827bdc153a44a7a8118faf7ae0b02a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:51:18.339503 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a89e54f4-9cc1-4c21-bcf8-2afaaf8a0bee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:18.340139 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-a89e54f4-9cc1-4c21-bcf8-2afaaf8a0bee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:18.341670 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1295/2593] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:51:18 2022] DELETE /identity/v3/projects/a7827bdc153a44a7a8118faf7ae0b02a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:18.347378 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234311b1-7634-4216-8bd1-096d090a45b7 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:18.347773 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234311b1-7634-4216-8bd1-096d090a45b7 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:18.348118 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234311b1-7634-4216-8bd1-096d090a45b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:18.366405 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-234311b1-7634-4216-8bd1-096d090a45b7 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:18.367596 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-234311b1-7634-4216-8bd1-096d090a45b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:18.423754 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1299/2594] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:18.432187 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c2da4-b813-41a4-a543-d25a1600dd42 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:18.432475 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c2da4-b813-41a4-a543-d25a1600dd42 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:18.432748 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c2da4-b813-41a4-a543-d25a1600dd42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:18.452134 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-673c2da4-b813-41a4-a543-d25a1600dd42 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:18.453363 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-673c2da4-b813-41a4-a543-d25a1600dd42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:18.461155 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1296/2595] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:18.465252 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234311b1-7634-4216-8bd1-096d090a45b7 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:18.475161 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234311b1-7634-4216-8bd1-096d090a45b7 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:18.479765 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429087e-c10d-483f-a568-7a591f2269f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:18.480445 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429087e-c10d-483f-a568-7a591f2269f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:18.480729 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429087e-c10d-483f-a568-7a591f2269f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:18.481032 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2429087e-c10d-483f-a568-7a591f2269f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:18.481794 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429087e-c10d-483f-a568-7a591f2269f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:51:18.482102 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429087e-c10d-483f-a568-7a591f2269f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:18.483706 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2429087e-c10d-483f-a568-7a591f2269f5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:18.495678 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1300/2596] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:51:18.500041 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c2da4-b813-41a4-a543-d25a1600dd42 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:18.509288 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c2da4-b813-41a4-a543-d25a1600dd42 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:18.514105 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47846b9-130e-4d3f-a27c-da012d2c27dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:18.514737 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47846b9-130e-4d3f-a27c-da012d2c27dd admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:18.515017 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47846b9-130e-4d3f-a27c-da012d2c27dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:18.515288 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47846b9-130e-4d3f-a27c-da012d2c27dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:18.515987 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47846b9-130e-4d3f-a27c-da012d2c27dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:18.517887 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47846b9-130e-4d3f-a27c-da012d2c27dd admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:18.552920 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1297/2597] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:51:18 2022] POST /identity/v3/projects => generated 403 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:18.556957 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429087e-c10d-483f-a568-7a591f2269f5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:18.567210 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2429087e-c10d-483f-a568-7a591f2269f5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:18.619483 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41569a15-514a-413a-bd2b-b292636f9fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:18.620145 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41569a15-514a-413a-bd2b-b292636f9fdd admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:18.620530 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41569a15-514a-413a-bd2b-b292636f9fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:18.620686 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41569a15-514a-413a-bd2b-b292636f9fdd admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:18.621429 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41569a15-514a-413a-bd2b-b292636f9fdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:18.623327 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41569a15-514a-413a-bd2b-b292636f9fdd admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:18.645178 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1301/2598] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:51:18 2022] POST /identity/v3/users => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:18.656148 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47846b9-130e-4d3f-a27c-da012d2c27dd admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:18.666234 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47846b9-130e-4d3f-a27c-da012d2c27dd admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:18.670997 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e26ca-bf9b-487f-bac5-75be59a1729d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:18.672010 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e26ca-bf9b-487f-bac5-75be59a1729d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:18.672298 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e26ca-bf9b-487f-bac5-75be59a1729d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:18.672575 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e26ca-bf9b-487f-bac5-75be59a1729d admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:18.673407 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e26ca-bf9b-487f-bac5-75be59a1729d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:18.675063 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e26ca-bf9b-487f-bac5-75be59a1729d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:18.687857 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1298/2599] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:18.689289 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41569a15-514a-413a-bd2b-b292636f9fdd admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:18.700073 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41569a15-514a-413a-bd2b-b292636f9fdd admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:18.704812 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e706b-c427-4573-bc85-08f68b932e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:18.706268 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e706b-c427-4573-bc85-08f68b932e15 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:18.706554 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e706b-c427-4573-bc85-08f68b932e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:18.706829 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e706b-c427-4573-bc85-08f68b932e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:18.707565 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e706b-c427-4573-bc85-08f68b932e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:18.709200 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e706b-c427-4573-bc85-08f68b932e15 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:18.719233 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1302/2600] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:18.723938 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e26ca-bf9b-487f-bac5-75be59a1729d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:18.733836 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e26ca-bf9b-487f-bac5-75be59a1729d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:18.739201 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a57b8-0363-4868-bd61-21f7777981e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:18.740383 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a57b8-0363-4868-bd61-21f7777981e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:18.740672 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a57b8-0363-4868-bd61-21f7777981e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:18.740957 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a57b8-0363-4868-bd61-21f7777981e8 admin admin] PATH_INFO: `/v3/projects/13eddc2d258b4bea97888ada55645aa0/users/36a0b86b7c7e4b73a038d4748fa95178/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:18.757441 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a57b8-0363-4868-bd61-21f7777981e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13eddc2d258b4bea97888ada55645aa0, user_id=36a0b86b7c7e4b73a038d4748fa95178, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:18.760103 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a57b8-0363-4868-bd61-21f7777981e8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:18.773980 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1299/2601] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:51:18 2022] PUT /identity/v3/projects/13eddc2d258b4bea97888ada55645aa0/users/36a0b86b7c7e4b73a038d4748fa95178/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:18.779059 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e8341-8e87-4d2f-8dd8-83a9ca349bd3 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:18.779374 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e8341-8e87-4d2f-8dd8-83a9ca349bd3 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:18.779651 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e8341-8e87-4d2f-8dd8-83a9ca349bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:18.797383 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-3c8e8341-8e87-4d2f-8dd8-83a9ca349bd3 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:18.798567 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3c8e8341-8e87-4d2f-8dd8-83a9ca349bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:18.854913 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1303/2602] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:18.864682 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a57b8-0363-4868-bd61-21f7777981e8 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:18.866369 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-893a57b8-0363-4868-bd61-21f7777981e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:18.921411 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a57b8-0363-4868-bd61-21f7777981e8 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:18.925219 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ee46e-7c16-4c13-97bd-6426ccbbc38f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:18.925799 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ee46e-7c16-4c13-97bd-6426ccbbc38f service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:18.926088 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ee46e-7c16-4c13-97bd-6426ccbbc38f service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:18.926356 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ee46e-7c16-4c13-97bd-6426ccbbc38f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:18.935926 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ee46e-7c16-4c13-97bd-6426ccbbc38f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:18.937398 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ee46e-7c16-4c13-97bd-6426ccbbc38f service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:18.947678 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1300/2603] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:51:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:51:19.547640 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd916e-ada2-49a0-a694-9dfb6328e798 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:19.548182 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd916e-ada2-49a0-a694-9dfb6328e798 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:19.548284 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd916e-ada2-49a0-a694-9dfb6328e798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:19.579559 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-72cd916e-ada2-49a0-a694-9dfb6328e798 None None] MFA Rules not processed for user `36a0b86b7c7e4b73a038d4748fa95178`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:19.581287 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-72cd916e-ada2-49a0-a694-9dfb6328e798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:19.644036 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1304/2604] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:51:19.648638 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ee46e-7c16-4c13-97bd-6426ccbbc38f service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:19.658198 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ee46e-7c16-4c13-97bd-6426ccbbc38f service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:19.663380 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4599d-b0d4-4bed-811c-42223bbef5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:19.664030 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4599d-b0d4-4bed-811c-42223bbef5cb admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:19.664313 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4599d-b0d4-4bed-811c-42223bbef5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:19.664592 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4599d-b0d4-4bed-811c-42223bbef5cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:19.665362 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4599d-b0d4-4bed-811c-42223bbef5cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:19.667366 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4599d-b0d4-4bed-811c-42223bbef5cb admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:19.691850 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1301/2605] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:51:19 2022] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:19.695979 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd916e-ada2-49a0-a694-9dfb6328e798 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:19.707482 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd916e-ada2-49a0-a694-9dfb6328e798 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:19.762046 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a8033-670b-489f-b6a2-1f83aa5a38b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:19.762640 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a8033-670b-489f-b6a2-1f83aa5a38b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:19.762927 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a8033-670b-489f-b6a2-1f83aa5a38b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:19.763200 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a8033-670b-489f-b6a2-1f83aa5a38b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:19.763938 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a8033-670b-489f-b6a2-1f83aa5a38b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:19.765910 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a8033-670b-489f-b6a2-1f83aa5a38b0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:19.786276 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1305/2606] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:51:19 2022] POST /identity/v3/users => generated 309 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:19.790151 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4599d-b0d4-4bed-811c-42223bbef5cb admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:19.800077 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4599d-b0d4-4bed-811c-42223bbef5cb admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:19.804527 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b7af8-01fd-4fb3-b0ba-8f13ecb1155f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:19.805198 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b7af8-01fd-4fb3-b0ba-8f13ecb1155f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:19.805475 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b7af8-01fd-4fb3-b0ba-8f13ecb1155f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:19.805747 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b7af8-01fd-4fb3-b0ba-8f13ecb1155f admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:19.806632 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b7af8-01fd-4fb3-b0ba-8f13ecb1155f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:19.808212 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b7af8-01fd-4fb3-b0ba-8f13ecb1155f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:19.818350 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1302/2607] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:19.822025 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a8033-670b-489f-b6a2-1f83aa5a38b0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:19.832151 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a8033-670b-489f-b6a2-1f83aa5a38b0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:19.836752 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c2d0a-bffd-4843-8e9f-4cd9e82f31c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:19.837658 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c2d0a-bffd-4843-8e9f-4cd9e82f31c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:19.837944 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c2d0a-bffd-4843-8e9f-4cd9e82f31c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:19.838222 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c2d0a-bffd-4843-8e9f-4cd9e82f31c7 admin admin] PATH_INFO: `/v3/projects/aacbbbb1c18b441294ea673c4a72d18e/users/da0b461fdb5b4f0d962f58853f1cc691/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:19.852984 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c2d0a-bffd-4843-8e9f-4cd9e82f31c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aacbbbb1c18b441294ea673c4a72d18e, user_id=da0b461fdb5b4f0d962f58853f1cc691, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:19.855697 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c2d0a-bffd-4843-8e9f-4cd9e82f31c7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:19.868992 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1306/2608] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:51:19 2022] PUT /identity/v3/projects/aacbbbb1c18b441294ea673c4a72d18e/users/da0b461fdb5b4f0d962f58853f1cc691/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:19.873202 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b7af8-01fd-4fb3-b0ba-8f13ecb1155f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:19.883853 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b7af8-01fd-4fb3-b0ba-8f13ecb1155f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:19.936946 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393c3eb-8951-4c30-9030-942ecdcb5f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:19.937639 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393c3eb-8951-4c30-9030-942ecdcb5f0f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:19.937924 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393c3eb-8951-4c30-9030-942ecdcb5f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:19.938204 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393c3eb-8951-4c30-9030-942ecdcb5f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:19.938934 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393c3eb-8951-4c30-9030-942ecdcb5f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:19.941111 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393c3eb-8951-4c30-9030-942ecdcb5f0f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:19.950414 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1303/2609] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:19.954537 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c2d0a-bffd-4843-8e9f-4cd9e82f31c7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:19.965619 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c2d0a-bffd-4843-8e9f-4cd9e82f31c7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:19.970086 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b28266-34ed-46f3-bc95-5a1b8b9e09e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:19.970948 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b28266-34ed-46f3-bc95-5a1b8b9e09e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:19.971224 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b28266-34ed-46f3-bc95-5a1b8b9e09e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:19.971494 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b28266-34ed-46f3-bc95-5a1b8b9e09e5 admin admin] PATH_INFO: `/v3/projects/aacbbbb1c18b441294ea673c4a72d18e/users/da0b461fdb5b4f0d962f58853f1cc691/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:19.973489 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b28266-34ed-46f3-bc95-5a1b8b9e09e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aacbbbb1c18b441294ea673c4a72d18e, user_id=da0b461fdb5b4f0d962f58853f1cc691, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:19.976114 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b28266-34ed-46f3-bc95-5a1b8b9e09e5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:19.985914 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1307/2610] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:51:19 2022] PUT /identity/v3/projects/aacbbbb1c18b441294ea673c4a72d18e/users/da0b461fdb5b4f0d962f58853f1cc691/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:51:20.581703 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1608c9-5f94-462f-aad3-0f8597388211 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:20.582036 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1608c9-5f94-462f-aad3-0f8597388211 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:20.582265 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1608c9-5f94-462f-aad3-0f8597388211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:20.607622 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-dd1608c9-5f94-462f-aad3-0f8597388211 None None] MFA Rules not processed for user `da0b461fdb5b4f0d962f58853f1cc691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:20.608830 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-dd1608c9-5f94-462f-aad3-0f8597388211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:20.676676 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1304/2611] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:20 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:21.810266 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b28266-34ed-46f3-bc95-5a1b8b9e09e5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:21.870989 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b28266-34ed-46f3-bc95-5a1b8b9e09e5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:21.875505 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c625ec5-261b-472f-9e48-3f0bc3310c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:21.876361 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c625ec5-261b-472f-9e48-3f0bc3310c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:21.876643 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c625ec5-261b-472f-9e48-3f0bc3310c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:21.876925 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c625ec5-261b-472f-9e48-3f0bc3310c3f admin admin] PATH_INFO: `/v3/users/36a0b86b7c7e4b73a038d4748fa95178` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:21.878718 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c625ec5-261b-472f-9e48-3f0bc3310c3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=36a0b86b7c7e4b73a038d4748fa95178)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:21.880632 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c625ec5-261b-472f-9e48-3f0bc3310c3f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:21.923506 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0c625ec5-261b-472f-9e48-3f0bc3310c3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36a0b86b7c7e4b73a038d4748fa95178'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:21.930508 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0c625ec5-261b-472f-9e48-3f0bc3310c3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36a0b86b7c7e4b73a038d4748fa95178'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:21.931180 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0c625ec5-261b-472f-9e48-3f0bc3310c3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36a0b86b7c7e4b73a038d4748fa95178'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:21.942835 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0c625ec5-261b-472f-9e48-3f0bc3310c3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36a0b86b7c7e4b73a038d4748fa95178'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:21.949872 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0c625ec5-261b-472f-9e48-3f0bc3310c3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36a0b86b7c7e4b73a038d4748fa95178'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:21.956333 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1308/2612] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:51:21 2022] DELETE /identity/v3/users/36a0b86b7c7e4b73a038d4748fa95178 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:22.130452 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1608c9-5f94-462f-aad3-0f8597388211 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:22.149299 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1608c9-5f94-462f-aad3-0f8597388211 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:22.221932 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f8456-214e-46e4-91fb-0b18e0ee8969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:22.223212 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f8456-214e-46e4-91fb-0b18e0ee8969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:22.223586 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f8456-214e-46e4-91fb-0b18e0ee8969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:22.223859 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f8456-214e-46e4-91fb-0b18e0ee8969 admin admin] PATH_INFO: `/v3/projects/13eddc2d258b4bea97888ada55645aa0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:22.225067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f8456-214e-46e4-91fb-0b18e0ee8969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13eddc2d258b4bea97888ada55645aa0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:22.227070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f8456-214e-46e4-91fb-0b18e0ee8969 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:22.274522 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6d8f8456-214e-46e4-91fb-0b18e0ee8969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13eddc2d258b4bea97888ada55645aa0', 'request_id': 'req-6d8f8456-214e-46e4-91fb-0b18e0ee8969'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:22.281377 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6d8f8456-214e-46e4-91fb-0b18e0ee8969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13eddc2d258b4bea97888ada55645aa0', 'request_id': 'req-6d8f8456-214e-46e4-91fb-0b18e0ee8969'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:22.287922 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6d8f8456-214e-46e4-91fb-0b18e0ee8969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13eddc2d258b4bea97888ada55645aa0', 'request_id': 'req-6d8f8456-214e-46e4-91fb-0b18e0ee8969'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:22.297532 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6d8f8456-214e-46e4-91fb-0b18e0ee8969 admin admin] The token cache is being invalidate because project 13eddc2d258b4bea97888ada55645aa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:51:22.297818 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6d8f8456-214e-46e4-91fb-0b18e0ee8969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:22.298448 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-6d8f8456-214e-46e4-91fb-0b18e0ee8969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:22.300573 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1305/2613] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:51:22 2022] DELETE /identity/v3/projects/13eddc2d258b4bea97888ada55645aa0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:22.304594 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c625ec5-261b-472f-9e48-3f0bc3310c3f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:22.305996 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0c625ec5-261b-472f-9e48-3f0bc3310c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:22.318337 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c625ec5-261b-472f-9e48-3f0bc3310c3f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:22.372537 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9cf9c-ad16-40cf-8f68-21bd5ea3792a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:22.373422 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9cf9c-ad16-40cf-8f68-21bd5ea3792a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:22.373707 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9cf9c-ad16-40cf-8f68-21bd5ea3792a admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:22.373985 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9cf9c-ad16-40cf-8f68-21bd5ea3792a admin admin] PATH_INFO: `/v3/users/da0b461fdb5b4f0d962f58853f1cc691` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:22.375184 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9cf9c-ad16-40cf-8f68-21bd5ea3792a admin admin] RBAC: Authorizing `identity:delete_user(user_id=da0b461fdb5b4f0d962f58853f1cc691)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:22.377152 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9cf9c-ad16-40cf-8f68-21bd5ea3792a admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:22.421597 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a3a9cf9c-ad16-40cf-8f68-21bd5ea3792a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da0b461fdb5b4f0d962f58853f1cc691'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:22.428855 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a3a9cf9c-ad16-40cf-8f68-21bd5ea3792a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da0b461fdb5b4f0d962f58853f1cc691'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:22.429538 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a3a9cf9c-ad16-40cf-8f68-21bd5ea3792a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da0b461fdb5b4f0d962f58853f1cc691'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:22.440574 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a3a9cf9c-ad16-40cf-8f68-21bd5ea3792a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da0b461fdb5b4f0d962f58853f1cc691'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:22.447451 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a3a9cf9c-ad16-40cf-8f68-21bd5ea3792a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da0b461fdb5b4f0d962f58853f1cc691'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:22.453454 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1309/2614] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:51:22 2022] DELETE /identity/v3/users/da0b461fdb5b4f0d962f58853f1cc691 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:22.631532 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f8456-214e-46e4-91fb-0b18e0ee8969 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:22.633451 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-6d8f8456-214e-46e4-91fb-0b18e0ee8969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:22.645854 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f8456-214e-46e4-91fb-0b18e0ee8969 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:22.700584 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40f165-61ec-46f1-9e2a-77690175108b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:22.701456 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40f165-61ec-46f1-9e2a-77690175108b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:22.701739 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40f165-61ec-46f1-9e2a-77690175108b admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:22.702012 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40f165-61ec-46f1-9e2a-77690175108b admin admin] PATH_INFO: `/v3/projects/aacbbbb1c18b441294ea673c4a72d18e` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:22.703167 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40f165-61ec-46f1-9e2a-77690175108b admin admin] RBAC: Authorizing `identity:delete_project(project_id=aacbbbb1c18b441294ea673c4a72d18e)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:22.705082 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40f165-61ec-46f1-9e2a-77690175108b admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:22.749818 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-fc40f165-61ec-46f1-9e2a-77690175108b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aacbbbb1c18b441294ea673c4a72d18e', 'request_id': 'req-fc40f165-61ec-46f1-9e2a-77690175108b'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:22.758645 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-fc40f165-61ec-46f1-9e2a-77690175108b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aacbbbb1c18b441294ea673c4a72d18e', 'request_id': 'req-fc40f165-61ec-46f1-9e2a-77690175108b'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:22.765780 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-fc40f165-61ec-46f1-9e2a-77690175108b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aacbbbb1c18b441294ea673c4a72d18e', 'request_id': 'req-fc40f165-61ec-46f1-9e2a-77690175108b'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:22.775763 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-fc40f165-61ec-46f1-9e2a-77690175108b admin admin] The token cache is being invalidate because project aacbbbb1c18b441294ea673c4a72d18e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:51:22.776047 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-fc40f165-61ec-46f1-9e2a-77690175108b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:22.776665 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-fc40f165-61ec-46f1-9e2a-77690175108b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:22.778234 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1306/2615] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:51:22 2022] DELETE /identity/v3/projects/aacbbbb1c18b441294ea673c4a72d18e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:22.783851 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f2765-6a67-4070-879e-e2fceffc7cde None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:22.784143 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f2765-6a67-4070-879e-e2fceffc7cde None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:22.784444 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f2765-6a67-4070-879e-e2fceffc7cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:22.803737 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-fd8f2765-6a67-4070-879e-e2fceffc7cde None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:22.804924 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fd8f2765-6a67-4070-879e-e2fceffc7cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:22.865936 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1310/2616] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:22.879201 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408aa6-b56d-496b-8492-6069caf841d0 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:22.879487 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408aa6-b56d-496b-8492-6069caf841d0 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:22.879767 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408aa6-b56d-496b-8492-6069caf841d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:22.900003 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-57408aa6-b56d-496b-8492-6069caf841d0 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:22.901218 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-57408aa6-b56d-496b-8492-6069caf841d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:22.909440 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1307/2617] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:22.913762 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f2765-6a67-4070-879e-e2fceffc7cde None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:22.923340 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f2765-6a67-4070-879e-e2fceffc7cde None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:22.927786 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec389c-87e1-4a70-bb82-c67968b20e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:22.928458 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec389c-87e1-4a70-bb82-c67968b20e15 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:22.928741 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec389c-87e1-4a70-bb82-c67968b20e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:22.929028 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec389c-87e1-4a70-bb82-c67968b20e15 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:22.929789 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec389c-87e1-4a70-bb82-c67968b20e15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:51:22.930095 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec389c-87e1-4a70-bb82-c67968b20e15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:22.931695 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec389c-87e1-4a70-bb82-c67968b20e15 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:22.943267 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1311/2618] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:51:22.947431 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57408aa6-b56d-496b-8492-6069caf841d0 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:22.956913 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57408aa6-b56d-496b-8492-6069caf841d0 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:22.961465 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f209dc0-f1df-4fb0-8ba3-9efb32827dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:22.962086 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f209dc0-f1df-4fb0-8ba3-9efb32827dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:22.962363 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f209dc0-f1df-4fb0-8ba3-9efb32827dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:22.962635 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f209dc0-f1df-4fb0-8ba3-9efb32827dd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:22.963327 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f209dc0-f1df-4fb0-8ba3-9efb32827dd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:22.965201 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f209dc0-f1df-4fb0-8ba3-9efb32827dd9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:22.989031 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1308/2619] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:51:22 2022] POST /identity/v3/projects => generated 371 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:22.992939 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec389c-87e1-4a70-bb82-c67968b20e15 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:23.003017 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec389c-87e1-4a70-bb82-c67968b20e15 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:23.055680 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ce9b8-e38e-4176-a38a-e0dd9b8b4fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:23.056332 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ce9b8-e38e-4176-a38a-e0dd9b8b4fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:23.056612 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ce9b8-e38e-4176-a38a-e0dd9b8b4fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:23.056882 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ce9b8-e38e-4176-a38a-e0dd9b8b4fb9 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:23.057672 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ce9b8-e38e-4176-a38a-e0dd9b8b4fb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:23.059707 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ce9b8-e38e-4176-a38a-e0dd9b8b4fb9 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:23.078764 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1312/2620] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:51:22 2022] POST /identity/v3/users => generated 286 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:23.083444 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f209dc0-f1df-4fb0-8ba3-9efb32827dd9 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:23.093347 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f209dc0-f1df-4fb0-8ba3-9efb32827dd9 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:23.097817 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453569c-ce18-48d6-83d2-6c9f1b968e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:23.098452 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453569c-ce18-48d6-83d2-6c9f1b968e8f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:23.098732 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453569c-ce18-48d6-83d2-6c9f1b968e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:23.099003 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453569c-ce18-48d6-83d2-6c9f1b968e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:23.099723 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453569c-ce18-48d6-83d2-6c9f1b968e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:23.101336 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453569c-ce18-48d6-83d2-6c9f1b968e8f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:23.111138 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1309/2621] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:23.115391 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ce9b8-e38e-4176-a38a-e0dd9b8b4fb9 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:23.125012 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ce9b8-e38e-4176-a38a-e0dd9b8b4fb9 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:23.130442 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fecea9-bef6-471f-922f-a37aef0495b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:23.131083 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fecea9-bef6-471f-922f-a37aef0495b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:23.131362 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fecea9-bef6-471f-922f-a37aef0495b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:23.131632 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fecea9-bef6-471f-922f-a37aef0495b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:23.132612 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fecea9-bef6-471f-922f-a37aef0495b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:23.134230 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fecea9-bef6-471f-922f-a37aef0495b5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:23.144269 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1313/2622] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:51:23.148375 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453569c-ce18-48d6-83d2-6c9f1b968e8f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:23.158389 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453569c-ce18-48d6-83d2-6c9f1b968e8f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:23.176476 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287ea82-a9c3-4c50-8110-4bbca77a89c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:23.177415 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287ea82-a9c3-4c50-8110-4bbca77a89c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:23.177700 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287ea82-a9c3-4c50-8110-4bbca77a89c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:23.177984 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a287ea82-a9c3-4c50-8110-4bbca77a89c4 admin admin] PATH_INFO: `/v3/projects/3b222d3475bc4274bce457c30058b385/users/12e2af9ec1e64339989df63c64c7594d/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:23.194542 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287ea82-a9c3-4c50-8110-4bbca77a89c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b222d3475bc4274bce457c30058b385, user_id=12e2af9ec1e64339989df63c64c7594d, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:23.198697 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a287ea82-a9c3-4c50-8110-4bbca77a89c4 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:23.210728 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1310/2623] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:51:23 2022] PUT /identity/v3/projects/3b222d3475bc4274bce457c30058b385/users/12e2af9ec1e64339989df63c64c7594d/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:51:23.222762 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006eff8-fade-4c42-9292-529e64b2f136 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:23.223050 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006eff8-fade-4c42-9292-529e64b2f136 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:23.223327 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006eff8-fade-4c42-9292-529e64b2f136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:23.248772 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-9006eff8-fade-4c42-9292-529e64b2f136 None None] MFA Rules not processed for user `12e2af9ec1e64339989df63c64c7594d`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:23.250001 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9006eff8-fade-4c42-9292-529e64b2f136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:23.311682 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1314/2624] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:23.316148 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287ea82-a9c3-4c50-8110-4bbca77a89c4 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:23.375336 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a287ea82-a9c3-4c50-8110-4bbca77a89c4 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:23.379977 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab0c43-2d94-4053-8a5b-5bae5f7d207b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:23.380615 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab0c43-2d94-4053-8a5b-5bae5f7d207b admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:23.380894 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab0c43-2d94-4053-8a5b-5bae5f7d207b admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:23.381202 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab0c43-2d94-4053-8a5b-5bae5f7d207b admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:23.382149 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab0c43-2d94-4053-8a5b-5bae5f7d207b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:23.384031 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab0c43-2d94-4053-8a5b-5bae5f7d207b admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:23.407777 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1311/2625] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:51:23 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:23.412505 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006eff8-fade-4c42-9292-529e64b2f136 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:23.422836 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006eff8-fade-4c42-9292-529e64b2f136 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:23.476525 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3a315-433d-4fd1-83e2-827ef530a98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:23.477216 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3a315-433d-4fd1-83e2-827ef530a98b admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:23.477502 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3a315-433d-4fd1-83e2-827ef530a98b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:23.477776 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3a315-433d-4fd1-83e2-827ef530a98b admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:23.478478 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3a315-433d-4fd1-83e2-827ef530a98b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:23.480371 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3a315-433d-4fd1-83e2-827ef530a98b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:23.499466 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1315/2626] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:51:23 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:23.504112 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab0c43-2d94-4053-8a5b-5bae5f7d207b admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:23.514380 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab0c43-2d94-4053-8a5b-5bae5f7d207b admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:23.518981 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126317b9-9693-4636-b091-1ddea1f784d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:23.519626 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126317b9-9693-4636-b091-1ddea1f784d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:23.519913 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126317b9-9693-4636-b091-1ddea1f784d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:23.520194 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126317b9-9693-4636-b091-1ddea1f784d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:23.520928 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126317b9-9693-4636-b091-1ddea1f784d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:23.522534 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126317b9-9693-4636-b091-1ddea1f784d7 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:23.532593 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1312/2627] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:23.536519 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3a315-433d-4fd1-83e2-827ef530a98b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:23.546130 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3a315-433d-4fd1-83e2-827ef530a98b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:23.551735 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720332b-6c49-4ca3-ab2f-16cc5bf180b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:23.552706 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720332b-6c49-4ca3-ab2f-16cc5bf180b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:23.553156 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720332b-6c49-4ca3-ab2f-16cc5bf180b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:23.553532 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720332b-6c49-4ca3-ab2f-16cc5bf180b4 admin admin] PATH_INFO: `/v3/projects/11c3705b271c489c96e927ca609b3c5e/users/b8e447f992524a3785783bce47d1e46b/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:23.570827 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8720332b-6c49-4ca3-ab2f-16cc5bf180b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c3705b271c489c96e927ca609b3c5e, user_id=b8e447f992524a3785783bce47d1e46b, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:23.573463 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8720332b-6c49-4ca3-ab2f-16cc5bf180b4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:23.586205 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1316/2628] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:51:23 2022] PUT /identity/v3/projects/11c3705b271c489c96e927ca609b3c5e/users/b8e447f992524a3785783bce47d1e46b/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:23.590182 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126317b9-9693-4636-b091-1ddea1f784d7 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:23.599962 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126317b9-9693-4636-b091-1ddea1f784d7 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:23.653868 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876483a9-6538-471a-905f-c383384abe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:23.654518 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876483a9-6538-471a-905f-c383384abe2a admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:23.654804 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876483a9-6538-471a-905f-c383384abe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:23.655081 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876483a9-6538-471a-905f-c383384abe2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:23.655813 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876483a9-6538-471a-905f-c383384abe2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:23.657443 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876483a9-6538-471a-905f-c383384abe2a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:23.667556 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1313/2629] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:23.671609 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720332b-6c49-4ca3-ab2f-16cc5bf180b4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:23.682490 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720332b-6c49-4ca3-ab2f-16cc5bf180b4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:23.687170 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e01b23-42dd-4709-a5cd-b92eba35647f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:23.688045 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e01b23-42dd-4709-a5cd-b92eba35647f admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:23.688332 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e01b23-42dd-4709-a5cd-b92eba35647f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:23.688613 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e01b23-42dd-4709-a5cd-b92eba35647f admin admin] PATH_INFO: `/v3/projects/11c3705b271c489c96e927ca609b3c5e/users/b8e447f992524a3785783bce47d1e46b/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:23.690627 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e01b23-42dd-4709-a5cd-b92eba35647f admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c3705b271c489c96e927ca609b3c5e, user_id=b8e447f992524a3785783bce47d1e46b, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:23.693311 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e01b23-42dd-4709-a5cd-b92eba35647f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:23.703247 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1317/2630] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:51:23 2022] PUT /identity/v3/projects/11c3705b271c489c96e927ca609b3c5e/users/b8e447f992524a3785783bce47d1e46b/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:51:23.713146 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11956d-110f-473d-9e23-06bf78004990 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:23.713464 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11956d-110f-473d-9e23-06bf78004990 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:23.713747 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11956d-110f-473d-9e23-06bf78004990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:23.740069 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-aa11956d-110f-473d-9e23-06bf78004990 None None] MFA Rules not processed for user `b8e447f992524a3785783bce47d1e46b`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:23.741309 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-aa11956d-110f-473d-9e23-06bf78004990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:23.805787 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1314/2631] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:23.815567 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e01b23-42dd-4709-a5cd-b92eba35647f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:23.817362 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e6e01b23-42dd-4709-a5cd-b92eba35647f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:23.873254 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e01b23-42dd-4709-a5cd-b92eba35647f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:23.876914 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b0dc0-f5dd-4903-9d91-62becb18cd2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:23.877703 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b0dc0-f5dd-4903-9d91-62becb18cd2f service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:23.877991 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b0dc0-f5dd-4903-9d91-62becb18cd2f service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:23.878344 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b0dc0-f5dd-4903-9d91-62becb18cd2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:23.888081 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b0dc0-f5dd-4903-9d91-62becb18cd2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:23.889582 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b0dc0-f5dd-4903-9d91-62becb18cd2f service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:23.899951 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1318/2632] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:51:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:51:24.250366 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11956d-110f-473d-9e23-06bf78004990 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:24.310513 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11956d-110f-473d-9e23-06bf78004990 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:24.315634 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd7f4a-2677-4d2e-93b1-7c4359966038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:24.316486 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd7f4a-2677-4d2e-93b1-7c4359966038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:24.316768 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd7f4a-2677-4d2e-93b1-7c4359966038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:24.317069 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd7f4a-2677-4d2e-93b1-7c4359966038 admin admin] PATH_INFO: `/v3/users/12e2af9ec1e64339989df63c64c7594d` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:24.318250 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd7f4a-2677-4d2e-93b1-7c4359966038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e2af9ec1e64339989df63c64c7594d)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:24.320151 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd7f4a-2677-4d2e-93b1-7c4359966038 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:24.364074 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-5bfd7f4a-2677-4d2e-93b1-7c4359966038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e2af9ec1e64339989df63c64c7594d'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:24.370562 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-5bfd7f4a-2677-4d2e-93b1-7c4359966038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e2af9ec1e64339989df63c64c7594d'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:24.371210 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-5bfd7f4a-2677-4d2e-93b1-7c4359966038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e2af9ec1e64339989df63c64c7594d'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:24.383179 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-5bfd7f4a-2677-4d2e-93b1-7c4359966038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e2af9ec1e64339989df63c64c7594d'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:24.389970 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-5bfd7f4a-2677-4d2e-93b1-7c4359966038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e2af9ec1e64339989df63c64c7594d'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:24.395738 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1315/2633] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:51:24 2022] DELETE /identity/v3/users/12e2af9ec1e64339989df63c64c7594d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:51:24.400454 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f44f3-0b95-4cf2-a8fd-f23dcded6125 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:24.400744 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f44f3-0b95-4cf2-a8fd-f23dcded6125 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:24.401074 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f44f3-0b95-4cf2-a8fd-f23dcded6125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:24.418673 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d02f44f3-0b95-4cf2-a8fd-f23dcded6125 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:24.419869 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d02f44f3-0b95-4cf2-a8fd-f23dcded6125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:24.475160 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1319/2634] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:24.484975 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd7f4a-2677-4d2e-93b1-7c4359966038 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:24.486384 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-5bfd7f4a-2677-4d2e-93b1-7c4359966038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:24.542767 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd7f4a-2677-4d2e-93b1-7c4359966038 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:24.546479 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd986ac-0b7a-4c2b-9469-c0699547e411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:24.547125 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd986ac-0b7a-4c2b-9469-c0699547e411 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:24.547407 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd986ac-0b7a-4c2b-9469-c0699547e411 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:24.547682 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd986ac-0b7a-4c2b-9469-c0699547e411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:24.557448 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd986ac-0b7a-4c2b-9469-c0699547e411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:24.558868 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd986ac-0b7a-4c2b-9469-c0699547e411 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:24.568013 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1316/2635] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:51:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:51:25.032057 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f44f3-0b95-4cf2-a8fd-f23dcded6125 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:25.033629 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d02f44f3-0b95-4cf2-a8fd-f23dcded6125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:25.045787 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f44f3-0b95-4cf2-a8fd-f23dcded6125 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:25.051051 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde3f31-4f3c-4cc4-8674-22b06fa56d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:25.051965 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde3f31-4f3c-4cc4-8674-22b06fa56d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:25.052249 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde3f31-4f3c-4cc4-8674-22b06fa56d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:25.052526 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde3f31-4f3c-4cc4-8674-22b06fa56d72 admin admin] PATH_INFO: `/v3/projects/3b222d3475bc4274bce457c30058b385` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:25.053748 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde3f31-4f3c-4cc4-8674-22b06fa56d72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b222d3475bc4274bce457c30058b385)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:25.055672 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde3f31-4f3c-4cc4-8674-22b06fa56d72 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:25.100537 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6cde3f31-4f3c-4cc4-8674-22b06fa56d72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b222d3475bc4274bce457c30058b385', 'request_id': 'req-6cde3f31-4f3c-4cc4-8674-22b06fa56d72'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:25.106463 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6cde3f31-4f3c-4cc4-8674-22b06fa56d72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b222d3475bc4274bce457c30058b385', 'request_id': 'req-6cde3f31-4f3c-4cc4-8674-22b06fa56d72'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:25.114058 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6cde3f31-4f3c-4cc4-8674-22b06fa56d72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b222d3475bc4274bce457c30058b385', 'request_id': 'req-6cde3f31-4f3c-4cc4-8674-22b06fa56d72'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:25.124185 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6cde3f31-4f3c-4cc4-8674-22b06fa56d72 admin admin] The token cache is being invalidate because project 3b222d3475bc4274bce457c30058b385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:51:25.124474 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6cde3f31-4f3c-4cc4-8674-22b06fa56d72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:25.125163 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-6cde3f31-4f3c-4cc4-8674-22b06fa56d72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:25.126662 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1320/2636] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:51:25 2022] DELETE /identity/v3/projects/3b222d3475bc4274bce457c30058b385 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:25.131800 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd986ac-0b7a-4c2b-9469-c0699547e411 service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:25.142534 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd986ac-0b7a-4c2b-9469-c0699547e411 service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:25.197211 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47b987-8845-43a3-a779-a20ead5259f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:25.198317 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47b987-8845-43a3-a779-a20ead5259f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:25.198607 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47b987-8845-43a3-a779-a20ead5259f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:25.198881 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47b987-8845-43a3-a779-a20ead5259f5 admin admin] PATH_INFO: `/v3/users/b8e447f992524a3785783bce47d1e46b` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:25.200130 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47b987-8845-43a3-a779-a20ead5259f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e447f992524a3785783bce47d1e46b)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:25.202090 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47b987-8845-43a3-a779-a20ead5259f5 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:25.247112 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0c47b987-8845-43a3-a779-a20ead5259f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e447f992524a3785783bce47d1e46b'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:25.253591 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0c47b987-8845-43a3-a779-a20ead5259f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e447f992524a3785783bce47d1e46b'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:25.254320 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0c47b987-8845-43a3-a779-a20ead5259f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e447f992524a3785783bce47d1e46b'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:25.266166 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0c47b987-8845-43a3-a779-a20ead5259f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e447f992524a3785783bce47d1e46b'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:25.272939 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0c47b987-8845-43a3-a779-a20ead5259f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e447f992524a3785783bce47d1e46b'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:25.278725 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1317/2637] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:51:25 2022] DELETE /identity/v3/users/b8e447f992524a3785783bce47d1e46b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:25.529744 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde3f31-4f3c-4cc4-8674-22b06fa56d72 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:25.531175 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6cde3f31-4f3c-4cc4-8674-22b06fa56d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:25.546599 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde3f31-4f3c-4cc4-8674-22b06fa56d72 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:25.605155 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab5fcd-2511-414f-ac5d-0f81bafd7b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:25.605993 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab5fcd-2511-414f-ac5d-0f81bafd7b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:25.606274 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab5fcd-2511-414f-ac5d-0f81bafd7b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:25.606547 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab5fcd-2511-414f-ac5d-0f81bafd7b01 admin admin] PATH_INFO: `/v3/projects/11c3705b271c489c96e927ca609b3c5e` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:25.607721 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab5fcd-2511-414f-ac5d-0f81bafd7b01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11c3705b271c489c96e927ca609b3c5e)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:25.609703 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ab5fcd-2511-414f-ac5d-0f81bafd7b01 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:25.657216 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-70ab5fcd-2511-414f-ac5d-0f81bafd7b01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11c3705b271c489c96e927ca609b3c5e', 'request_id': 'req-70ab5fcd-2511-414f-ac5d-0f81bafd7b01'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:25.663554 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-70ab5fcd-2511-414f-ac5d-0f81bafd7b01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11c3705b271c489c96e927ca609b3c5e', 'request_id': 'req-70ab5fcd-2511-414f-ac5d-0f81bafd7b01'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:25.670430 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-70ab5fcd-2511-414f-ac5d-0f81bafd7b01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11c3705b271c489c96e927ca609b3c5e', 'request_id': 'req-70ab5fcd-2511-414f-ac5d-0f81bafd7b01'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:25.680251 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-70ab5fcd-2511-414f-ac5d-0f81bafd7b01 admin admin] The token cache is being invalidate because project 11c3705b271c489c96e927ca609b3c5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:51:25.680535 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-70ab5fcd-2511-414f-ac5d-0f81bafd7b01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:25.681192 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-70ab5fcd-2511-414f-ac5d-0f81bafd7b01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:25.682711 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1321/2638] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:51:25 2022] DELETE /identity/v3/projects/11c3705b271c489c96e927ca609b3c5e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:25.688289 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54870e5f-49c9-4f61-becc-6fe63a6eadf6 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:25.688577 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54870e5f-49c9-4f61-becc-6fe63a6eadf6 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:25.688856 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54870e5f-49c9-4f61-becc-6fe63a6eadf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:25.706537 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-54870e5f-49c9-4f61-becc-6fe63a6eadf6 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:25.707723 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-54870e5f-49c9-4f61-becc-6fe63a6eadf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:25.762948 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1318/2639] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:25.771141 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2e054-0749-4fdf-8dce-83b8b7222421 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:25.771428 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2e054-0749-4fdf-8dce-83b8b7222421 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:25.771706 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2e054-0749-4fdf-8dce-83b8b7222421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:25.789522 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-9ad2e054-0749-4fdf-8dce-83b8b7222421 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:25.790641 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-9ad2e054-0749-4fdf-8dce-83b8b7222421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:25.798197 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1322/2640] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:25.802663 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54870e5f-49c9-4f61-becc-6fe63a6eadf6 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:25.811978 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54870e5f-49c9-4f61-becc-6fe63a6eadf6 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:25.817111 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4e244-0205-417c-83ff-87e637c05d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:25.817746 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4e244-0205-417c-83ff-87e637c05d0e admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:25.818030 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4e244-0205-417c-83ff-87e637c05d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:25.818306 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4e244-0205-417c-83ff-87e637c05d0e admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:25.819036 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4e244-0205-417c-83ff-87e637c05d0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:51:25.819342 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4e244-0205-417c-83ff-87e637c05d0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:25.820926 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb4e244-0205-417c-83ff-87e637c05d0e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:25.831968 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1319/2641] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:51:25.837190 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2e054-0749-4fdf-8dce-83b8b7222421 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:25.847487 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2e054-0749-4fdf-8dce-83b8b7222421 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:25.852107 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dab161-ae7d-4123-b14c-05532abce436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:25.852816 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dab161-ae7d-4123-b14c-05532abce436 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:25.853134 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dab161-ae7d-4123-b14c-05532abce436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:25.853413 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dab161-ae7d-4123-b14c-05532abce436 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:25.854105 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dab161-ae7d-4123-b14c-05532abce436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:25.856005 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dab161-ae7d-4123-b14c-05532abce436 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:25.881054 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1323/2642] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:51:25 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:25.885627 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4e244-0205-417c-83ff-87e637c05d0e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:25.895360 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4e244-0205-417c-83ff-87e637c05d0e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:25.948642 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942680a-0a5c-4e1a-85c9-05466b1db958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:25.949339 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942680a-0a5c-4e1a-85c9-05466b1db958 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:25.949627 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942680a-0a5c-4e1a-85c9-05466b1db958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:25.949902 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942680a-0a5c-4e1a-85c9-05466b1db958 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:25.950629 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942680a-0a5c-4e1a-85c9-05466b1db958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:25.952544 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942680a-0a5c-4e1a-85c9-05466b1db958 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:25.971981 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1320/2643] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:51:25 2022] POST /identity/v3/users => generated 284 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:25.976055 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dab161-ae7d-4123-b14c-05532abce436 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:25.986101 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dab161-ae7d-4123-b14c-05532abce436 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:25.991206 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925326aa-3102-4c11-9d5e-91412ecf7062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:25.991850 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925326aa-3102-4c11-9d5e-91412ecf7062 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:25.992133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925326aa-3102-4c11-9d5e-91412ecf7062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:25.992407 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925326aa-3102-4c11-9d5e-91412ecf7062 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:25.993178 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925326aa-3102-4c11-9d5e-91412ecf7062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:25.994766 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925326aa-3102-4c11-9d5e-91412ecf7062 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:26.005235 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1324/2644] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:26.009107 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942680a-0a5c-4e1a-85c9-05466b1db958 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:26.019639 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942680a-0a5c-4e1a-85c9-05466b1db958 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:26.024270 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb548f8-56b8-415e-826c-42259b205252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:26.024916 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb548f8-56b8-415e-826c-42259b205252 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:26.025231 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb548f8-56b8-415e-826c-42259b205252 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:26.025511 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb548f8-56b8-415e-826c-42259b205252 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:26.026241 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb548f8-56b8-415e-826c-42259b205252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:26.027817 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb548f8-56b8-415e-826c-42259b205252 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:26.037437 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1321/2645] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:26.041393 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925326aa-3102-4c11-9d5e-91412ecf7062 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:26.050888 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925326aa-3102-4c11-9d5e-91412ecf7062 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:26.055613 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4010b-6426-4539-993f-5fd29ae8203b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:26.056481 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4010b-6426-4539-993f-5fd29ae8203b admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:26.056763 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4010b-6426-4539-993f-5fd29ae8203b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:26.057067 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e4010b-6426-4539-993f-5fd29ae8203b admin admin] PATH_INFO: `/v3/projects/440911e0bc16437d93b5af8588da2746/users/64e12dc04a354914adb3051c15c945e6/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:26.073277 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4010b-6426-4539-993f-5fd29ae8203b admin admin] RBAC: Authorizing `identity:create_grant(project_id=440911e0bc16437d93b5af8588da2746, user_id=64e12dc04a354914adb3051c15c945e6, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:26.075928 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e4010b-6426-4539-993f-5fd29ae8203b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:26.089349 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1325/2646] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:51:26 2022] PUT /identity/v3/projects/440911e0bc16437d93b5af8588da2746/users/64e12dc04a354914adb3051c15c945e6/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:26.100550 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c829d-6adb-43d9-8f46-9600995c48d1 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:26.100845 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c829d-6adb-43d9-8f46-9600995c48d1 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:26.101157 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c829d-6adb-43d9-8f46-9600995c48d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:26.127022 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-663c829d-6adb-43d9-8f46-9600995c48d1 None None] MFA Rules not processed for user `64e12dc04a354914adb3051c15c945e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:26.128742 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-663c829d-6adb-43d9-8f46-9600995c48d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:26.191348 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1322/2647] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:26.196214 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4010b-6426-4539-993f-5fd29ae8203b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:26.257366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e4010b-6426-4539-993f-5fd29ae8203b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:26.262018 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7905ea-b277-42a6-ab59-e45f58dec74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:26.262635 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7905ea-b277-42a6-ab59-e45f58dec74f admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:26.262917 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7905ea-b277-42a6-ab59-e45f58dec74f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:26.263191 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7905ea-b277-42a6-ab59-e45f58dec74f admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:26.263926 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7905ea-b277-42a6-ab59-e45f58dec74f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:26.265877 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7905ea-b277-42a6-ab59-e45f58dec74f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:26.289838 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1326/2648] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:51:26 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:26.293941 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c829d-6adb-43d9-8f46-9600995c48d1 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:26.305062 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c829d-6adb-43d9-8f46-9600995c48d1 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:26.360950 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918db23-970f-45e9-b320-88c30c8587d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:26.361641 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918db23-970f-45e9-b320-88c30c8587d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:26.361963 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918db23-970f-45e9-b320-88c30c8587d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:26.362239 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918db23-970f-45e9-b320-88c30c8587d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:26.362954 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918db23-970f-45e9-b320-88c30c8587d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:26.364829 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918db23-970f-45e9-b320-88c30c8587d3 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:26.384243 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1323/2649] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:51:26 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:26.388289 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7905ea-b277-42a6-ab59-e45f58dec74f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:26.399259 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7905ea-b277-42a6-ab59-e45f58dec74f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:26.403985 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df879f-3969-4462-bfad-2024aa7355f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:26.404785 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df879f-3969-4462-bfad-2024aa7355f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:26.405222 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df879f-3969-4462-bfad-2024aa7355f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:26.405539 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df879f-3969-4462-bfad-2024aa7355f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:26.406493 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df879f-3969-4462-bfad-2024aa7355f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:26.408429 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df879f-3969-4462-bfad-2024aa7355f4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:26.419254 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1327/2650] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:26.423262 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918db23-970f-45e9-b320-88c30c8587d3 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:26.432903 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918db23-970f-45e9-b320-88c30c8587d3 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:26.437528 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d31d19-21ce-42af-8367-9a1bef22a20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:26.438402 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d31d19-21ce-42af-8367-9a1bef22a20a admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:26.438686 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d31d19-21ce-42af-8367-9a1bef22a20a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:26.438959 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d31d19-21ce-42af-8367-9a1bef22a20a admin admin] PATH_INFO: `/v3/projects/ad1f20bb93cd482ebec25851ed1bb974/users/036bba00de2442a98dfa2e4e28fa9971/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:26.452860 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d31d19-21ce-42af-8367-9a1bef22a20a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1f20bb93cd482ebec25851ed1bb974, user_id=036bba00de2442a98dfa2e4e28fa9971, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:26.456094 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d31d19-21ce-42af-8367-9a1bef22a20a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:26.468664 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1324/2651] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:51:26 2022] PUT /identity/v3/projects/ad1f20bb93cd482ebec25851ed1bb974/users/036bba00de2442a98dfa2e4e28fa9971/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:26.473091 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df879f-3969-4462-bfad-2024aa7355f4 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:26.482691 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df879f-3969-4462-bfad-2024aa7355f4 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:26.536020 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48147f3-3ea6-458e-8f37-0b4332e99e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:26.536668 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48147f3-3ea6-458e-8f37-0b4332e99e8f admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:26.536950 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48147f3-3ea6-458e-8f37-0b4332e99e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:26.537254 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48147f3-3ea6-458e-8f37-0b4332e99e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:26.537980 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48147f3-3ea6-458e-8f37-0b4332e99e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:26.539566 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48147f3-3ea6-458e-8f37-0b4332e99e8f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:26.549041 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1328/2652] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:26.553524 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d31d19-21ce-42af-8367-9a1bef22a20a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:26.563546 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d31d19-21ce-42af-8367-9a1bef22a20a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:26.568890 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36426632-54c4-4bf5-82a4-77b9e443c12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:26.569789 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36426632-54c4-4bf5-82a4-77b9e443c12d admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:26.570067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36426632-54c4-4bf5-82a4-77b9e443c12d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:26.570494 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36426632-54c4-4bf5-82a4-77b9e443c12d admin admin] PATH_INFO: `/v3/projects/ad1f20bb93cd482ebec25851ed1bb974/users/036bba00de2442a98dfa2e4e28fa9971/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:26.572458 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36426632-54c4-4bf5-82a4-77b9e443c12d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1f20bb93cd482ebec25851ed1bb974, user_id=036bba00de2442a98dfa2e4e28fa9971, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:26.575757 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36426632-54c4-4bf5-82a4-77b9e443c12d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:26.586066 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1325/2653] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:51:26 2022] PUT /identity/v3/projects/ad1f20bb93cd482ebec25851ed1bb974/users/036bba00de2442a98dfa2e4e28fa9971/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:51:26.596143 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d07c47-731d-45ac-83b7-c54d542ad3df None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:26.596455 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d07c47-731d-45ac-83b7-c54d542ad3df None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:26.596727 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d07c47-731d-45ac-83b7-c54d542ad3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:26.622761 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-53d07c47-731d-45ac-83b7-c54d542ad3df None None] MFA Rules not processed for user `036bba00de2442a98dfa2e4e28fa9971`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:26.623376 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-53d07c47-731d-45ac-83b7-c54d542ad3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:26.692551 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1329/2654] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:26 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:26.701875 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36426632-54c4-4bf5-82a4-77b9e443c12d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:26.703551 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-36426632-54c4-4bf5-82a4-77b9e443c12d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:26.758448 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36426632-54c4-4bf5-82a4-77b9e443c12d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:26.762083 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149215fc-e6be-4748-b9df-854a07431713 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:26.762708 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149215fc-e6be-4748-b9df-854a07431713 service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:26.763023 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149215fc-e6be-4748-b9df-854a07431713 service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:26.763345 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149215fc-e6be-4748-b9df-854a07431713 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:26.772043 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149215fc-e6be-4748-b9df-854a07431713 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:26.773498 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149215fc-e6be-4748-b9df-854a07431713 service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:26.782561 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1326/2655] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:51:26 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:51:27.988236 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d07c47-731d-45ac-83b7-c54d542ad3df None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:28.046464 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d07c47-731d-45ac-83b7-c54d542ad3df None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:28.051428 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a86fd-eea3-4f32-b636-4e9e6f60dd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:28.052281 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a86fd-eea3-4f32-b636-4e9e6f60dd45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:28.052567 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a86fd-eea3-4f32-b636-4e9e6f60dd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:28.052846 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a86fd-eea3-4f32-b636-4e9e6f60dd45 admin admin] PATH_INFO: `/v3/users/64e12dc04a354914adb3051c15c945e6` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:28.054070 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a86fd-eea3-4f32-b636-4e9e6f60dd45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64e12dc04a354914adb3051c15c945e6)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:28.055991 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a86fd-eea3-4f32-b636-4e9e6f60dd45 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:28.099576 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a32a86fd-eea3-4f32-b636-4e9e6f60dd45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64e12dc04a354914adb3051c15c945e6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:28.106038 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a32a86fd-eea3-4f32-b636-4e9e6f60dd45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64e12dc04a354914adb3051c15c945e6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:28.106630 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a32a86fd-eea3-4f32-b636-4e9e6f60dd45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64e12dc04a354914adb3051c15c945e6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:28.117523 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a32a86fd-eea3-4f32-b636-4e9e6f60dd45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64e12dc04a354914adb3051c15c945e6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:28.124096 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a32a86fd-eea3-4f32-b636-4e9e6f60dd45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64e12dc04a354914adb3051c15c945e6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:28.130220 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1330/2656] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:51:27 2022] DELETE /identity/v3/users/64e12dc04a354914adb3051c15c945e6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:28.135088 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ffec7-6f61-4630-bf19-67e68d7161b7 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:28.135631 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ffec7-6f61-4630-bf19-67e68d7161b7 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:28.135631 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ffec7-6f61-4630-bf19-67e68d7161b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:28.154970 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-5e9ffec7-6f61-4630-bf19-67e68d7161b7 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:28.156179 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-5e9ffec7-6f61-4630-bf19-67e68d7161b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:28.212274 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1327/2657] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:28.222250 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a86fd-eea3-4f32-b636-4e9e6f60dd45 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:28.223642 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a32a86fd-eea3-4f32-b636-4e9e6f60dd45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:28.277359 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a86fd-eea3-4f32-b636-4e9e6f60dd45 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:28.280897 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e40240-3d77-44da-99d4-f42edbb66ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:28.281554 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e40240-3d77-44da-99d4-f42edbb66ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:28.281834 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e40240-3d77-44da-99d4-f42edbb66ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:28.282107 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e40240-3d77-44da-99d4-f42edbb66ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:28.290797 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e40240-3d77-44da-99d4-f42edbb66ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:28.292211 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e40240-3d77-44da-99d4-f42edbb66ff1 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:28.301323 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1331/2658] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:51:28.555741 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ffec7-6f61-4630-bf19-67e68d7161b7 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:28.557438 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-5e9ffec7-6f61-4630-bf19-67e68d7161b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:28.578580 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ffec7-6f61-4630-bf19-67e68d7161b7 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:28.583726 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537cbee-a5a6-4307-9c36-5e7e0f2943d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:28.584670 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537cbee-a5a6-4307-9c36-5e7e0f2943d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:28.584845 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537cbee-a5a6-4307-9c36-5e7e0f2943d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:28.585192 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537cbee-a5a6-4307-9c36-5e7e0f2943d1 admin admin] PATH_INFO: `/v3/projects/440911e0bc16437d93b5af8588da2746` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:28.586388 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537cbee-a5a6-4307-9c36-5e7e0f2943d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=440911e0bc16437d93b5af8588da2746)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:28.588282 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537cbee-a5a6-4307-9c36-5e7e0f2943d1 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:28.632756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0537cbee-a5a6-4307-9c36-5e7e0f2943d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '440911e0bc16437d93b5af8588da2746', 'request_id': 'req-0537cbee-a5a6-4307-9c36-5e7e0f2943d1'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:28.640088 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0537cbee-a5a6-4307-9c36-5e7e0f2943d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '440911e0bc16437d93b5af8588da2746', 'request_id': 'req-0537cbee-a5a6-4307-9c36-5e7e0f2943d1'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:28.646912 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0537cbee-a5a6-4307-9c36-5e7e0f2943d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '440911e0bc16437d93b5af8588da2746', 'request_id': 'req-0537cbee-a5a6-4307-9c36-5e7e0f2943d1'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:28.656596 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0537cbee-a5a6-4307-9c36-5e7e0f2943d1 admin admin] The token cache is being invalidate because project 440911e0bc16437d93b5af8588da2746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:51:28.657516 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0537cbee-a5a6-4307-9c36-5e7e0f2943d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:28.658156 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0537cbee-a5a6-4307-9c36-5e7e0f2943d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:28.660251 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1328/2659] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:51:28 2022] DELETE /identity/v3/projects/440911e0bc16437d93b5af8588da2746 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:51:28.664421 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e40240-3d77-44da-99d4-f42edbb66ff1 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:28.673986 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e40240-3d77-44da-99d4-f42edbb66ff1 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:28.728473 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b57f361-dc85-4c99-b2f2-d8cf45fcdf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:28.729357 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57f361-dc85-4c99-b2f2-d8cf45fcdf90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:28.729637 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57f361-dc85-4c99-b2f2-d8cf45fcdf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:28.729911 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b57f361-dc85-4c99-b2f2-d8cf45fcdf90 admin admin] PATH_INFO: `/v3/users/036bba00de2442a98dfa2e4e28fa9971` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:28.731089 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b57f361-dc85-4c99-b2f2-d8cf45fcdf90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=036bba00de2442a98dfa2e4e28fa9971)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:28.733030 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b57f361-dc85-4c99-b2f2-d8cf45fcdf90 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:28.778559 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-7b57f361-dc85-4c99-b2f2-d8cf45fcdf90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '036bba00de2442a98dfa2e4e28fa9971'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:28.785242 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-7b57f361-dc85-4c99-b2f2-d8cf45fcdf90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '036bba00de2442a98dfa2e4e28fa9971'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:28.785935 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-7b57f361-dc85-4c99-b2f2-d8cf45fcdf90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '036bba00de2442a98dfa2e4e28fa9971'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:28.797126 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-7b57f361-dc85-4c99-b2f2-d8cf45fcdf90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '036bba00de2442a98dfa2e4e28fa9971'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:28.804496 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-7b57f361-dc85-4c99-b2f2-d8cf45fcdf90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '036bba00de2442a98dfa2e4e28fa9971'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:28.810376 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1332/2660] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:51:28 2022] DELETE /identity/v3/users/036bba00de2442a98dfa2e4e28fa9971 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:29.066438 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537cbee-a5a6-4307-9c36-5e7e0f2943d1 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:29.067887 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-0537cbee-a5a6-4307-9c36-5e7e0f2943d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:29.080557 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537cbee-a5a6-4307-9c36-5e7e0f2943d1 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:29.134553 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38ed7f-1e4e-438f-bc1e-4ba73e27df3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:29.135401 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38ed7f-1e4e-438f-bc1e-4ba73e27df3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:29.135956 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38ed7f-1e4e-438f-bc1e-4ba73e27df3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:29.135956 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38ed7f-1e4e-438f-bc1e-4ba73e27df3a admin admin] PATH_INFO: `/v3/projects/ad1f20bb93cd482ebec25851ed1bb974` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:29.137150 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38ed7f-1e4e-438f-bc1e-4ba73e27df3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad1f20bb93cd482ebec25851ed1bb974)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:29.139061 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38ed7f-1e4e-438f-bc1e-4ba73e27df3a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:29.187818 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-ca38ed7f-1e4e-438f-bc1e-4ba73e27df3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad1f20bb93cd482ebec25851ed1bb974', 'request_id': 'req-ca38ed7f-1e4e-438f-bc1e-4ba73e27df3a'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:29.194699 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-ca38ed7f-1e4e-438f-bc1e-4ba73e27df3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad1f20bb93cd482ebec25851ed1bb974', 'request_id': 'req-ca38ed7f-1e4e-438f-bc1e-4ba73e27df3a'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:29.200737 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-ca38ed7f-1e4e-438f-bc1e-4ba73e27df3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad1f20bb93cd482ebec25851ed1bb974', 'request_id': 'req-ca38ed7f-1e4e-438f-bc1e-4ba73e27df3a'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:29.210495 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-ca38ed7f-1e4e-438f-bc1e-4ba73e27df3a admin admin] The token cache is being invalidate because project ad1f20bb93cd482ebec25851ed1bb974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:51:29.210777 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-ca38ed7f-1e4e-438f-bc1e-4ba73e27df3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:29.211395 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-ca38ed7f-1e4e-438f-bc1e-4ba73e27df3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:29.212967 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1329/2661] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:51:29 2022] DELETE /identity/v3/projects/ad1f20bb93cd482ebec25851ed1bb974 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:29.218633 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809f1fd-d6e3-491a-914b-925f2a9134c5 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:29.219141 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809f1fd-d6e3-491a-914b-925f2a9134c5 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:29.219375 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a809f1fd-d6e3-491a-914b-925f2a9134c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:29.237973 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a809f1fd-d6e3-491a-914b-925f2a9134c5 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:29.239152 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a809f1fd-d6e3-491a-914b-925f2a9134c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:29.295240 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1333/2662] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:29.304324 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce2131-b628-494e-bc92-3885aaa2b6e7 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:29.304611 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce2131-b628-494e-bc92-3885aaa2b6e7 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:29.304889 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce2131-b628-494e-bc92-3885aaa2b6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:29.322985 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-70ce2131-b628-494e-bc92-3885aaa2b6e7 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:29.324215 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-70ce2131-b628-494e-bc92-3885aaa2b6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:29.332630 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1330/2663] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:29.336776 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809f1fd-d6e3-491a-914b-925f2a9134c5 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:29.347024 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a809f1fd-d6e3-491a-914b-925f2a9134c5 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:29.351735 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289e99c-f4c6-472b-97a3-abc2602376ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:29.352400 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289e99c-f4c6-472b-97a3-abc2602376ba admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:29.352683 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289e99c-f4c6-472b-97a3-abc2602376ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:29.352987 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289e99c-f4c6-472b-97a3-abc2602376ba admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:29.353812 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289e99c-f4c6-472b-97a3-abc2602376ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:51:29.354118 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289e99c-f4c6-472b-97a3-abc2602376ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:29.355722 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289e99c-f4c6-472b-97a3-abc2602376ba admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:29.367891 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1334/2664] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:51:29.372245 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce2131-b628-494e-bc92-3885aaa2b6e7 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:29.382164 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce2131-b628-494e-bc92-3885aaa2b6e7 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:29.386739 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fe50f-1564-4d85-9918-70da9cfb1beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:29.387373 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fe50f-1564-4d85-9918-70da9cfb1beb admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:29.387654 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fe50f-1564-4d85-9918-70da9cfb1beb admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:29.387925 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fe50f-1564-4d85-9918-70da9cfb1beb admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:29.388622 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fe50f-1564-4d85-9918-70da9cfb1beb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:29.390539 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fe50f-1564-4d85-9918-70da9cfb1beb admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:29.414803 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1331/2665] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:51:29 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:51:29.418820 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289e99c-f4c6-472b-97a3-abc2602376ba admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:29.429030 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289e99c-f4c6-472b-97a3-abc2602376ba admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:29.481553 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fa106-8c5e-4834-99a2-331ef1eff234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:29.482213 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fa106-8c5e-4834-99a2-331ef1eff234 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:29.482492 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fa106-8c5e-4834-99a2-331ef1eff234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:29.482765 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fa106-8c5e-4834-99a2-331ef1eff234 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:29.483470 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fa106-8c5e-4834-99a2-331ef1eff234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:29.485413 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fa106-8c5e-4834-99a2-331ef1eff234 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:29.505471 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1335/2666] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:51:29 2022] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:29.509776 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fe50f-1564-4d85-9918-70da9cfb1beb admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:29.519658 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fe50f-1564-4d85-9918-70da9cfb1beb admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:29.524116 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb10632-79f8-489b-9c83-be03405874b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:29.524759 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb10632-79f8-489b-9c83-be03405874b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:29.525069 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb10632-79f8-489b-9c83-be03405874b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:29.525344 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb10632-79f8-489b-9c83-be03405874b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:29.526069 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb10632-79f8-489b-9c83-be03405874b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:29.527643 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb10632-79f8-489b-9c83-be03405874b4 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:29.537508 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1332/2667] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:29.541059 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fa106-8c5e-4834-99a2-331ef1eff234 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:29.551392 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fa106-8c5e-4834-99a2-331ef1eff234 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:29.555947 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9547098-05bc-43fd-80d5-e72171ae39f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:29.556596 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9547098-05bc-43fd-80d5-e72171ae39f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:29.556878 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9547098-05bc-43fd-80d5-e72171ae39f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:29.557187 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9547098-05bc-43fd-80d5-e72171ae39f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:29.557924 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9547098-05bc-43fd-80d5-e72171ae39f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:29.559521 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9547098-05bc-43fd-80d5-e72171ae39f5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:29.570017 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1336/2668] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:29.573910 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb10632-79f8-489b-9c83-be03405874b4 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:29.583656 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb10632-79f8-489b-9c83-be03405874b4 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:29.588163 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419242b-9a6e-48dc-a366-3c3eefb5bb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:29.589033 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419242b-9a6e-48dc-a366-3c3eefb5bb2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:29.589323 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419242b-9a6e-48dc-a366-3c3eefb5bb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:29.589592 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419242b-9a6e-48dc-a366-3c3eefb5bb2d admin admin] PATH_INFO: `/v3/projects/2ce084a1e0914e48bc8ec71511af1306/users/0864b0cfd2e34fffaa7a3fea237c7faa/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:29.603266 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419242b-9a6e-48dc-a366-3c3eefb5bb2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ce084a1e0914e48bc8ec71511af1306, user_id=0864b0cfd2e34fffaa7a3fea237c7faa, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:29.605919 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419242b-9a6e-48dc-a366-3c3eefb5bb2d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:29.618564 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1333/2669] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:51:29 2022] PUT /identity/v3/projects/2ce084a1e0914e48bc8ec71511af1306/users/0864b0cfd2e34fffaa7a3fea237c7faa/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:51:29.629382 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c99ab-a296-42d8-97b9-db58766f31cb None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:29.629671 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c99ab-a296-42d8-97b9-db58766f31cb None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:29.629947 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c99ab-a296-42d8-97b9-db58766f31cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:29.655584 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-ca0c99ab-a296-42d8-97b9-db58766f31cb None None] MFA Rules not processed for user `0864b0cfd2e34fffaa7a3fea237c7faa`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:29.656815 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ca0c99ab-a296-42d8-97b9-db58766f31cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:29.716560 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1337/2670] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:29.721630 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419242b-9a6e-48dc-a366-3c3eefb5bb2d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:29.779941 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419242b-9a6e-48dc-a366-3c3eefb5bb2d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:29.785988 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76487432-e69f-4f42-bd28-978e240b0c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:29.786850 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76487432-e69f-4f42-bd28-978e240b0c19 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:29.787199 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76487432-e69f-4f42-bd28-978e240b0c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:29.787474 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76487432-e69f-4f42-bd28-978e240b0c19 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:29.788240 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76487432-e69f-4f42-bd28-978e240b0c19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:29.790146 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76487432-e69f-4f42-bd28-978e240b0c19 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:29.815021 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1334/2671] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:51:29 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:51:29.818993 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c99ab-a296-42d8-97b9-db58766f31cb None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:29.829460 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c99ab-a296-42d8-97b9-db58766f31cb None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:29.883185 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cd97d-e98f-4767-ba8e-03bb6b3e3270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:29.883847 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cd97d-e98f-4767-ba8e-03bb6b3e3270 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:29.884132 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cd97d-e98f-4767-ba8e-03bb6b3e3270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:29.884409 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5cd97d-e98f-4767-ba8e-03bb6b3e3270 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:29.885143 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5cd97d-e98f-4767-ba8e-03bb6b3e3270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:29.887050 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5cd97d-e98f-4767-ba8e-03bb6b3e3270 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:29.905368 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1338/2672] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:51:29 2022] POST /identity/v3/users => generated 296 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:29.909990 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76487432-e69f-4f42-bd28-978e240b0c19 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:29.920230 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76487432-e69f-4f42-bd28-978e240b0c19 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:29.925518 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481733b-6a41-4969-892e-37173015a092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:29.926170 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481733b-6a41-4969-892e-37173015a092 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:29.926453 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481733b-6a41-4969-892e-37173015a092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:29.926731 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481733b-6a41-4969-892e-37173015a092 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:29.927461 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481733b-6a41-4969-892e-37173015a092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:29.929075 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481733b-6a41-4969-892e-37173015a092 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:29.939261 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1335/2673] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:29.943857 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cd97d-e98f-4767-ba8e-03bb6b3e3270 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:29.953381 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5cd97d-e98f-4767-ba8e-03bb6b3e3270 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:29.958673 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82caa54-e413-46a7-ac12-16111df5d012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:29.959572 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82caa54-e413-46a7-ac12-16111df5d012 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:29.959988 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82caa54-e413-46a7-ac12-16111df5d012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:29.960153 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82caa54-e413-46a7-ac12-16111df5d012 admin admin] PATH_INFO: `/v3/projects/f3aebb84a60c49f7a6e6be6628ff403b/users/1d55f9e420484f17a269052b30c694dd/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:29.974546 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82caa54-e413-46a7-ac12-16111df5d012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3aebb84a60c49f7a6e6be6628ff403b, user_id=1d55f9e420484f17a269052b30c694dd, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:29.977246 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82caa54-e413-46a7-ac12-16111df5d012 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:29.990047 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1339/2674] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:51:29 2022] PUT /identity/v3/projects/f3aebb84a60c49f7a6e6be6628ff403b/users/1d55f9e420484f17a269052b30c694dd/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:29.993947 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481733b-6a41-4969-892e-37173015a092 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:30.004197 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481733b-6a41-4969-892e-37173015a092 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:30.057096 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e2387-6aba-4c2d-991f-c27b91e24c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:30.057690 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e2387-6aba-4c2d-991f-c27b91e24c75 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:30.057972 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e2387-6aba-4c2d-991f-c27b91e24c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:30.058243 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e2387-6aba-4c2d-991f-c27b91e24c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:30.058963 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e2387-6aba-4c2d-991f-c27b91e24c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:30.060603 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e2387-6aba-4c2d-991f-c27b91e24c75 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:30.070606 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1336/2675] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:30.074726 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82caa54-e413-46a7-ac12-16111df5d012 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:30.084733 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82caa54-e413-46a7-ac12-16111df5d012 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:30.089841 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3753ea9-ea0d-4ba4-b47e-eca53eded674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:30.090719 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3753ea9-ea0d-4ba4-b47e-eca53eded674 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:30.091006 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3753ea9-ea0d-4ba4-b47e-eca53eded674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:30.091287 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3753ea9-ea0d-4ba4-b47e-eca53eded674 admin admin] PATH_INFO: `/v3/projects/f3aebb84a60c49f7a6e6be6628ff403b/users/1d55f9e420484f17a269052b30c694dd/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:30.093305 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3753ea9-ea0d-4ba4-b47e-eca53eded674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3aebb84a60c49f7a6e6be6628ff403b, user_id=1d55f9e420484f17a269052b30c694dd, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:30.095993 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3753ea9-ea0d-4ba4-b47e-eca53eded674 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:30.106001 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1340/2676] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:51:30 2022] PUT /identity/v3/projects/f3aebb84a60c49f7a6e6be6628ff403b/users/1d55f9e420484f17a269052b30c694dd/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:51:30.116361 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc0482-6112-4688-8c0b-5e3c8e58a52e None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:30.116675 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc0482-6112-4688-8c0b-5e3c8e58a52e None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:30.116955 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc0482-6112-4688-8c0b-5e3c8e58a52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:30.142893 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-c0dc0482-6112-4688-8c0b-5e3c8e58a52e None None] MFA Rules not processed for user `1d55f9e420484f17a269052b30c694dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:30.144082 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-c0dc0482-6112-4688-8c0b-5e3c8e58a52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:30.208496 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1337/2677] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:51:30.219316 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3753ea9-ea0d-4ba4-b47e-eca53eded674 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:30.221118 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d3753ea9-ea0d-4ba4-b47e-eca53eded674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:30.278708 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3753ea9-ea0d-4ba4-b47e-eca53eded674 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:30.282255 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82635ce5-4e76-4f25-b962-9e70d6542e22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:30.282892 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82635ce5-4e76-4f25-b962-9e70d6542e22 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:30.283172 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82635ce5-4e76-4f25-b962-9e70d6542e22 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:30.283445 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82635ce5-4e76-4f25-b962-9e70d6542e22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:30.292148 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82635ce5-4e76-4f25-b962-9e70d6542e22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:30.293608 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82635ce5-4e76-4f25-b962-9e70d6542e22 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:30.303127 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1341/2678] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:51:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:51:30.580382 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc0482-6112-4688-8c0b-5e3c8e58a52e None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:30.589911 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc0482-6112-4688-8c0b-5e3c8e58a52e None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:30.594413 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321f495-624c-42c9-b9f8-48118c0e2954 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d55f9e420484f17a269052b30c694dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3aebb84a60c49f7a6e6be6628ff403b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:30.595057 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321f495-624c-42c9-b9f8-48118c0e2954 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:30.595341 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321f495-624c-42c9-b9f8-48118c0e2954 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:30.595620 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321f495-624c-42c9-b9f8-48118c0e2954 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:30.596361 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321f495-624c-42c9-b9f8-48118c0e2954 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:51:30.596672 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321f495-624c-42c9-b9f8-48118c0e2954 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:30.598299 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c321f495-624c-42c9-b9f8-48118c0e2954 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:30.609254 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1338/2679] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:51:30.613206 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82635ce5-4e76-4f25-b962-9e70d6542e22 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:30.621987 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82635ce5-4e76-4f25-b962-9e70d6542e22 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:30.626561 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf147eb-166f-4ed9-b2db-bf2fd3c6e903 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d55f9e420484f17a269052b30c694dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3aebb84a60c49f7a6e6be6628ff403b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:30.627829 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf147eb-166f-4ed9-b2db-bf2fd3c6e903 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:30.628011 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf147eb-166f-4ed9-b2db-bf2fd3c6e903 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:30.628288 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf147eb-166f-4ed9-b2db-bf2fd3c6e903 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:30.628987 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf147eb-166f-4ed9-b2db-bf2fd3c6e903 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:30.630892 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf147eb-166f-4ed9-b2db-bf2fd3c6e903 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:30.656838 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1342/2680] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:51:30 2022] POST /identity/v3/projects => generated 354 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:30.661604 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321f495-624c-42c9-b9f8-48118c0e2954 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:30.671111 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321f495-624c-42c9-b9f8-48118c0e2954 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:30.723841 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bb732-bb12-4221-9260-00e184b9c438 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d55f9e420484f17a269052b30c694dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3aebb84a60c49f7a6e6be6628ff403b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:30.724485 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bb732-bb12-4221-9260-00e184b9c438 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:30.724766 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bb732-bb12-4221-9260-00e184b9c438 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:30.725064 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bb732-bb12-4221-9260-00e184b9c438 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:30.725785 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162bb732-bb12-4221-9260-00e184b9c438 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:51:30.726088 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162bb732-bb12-4221-9260-00e184b9c438 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:30.727655 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162bb732-bb12-4221-9260-00e184b9c438 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:30.738839 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1339/2681] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:51:30.772886 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf147eb-166f-4ed9-b2db-bf2fd3c6e903 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:30.783091 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf147eb-166f-4ed9-b2db-bf2fd3c6e903 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:30.787736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02032a-74f9-468c-9126-fe969e28b1dc tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1d55f9e420484f17a269052b30c694dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3aebb84a60c49f7a6e6be6628ff403b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:30.788579 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02032a-74f9-468c-9126-fe969e28b1dc tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:30.788867 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02032a-74f9-468c-9126-fe969e28b1dc tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:30.789188 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02032a-74f9-468c-9126-fe969e28b1dc tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] PATH_INFO: `/v3/projects/f6d7ce2493d242fb92ff466fd9d50086` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:30.790405 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02032a-74f9-468c-9126-fe969e28b1dc tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f6d7ce2493d242fb92ff466fd9d50086)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:30.792313 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02032a-74f9-468c-9126-fe969e28b1dc tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:30.837446 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8a02032a-74f9-468c-9126-fe969e28b1dc tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6d7ce2493d242fb92ff466fd9d50086', 'request_id': 'req-8a02032a-74f9-468c-9126-fe969e28b1dc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:30.843799 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8a02032a-74f9-468c-9126-fe969e28b1dc tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6d7ce2493d242fb92ff466fd9d50086', 'request_id': 'req-8a02032a-74f9-468c-9126-fe969e28b1dc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:30.851592 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8a02032a-74f9-468c-9126-fe969e28b1dc tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6d7ce2493d242fb92ff466fd9d50086', 'request_id': 'req-8a02032a-74f9-468c-9126-fe969e28b1dc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:30.861340 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8a02032a-74f9-468c-9126-fe969e28b1dc tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] The token cache is being invalidate because project f6d7ce2493d242fb92ff466fd9d50086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:51:30.861633 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8a02032a-74f9-468c-9126-fe969e28b1dc tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:30.862356 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-8a02032a-74f9-468c-9126-fe969e28b1dc tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:30.863842 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1343/2682] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:51:30 2022] DELETE /identity/v3/projects/f6d7ce2493d242fb92ff466fd9d50086 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:31.035481 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bb732-bb12-4221-9260-00e184b9c438 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:31.037218 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-162bb732-bb12-4221-9260-00e184b9c438 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:31.098369 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bb732-bb12-4221-9260-00e184b9c438 tempest-VolumeQuotaClassesTest-935165191 tempest-VolumeQuotaClassesTest-935165191-project-admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:31.150516 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa4274-adbc-4c9f-a2c9-44714985e397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:31.151370 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa4274-adbc-4c9f-a2c9-44714985e397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:31.151650 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa4274-adbc-4c9f-a2c9-44714985e397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:31.151924 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa4274-adbc-4c9f-a2c9-44714985e397 admin admin] PATH_INFO: `/v3/users/0864b0cfd2e34fffaa7a3fea237c7faa` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:31.153130 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa4274-adbc-4c9f-a2c9-44714985e397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0864b0cfd2e34fffaa7a3fea237c7faa)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:31.155043 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa4274-adbc-4c9f-a2c9-44714985e397 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:31.200999 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-f1fa4274-adbc-4c9f-a2c9-44714985e397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0864b0cfd2e34fffaa7a3fea237c7faa'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:31.208490 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-f1fa4274-adbc-4c9f-a2c9-44714985e397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0864b0cfd2e34fffaa7a3fea237c7faa'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:31.209256 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-f1fa4274-adbc-4c9f-a2c9-44714985e397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0864b0cfd2e34fffaa7a3fea237c7faa'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:31.220276 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-f1fa4274-adbc-4c9f-a2c9-44714985e397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0864b0cfd2e34fffaa7a3fea237c7faa'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:31.227295 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-f1fa4274-adbc-4c9f-a2c9-44714985e397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0864b0cfd2e34fffaa7a3fea237c7faa'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:31.233300 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1340/2683] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:51:31 2022] DELETE /identity/v3/users/0864b0cfd2e34fffaa7a3fea237c7faa => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:31.237865 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc9ffa-e8a0-45ad-a60f-59518e5f7eb8 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:31.238363 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc9ffa-e8a0-45ad-a60f-59518e5f7eb8 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:31.238462 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc9ffa-e8a0-45ad-a60f-59518e5f7eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:31.256604 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-8dbc9ffa-e8a0-45ad-a60f-59518e5f7eb8 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:31.258074 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8dbc9ffa-e8a0-45ad-a60f-59518e5f7eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:31.312255 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1344/2684] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:31.322284 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa4274-adbc-4c9f-a2c9-44714985e397 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:31.323677 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-f1fa4274-adbc-4c9f-a2c9-44714985e397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:31.505051 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa4274-adbc-4c9f-a2c9-44714985e397 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:31.509087 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b2fb0-26e3-43fe-ab52-5a6cf43b4166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:31.509724 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b2fb0-26e3-43fe-ab52-5a6cf43b4166 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:31.510000 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b2fb0-26e3-43fe-ab52-5a6cf43b4166 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:31.510268 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b2fb0-26e3-43fe-ab52-5a6cf43b4166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:31.519591 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b2fb0-26e3-43fe-ab52-5a6cf43b4166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:31.520993 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b2fb0-26e3-43fe-ab52-5a6cf43b4166 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:31.529971 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1341/2685] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:51:31.780382 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc9ffa-e8a0-45ad-a60f-59518e5f7eb8 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:31.781861 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8dbc9ffa-e8a0-45ad-a60f-59518e5f7eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:31.794234 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc9ffa-e8a0-45ad-a60f-59518e5f7eb8 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:31.798918 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02f7b3-a595-44ff-90fd-ce12bdd26bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:31.800892 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02f7b3-a595-44ff-90fd-ce12bdd26bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:31.801273 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02f7b3-a595-44ff-90fd-ce12bdd26bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:31.801785 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02f7b3-a595-44ff-90fd-ce12bdd26bcd admin admin] PATH_INFO: `/v3/projects/2ce084a1e0914e48bc8ec71511af1306` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:31.803238 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02f7b3-a595-44ff-90fd-ce12bdd26bcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ce084a1e0914e48bc8ec71511af1306)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:31.805132 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02f7b3-a595-44ff-90fd-ce12bdd26bcd admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:31.848998 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bd02f7b3-a595-44ff-90fd-ce12bdd26bcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ce084a1e0914e48bc8ec71511af1306', 'request_id': 'req-bd02f7b3-a595-44ff-90fd-ce12bdd26bcd'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:31.854871 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bd02f7b3-a595-44ff-90fd-ce12bdd26bcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ce084a1e0914e48bc8ec71511af1306', 'request_id': 'req-bd02f7b3-a595-44ff-90fd-ce12bdd26bcd'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:31.862280 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bd02f7b3-a595-44ff-90fd-ce12bdd26bcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ce084a1e0914e48bc8ec71511af1306', 'request_id': 'req-bd02f7b3-a595-44ff-90fd-ce12bdd26bcd'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:31.872527 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bd02f7b3-a595-44ff-90fd-ce12bdd26bcd admin admin] The token cache is being invalidate because project 2ce084a1e0914e48bc8ec71511af1306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:51:31.872881 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bd02f7b3-a595-44ff-90fd-ce12bdd26bcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:31.873568 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-bd02f7b3-a595-44ff-90fd-ce12bdd26bcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:31.875081 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1345/2686] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:51:31 2022] DELETE /identity/v3/projects/2ce084a1e0914e48bc8ec71511af1306 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:31.879687 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b2fb0-26e3-43fe-ab52-5a6cf43b4166 service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:31.889404 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b2fb0-26e3-43fe-ab52-5a6cf43b4166 service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:31.942500 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95921758-2b4b-4d28-ae50-a44625f8f6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:31.943363 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95921758-2b4b-4d28-ae50-a44625f8f6f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:31.943645 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95921758-2b4b-4d28-ae50-a44625f8f6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:31.943920 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95921758-2b4b-4d28-ae50-a44625f8f6f1 admin admin] PATH_INFO: `/v3/users/1d55f9e420484f17a269052b30c694dd` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:31.945140 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95921758-2b4b-4d28-ae50-a44625f8f6f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d55f9e420484f17a269052b30c694dd)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:31.947065 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95921758-2b4b-4d28-ae50-a44625f8f6f1 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:31.991560 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-95921758-2b4b-4d28-ae50-a44625f8f6f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d55f9e420484f17a269052b30c694dd'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:31.998250 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-95921758-2b4b-4d28-ae50-a44625f8f6f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d55f9e420484f17a269052b30c694dd'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:31.998924 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-95921758-2b4b-4d28-ae50-a44625f8f6f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d55f9e420484f17a269052b30c694dd'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:32.010532 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-95921758-2b4b-4d28-ae50-a44625f8f6f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d55f9e420484f17a269052b30c694dd'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:32.017396 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-95921758-2b4b-4d28-ae50-a44625f8f6f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d55f9e420484f17a269052b30c694dd'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:32.023098 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1342/2687] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:51:31 2022] DELETE /identity/v3/users/1d55f9e420484f17a269052b30c694dd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:32.277956 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02f7b3-a595-44ff-90fd-ce12bdd26bcd admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:32.279362 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-bd02f7b3-a595-44ff-90fd-ce12bdd26bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:32.294653 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02f7b3-a595-44ff-90fd-ce12bdd26bcd admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:32.350056 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0662e-6e77-410e-a61f-bfea847c8a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:32.350898 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0662e-6e77-410e-a61f-bfea847c8a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:32.351181 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0662e-6e77-410e-a61f-bfea847c8a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:32.351488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0662e-6e77-410e-a61f-bfea847c8a70 admin admin] PATH_INFO: `/v3/projects/f3aebb84a60c49f7a6e6be6628ff403b` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:32.352663 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0662e-6e77-410e-a61f-bfea847c8a70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3aebb84a60c49f7a6e6be6628ff403b)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:32.354612 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0662e-6e77-410e-a61f-bfea847c8a70 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:32.399146 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-22d0662e-6e77-410e-a61f-bfea847c8a70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3aebb84a60c49f7a6e6be6628ff403b', 'request_id': 'req-22d0662e-6e77-410e-a61f-bfea847c8a70'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:32.405133 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-22d0662e-6e77-410e-a61f-bfea847c8a70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3aebb84a60c49f7a6e6be6628ff403b', 'request_id': 'req-22d0662e-6e77-410e-a61f-bfea847c8a70'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:32.413971 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-22d0662e-6e77-410e-a61f-bfea847c8a70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3aebb84a60c49f7a6e6be6628ff403b', 'request_id': 'req-22d0662e-6e77-410e-a61f-bfea847c8a70'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:32.424017 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-22d0662e-6e77-410e-a61f-bfea847c8a70 admin admin] The token cache is being invalidate because project f3aebb84a60c49f7a6e6be6628ff403b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:51:32.424350 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-22d0662e-6e77-410e-a61f-bfea847c8a70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:32.424988 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-22d0662e-6e77-410e-a61f-bfea847c8a70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:32.426602 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1346/2688] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:51:32 2022] DELETE /identity/v3/projects/f3aebb84a60c49f7a6e6be6628ff403b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:32.432166 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fe302-0808-4ec3-a916-6e70393550ca None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:32.432652 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fe302-0808-4ec3-a916-6e70393550ca None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:32.432797 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fe302-0808-4ec3-a916-6e70393550ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:32.450539 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-c67fe302-0808-4ec3-a916-6e70393550ca None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:32.451721 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-c67fe302-0808-4ec3-a916-6e70393550ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:32.506676 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1343/2689] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:32.514677 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72117d-035e-44f4-810e-65b415248d74 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:32.514969 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72117d-035e-44f4-810e-65b415248d74 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:32.515249 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72117d-035e-44f4-810e-65b415248d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:32.533625 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-8b72117d-035e-44f4-810e-65b415248d74 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:32.535365 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8b72117d-035e-44f4-810e-65b415248d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:32.543151 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1347/2690] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:32.547351 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fe302-0808-4ec3-a916-6e70393550ca None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:32.556822 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fe302-0808-4ec3-a916-6e70393550ca None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:32.561333 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d573a-2a06-4da3-84e9-09be36f0b888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:32.561998 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d573a-2a06-4da3-84e9-09be36f0b888 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:32.562276 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d573a-2a06-4da3-84e9-09be36f0b888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:32.562545 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d573a-2a06-4da3-84e9-09be36f0b888 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:32.563271 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d573a-2a06-4da3-84e9-09be36f0b888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:51:32.563570 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d573a-2a06-4da3-84e9-09be36f0b888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:32.565234 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d573a-2a06-4da3-84e9-09be36f0b888 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:32.576549 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1344/2691] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:51:32.581355 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72117d-035e-44f4-810e-65b415248d74 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:32.590480 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72117d-035e-44f4-810e-65b415248d74 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:32.595089 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47e853-fca8-4856-a3db-2f447e9b64b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:32.595736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47e853-fca8-4856-a3db-2f447e9b64b0 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:32.596019 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47e853-fca8-4856-a3db-2f447e9b64b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:32.596860 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f47e853-fca8-4856-a3db-2f447e9b64b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:32.597600 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47e853-fca8-4856-a3db-2f447e9b64b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:32.599507 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f47e853-fca8-4856-a3db-2f447e9b64b0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:32.623503 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1348/2692] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:51:32 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:51:32.628051 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d573a-2a06-4da3-84e9-09be36f0b888 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:32.637962 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d573a-2a06-4da3-84e9-09be36f0b888 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:32.692527 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cf4c1-a283-4652-a7e0-0b3e2fabaa7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:32.693232 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cf4c1-a283-4652-a7e0-0b3e2fabaa7a admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:32.693544 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cf4c1-a283-4652-a7e0-0b3e2fabaa7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:32.693825 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cf4c1-a283-4652-a7e0-0b3e2fabaa7a admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:32.694534 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cf4c1-a283-4652-a7e0-0b3e2fabaa7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:32.696477 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cf4c1-a283-4652-a7e0-0b3e2fabaa7a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:32.719284 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1345/2693] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:51:32 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:32.720598 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47e853-fca8-4856-a3db-2f447e9b64b0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:32.731430 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f47e853-fca8-4856-a3db-2f447e9b64b0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:32.736549 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb2197-8421-4ed0-8452-3b6c0102ecb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:32.737943 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb2197-8421-4ed0-8452-3b6c0102ecb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:32.738218 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb2197-8421-4ed0-8452-3b6c0102ecb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:32.738488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb2197-8421-4ed0-8452-3b6c0102ecb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:32.739215 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb2197-8421-4ed0-8452-3b6c0102ecb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:32.740794 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb2197-8421-4ed0-8452-3b6c0102ecb5 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:32.751037 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1349/2694] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:32.755110 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cf4c1-a283-4652-a7e0-0b3e2fabaa7a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:32.766250 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cf4c1-a283-4652-a7e0-0b3e2fabaa7a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:32.771145 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db821a-8b00-418b-bcdf-71cc0e5234ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:32.771753 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db821a-8b00-418b-bcdf-71cc0e5234ca admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:32.772066 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db821a-8b00-418b-bcdf-71cc0e5234ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:32.772410 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db821a-8b00-418b-bcdf-71cc0e5234ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:32.773197 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db821a-8b00-418b-bcdf-71cc0e5234ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:32.774777 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db821a-8b00-418b-bcdf-71cc0e5234ca admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:32.785896 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1346/2695] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:51:32.790154 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb2197-8421-4ed0-8452-3b6c0102ecb5 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:32.801234 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb2197-8421-4ed0-8452-3b6c0102ecb5 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:32.805876 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb20f0-2d2a-499c-8359-ba4831795d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:32.806743 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb20f0-2d2a-499c-8359-ba4831795d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:32.807018 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb20f0-2d2a-499c-8359-ba4831795d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:32.807292 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cb20f0-2d2a-499c-8359-ba4831795d33 admin admin] PATH_INFO: `/v3/projects/545851525a4b49f88168cb3cd8936f43/users/d94be18e6fa3497db7788c492ee5fd61/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:32.821368 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb20f0-2d2a-499c-8359-ba4831795d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=545851525a4b49f88168cb3cd8936f43, user_id=d94be18e6fa3497db7788c492ee5fd61, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:32.824230 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cb20f0-2d2a-499c-8359-ba4831795d33 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:32.837426 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1350/2696] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:51:32 2022] PUT /identity/v3/projects/545851525a4b49f88168cb3cd8936f43/users/d94be18e6fa3497db7788c492ee5fd61/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:32.848507 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486848c-deb0-4ad6-859f-4bf89bccc25d None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:32.848803 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486848c-deb0-4ad6-859f-4bf89bccc25d None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:32.849116 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486848c-deb0-4ad6-859f-4bf89bccc25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:32.876510 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-2486848c-deb0-4ad6-859f-4bf89bccc25d None None] MFA Rules not processed for user `d94be18e6fa3497db7788c492ee5fd61`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:32.878393 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-2486848c-deb0-4ad6-859f-4bf89bccc25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:32.946211 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1347/2697] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:32.950889 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb20f0-2d2a-499c-8359-ba4831795d33 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:33.017409 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cb20f0-2d2a-499c-8359-ba4831795d33 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:33.022671 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af39e0-bc88-4f86-a233-8efb11486937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:33.023332 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af39e0-bc88-4f86-a233-8efb11486937 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:33.023621 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af39e0-bc88-4f86-a233-8efb11486937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:33.023904 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af39e0-bc88-4f86-a233-8efb11486937 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:33.024612 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af39e0-bc88-4f86-a233-8efb11486937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:33.026596 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af39e0-bc88-4f86-a233-8efb11486937 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:33.056246 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1351/2698] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:51:32 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:33.057366 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486848c-deb0-4ad6-859f-4bf89bccc25d None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:33.068308 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486848c-deb0-4ad6-859f-4bf89bccc25d None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:33.122545 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9072c2-3cf4-4d26-bd96-c46b4d6a6a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:33.123209 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9072c2-3cf4-4d26-bd96-c46b4d6a6a9d admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:33.123491 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9072c2-3cf4-4d26-bd96-c46b4d6a6a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:33.123766 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9072c2-3cf4-4d26-bd96-c46b4d6a6a9d admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:33.124475 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9072c2-3cf4-4d26-bd96-c46b4d6a6a9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:33.126403 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9072c2-3cf4-4d26-bd96-c46b4d6a6a9d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:33.145925 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1348/2699] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:51:33 2022] POST /identity/v3/users => generated 301 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:33.149845 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af39e0-bc88-4f86-a233-8efb11486937 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:33.159900 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af39e0-bc88-4f86-a233-8efb11486937 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:33.164498 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e72e0-b5d8-4c61-be1f-57fbcc7c3569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:33.165347 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e72e0-b5d8-4c61-be1f-57fbcc7c3569 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:33.165636 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e72e0-b5d8-4c61-be1f-57fbcc7c3569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:33.165914 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e72e0-b5d8-4c61-be1f-57fbcc7c3569 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:33.166685 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e72e0-b5d8-4c61-be1f-57fbcc7c3569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:33.168285 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e72e0-b5d8-4c61-be1f-57fbcc7c3569 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:33.179273 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1352/2700] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:33.183211 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9072c2-3cf4-4d26-bd96-c46b4d6a6a9d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:33.193502 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9072c2-3cf4-4d26-bd96-c46b4d6a6a9d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:33.198028 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44341a-b97b-4ed2-a46d-19926ed1bd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:33.198886 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44341a-b97b-4ed2-a46d-19926ed1bd20 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:33.199171 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44341a-b97b-4ed2-a46d-19926ed1bd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:33.199461 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44341a-b97b-4ed2-a46d-19926ed1bd20 admin admin] PATH_INFO: `/v3/projects/28d9b463014940b7bf42409606418323/users/d7cecab047b7435992dcda5dffc597b6/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:33.213296 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44341a-b97b-4ed2-a46d-19926ed1bd20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d9b463014940b7bf42409606418323, user_id=d7cecab047b7435992dcda5dffc597b6, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:33.215940 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44341a-b97b-4ed2-a46d-19926ed1bd20 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:33.231282 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1349/2701] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:51:33 2022] PUT /identity/v3/projects/28d9b463014940b7bf42409606418323/users/d7cecab047b7435992dcda5dffc597b6/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:33.235245 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e72e0-b5d8-4c61-be1f-57fbcc7c3569 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:33.246393 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e72e0-b5d8-4c61-be1f-57fbcc7c3569 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:33.307392 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af065958-4040-4013-bb1c-f903996ac3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:33.308060 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af065958-4040-4013-bb1c-f903996ac3be admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:33.308240 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af065958-4040-4013-bb1c-f903996ac3be admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:33.308529 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af065958-4040-4013-bb1c-f903996ac3be admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:33.309284 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af065958-4040-4013-bb1c-f903996ac3be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:33.310917 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af065958-4040-4013-bb1c-f903996ac3be admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:33.320944 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1353/2702] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:33.325129 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44341a-b97b-4ed2-a46d-19926ed1bd20 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:33.335714 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44341a-b97b-4ed2-a46d-19926ed1bd20 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:33.340178 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616915a2-4987-4479-81a9-82a975f9b59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:33.341064 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616915a2-4987-4479-81a9-82a975f9b59a admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:33.341345 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616915a2-4987-4479-81a9-82a975f9b59a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:33.341616 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616915a2-4987-4479-81a9-82a975f9b59a admin admin] PATH_INFO: `/v3/projects/28d9b463014940b7bf42409606418323/users/d7cecab047b7435992dcda5dffc597b6/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:33.343533 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616915a2-4987-4479-81a9-82a975f9b59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=28d9b463014940b7bf42409606418323, user_id=d7cecab047b7435992dcda5dffc597b6, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:33.346811 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616915a2-4987-4479-81a9-82a975f9b59a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:33.356640 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1350/2703] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:51:33 2022] PUT /identity/v3/projects/28d9b463014940b7bf42409606418323/users/d7cecab047b7435992dcda5dffc597b6/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:33.367508 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3648697-6904-424d-8fc0-1e35796d4c7a None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:33.367800 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3648697-6904-424d-8fc0-1e35796d4c7a None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:33.368082 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3648697-6904-424d-8fc0-1e35796d4c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:33.395102 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-a3648697-6904-424d-8fc0-1e35796d4c7a None None] MFA Rules not processed for user `d7cecab047b7435992dcda5dffc597b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:33.396314 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a3648697-6904-424d-8fc0-1e35796d4c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:33.461603 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1354/2704] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:33.470744 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616915a2-4987-4479-81a9-82a975f9b59a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:33.472530 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-616915a2-4987-4479-81a9-82a975f9b59a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:33.527049 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616915a2-4987-4479-81a9-82a975f9b59a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:33.530574 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5addac-63f5-4a56-b193-2a55603238ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:33.531191 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5addac-63f5-4a56-b193-2a55603238ee service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:33.531469 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5addac-63f5-4a56-b193-2a55603238ee service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:33.531738 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5addac-63f5-4a56-b193-2a55603238ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:33.540318 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5addac-63f5-4a56-b193-2a55603238ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:33.541735 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5addac-63f5-4a56-b193-2a55603238ee service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:33.550889 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1351/2705] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:51:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:51:33.677665 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3648697-6904-424d-8fc0-1e35796d4c7a None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:33.735693 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3648697-6904-424d-8fc0-1e35796d4c7a None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:33.740757 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96ed48-dab0-47d9-abce-ab6d5932c8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:33.741638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96ed48-dab0-47d9-abce-ab6d5932c8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:33.741925 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96ed48-dab0-47d9-abce-ab6d5932c8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:33.742204 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96ed48-dab0-47d9-abce-ab6d5932c8bf admin admin] PATH_INFO: `/v3/users/d94be18e6fa3497db7788c492ee5fd61` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:33.743389 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96ed48-dab0-47d9-abce-ab6d5932c8bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d94be18e6fa3497db7788c492ee5fd61)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:33.745368 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f96ed48-dab0-47d9-abce-ab6d5932c8bf admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:33.789974 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2f96ed48-dab0-47d9-abce-ab6d5932c8bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd94be18e6fa3497db7788c492ee5fd61'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:33.796416 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2f96ed48-dab0-47d9-abce-ab6d5932c8bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd94be18e6fa3497db7788c492ee5fd61'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:33.797107 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2f96ed48-dab0-47d9-abce-ab6d5932c8bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd94be18e6fa3497db7788c492ee5fd61'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:33.808022 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2f96ed48-dab0-47d9-abce-ab6d5932c8bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd94be18e6fa3497db7788c492ee5fd61'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:33.814712 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-2f96ed48-dab0-47d9-abce-ab6d5932c8bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd94be18e6fa3497db7788c492ee5fd61'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:33.820261 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1355/2706] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:51:33 2022] DELETE /identity/v3/users/d94be18e6fa3497db7788c492ee5fd61 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:33.824710 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee44ded-db20-402a-a261-29d431d0c21a None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:33.824999 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee44ded-db20-402a-a261-29d431d0c21a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:33.825309 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee44ded-db20-402a-a261-29d431d0c21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:33.842623 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-0ee44ded-db20-402a-a261-29d431d0c21a None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:33.843795 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-0ee44ded-db20-402a-a261-29d431d0c21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:33.901848 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1352/2707] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:33.911523 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96ed48-dab0-47d9-abce-ab6d5932c8bf admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:33.912914 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2f96ed48-dab0-47d9-abce-ab6d5932c8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:33.967620 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96ed48-dab0-47d9-abce-ab6d5932c8bf admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:33.971251 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba3b1e-c37a-4a0e-8c45-7c9aba3fbcb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:33.971889 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba3b1e-c37a-4a0e-8c45-7c9aba3fbcb5 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:33.972200 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba3b1e-c37a-4a0e-8c45-7c9aba3fbcb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:33.972476 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba3b1e-c37a-4a0e-8c45-7c9aba3fbcb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:33.981362 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba3b1e-c37a-4a0e-8c45-7c9aba3fbcb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:33.982792 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba3b1e-c37a-4a0e-8c45-7c9aba3fbcb5 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:33.992475 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1356/2708] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:51:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:51:34.248709 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee44ded-db20-402a-a261-29d431d0c21a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:34.250190 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-0ee44ded-db20-402a-a261-29d431d0c21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:34.269456 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee44ded-db20-402a-a261-29d431d0c21a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:34.275537 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c44c50-653e-49c7-bd73-0f2e718195a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:34.276621 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c44c50-653e-49c7-bd73-0f2e718195a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:34.277377 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c44c50-653e-49c7-bd73-0f2e718195a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:34.277827 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c44c50-653e-49c7-bd73-0f2e718195a2 admin admin] PATH_INFO: `/v3/projects/545851525a4b49f88168cb3cd8936f43` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:34.279857 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c44c50-653e-49c7-bd73-0f2e718195a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=545851525a4b49f88168cb3cd8936f43)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:34.282254 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c44c50-653e-49c7-bd73-0f2e718195a2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:34.331543 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-18c44c50-653e-49c7-bd73-0f2e718195a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '545851525a4b49f88168cb3cd8936f43', 'request_id': 'req-18c44c50-653e-49c7-bd73-0f2e718195a2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:34.339384 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-18c44c50-653e-49c7-bd73-0f2e718195a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '545851525a4b49f88168cb3cd8936f43', 'request_id': 'req-18c44c50-653e-49c7-bd73-0f2e718195a2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:34.345751 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-18c44c50-653e-49c7-bd73-0f2e718195a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '545851525a4b49f88168cb3cd8936f43', 'request_id': 'req-18c44c50-653e-49c7-bd73-0f2e718195a2'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:34.356442 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-18c44c50-653e-49c7-bd73-0f2e718195a2 admin admin] The token cache is being invalidate because project 545851525a4b49f88168cb3cd8936f43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:51:34.356803 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-18c44c50-653e-49c7-bd73-0f2e718195a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:34.357540 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-18c44c50-653e-49c7-bd73-0f2e718195a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:34.359582 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1353/2709] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:51:34 2022] DELETE /identity/v3/projects/545851525a4b49f88168cb3cd8936f43 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:34.364309 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba3b1e-c37a-4a0e-8c45-7c9aba3fbcb5 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:34.373888 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba3b1e-c37a-4a0e-8c45-7c9aba3fbcb5 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:34.427892 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a811a3-feb1-4375-a868-03f869ee2652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:34.428766 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a811a3-feb1-4375-a868-03f869ee2652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:34.429076 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a811a3-feb1-4375-a868-03f869ee2652 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:34.429354 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a811a3-feb1-4375-a868-03f869ee2652 admin admin] PATH_INFO: `/v3/users/d7cecab047b7435992dcda5dffc597b6` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:34.430574 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a811a3-feb1-4375-a868-03f869ee2652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7cecab047b7435992dcda5dffc597b6)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:34.432513 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a811a3-feb1-4375-a868-03f869ee2652 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:34.475031 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c6a811a3-feb1-4375-a868-03f869ee2652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7cecab047b7435992dcda5dffc597b6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:34.481546 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c6a811a3-feb1-4375-a868-03f869ee2652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7cecab047b7435992dcda5dffc597b6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:34.482198 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c6a811a3-feb1-4375-a868-03f869ee2652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7cecab047b7435992dcda5dffc597b6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:34.493661 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c6a811a3-feb1-4375-a868-03f869ee2652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7cecab047b7435992dcda5dffc597b6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:34.500303 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c6a811a3-feb1-4375-a868-03f869ee2652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7cecab047b7435992dcda5dffc597b6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:34.505998 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1357/2710] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:51:34 2022] DELETE /identity/v3/users/d7cecab047b7435992dcda5dffc597b6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:34.768829 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c44c50-653e-49c7-bd73-0f2e718195a2 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:34.770387 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-18c44c50-653e-49c7-bd73-0f2e718195a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:34.785364 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c44c50-653e-49c7-bd73-0f2e718195a2 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:34.841562 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e970deb-c524-4c50-8972-31aab14b586d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:34.842466 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e970deb-c524-4c50-8972-31aab14b586d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:34.842682 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e970deb-c524-4c50-8972-31aab14b586d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:34.842952 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e970deb-c524-4c50-8972-31aab14b586d admin admin] PATH_INFO: `/v3/projects/28d9b463014940b7bf42409606418323` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:34.844233 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e970deb-c524-4c50-8972-31aab14b586d admin admin] RBAC: Authorizing `identity:delete_project(project_id=28d9b463014940b7bf42409606418323)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:34.846134 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e970deb-c524-4c50-8972-31aab14b586d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:34.891244 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9e970deb-c524-4c50-8972-31aab14b586d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28d9b463014940b7bf42409606418323', 'request_id': 'req-9e970deb-c524-4c50-8972-31aab14b586d'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:34.899212 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9e970deb-c524-4c50-8972-31aab14b586d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28d9b463014940b7bf42409606418323', 'request_id': 'req-9e970deb-c524-4c50-8972-31aab14b586d'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:34.906093 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9e970deb-c524-4c50-8972-31aab14b586d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28d9b463014940b7bf42409606418323', 'request_id': 'req-9e970deb-c524-4c50-8972-31aab14b586d'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:34.921886 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9e970deb-c524-4c50-8972-31aab14b586d admin admin] The token cache is being invalidate because project 28d9b463014940b7bf42409606418323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:51:34.922261 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9e970deb-c524-4c50-8972-31aab14b586d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:34.922863 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-9e970deb-c524-4c50-8972-31aab14b586d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:34.924423 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1354/2711] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:51:34 2022] DELETE /identity/v3/projects/28d9b463014940b7bf42409606418323 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:34.931183 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efdf55-951e-4ea4-8638-cb293906c84c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:34.931496 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efdf55-951e-4ea4-8638-cb293906c84c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:34.931780 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efdf55-951e-4ea4-8638-cb293906c84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:34.950382 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-f5efdf55-951e-4ea4-8638-cb293906c84c None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:34.951597 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f5efdf55-951e-4ea4-8638-cb293906c84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:35.016435 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1358/2712] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:51:35.018441 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f940e-fba7-46ed-95c3-a5032b64b62f None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:35.018734 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f940e-fba7-46ed-95c3-a5032b64b62f None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:35.019007 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f940e-fba7-46ed-95c3-a5032b64b62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:35.038488 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-9e8f940e-fba7-46ed-95c3-a5032b64b62f None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:35.039701 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-9e8f940e-fba7-46ed-95c3-a5032b64b62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:35.048089 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1355/2713] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:35.052951 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efdf55-951e-4ea4-8638-cb293906c84c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:35.062626 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efdf55-951e-4ea4-8638-cb293906c84c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:35.067573 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6ef7e-1d11-4e2a-bc55-f24058b26ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:35.068225 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6ef7e-1d11-4e2a-bc55-f24058b26ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:35.068507 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6ef7e-1d11-4e2a-bc55-f24058b26ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:35.068923 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6ef7e-1d11-4e2a-bc55-f24058b26ab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:35.069708 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6ef7e-1d11-4e2a-bc55-f24058b26ab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:51:35.070017 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6ef7e-1d11-4e2a-bc55-f24058b26ab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:35.071676 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6ef7e-1d11-4e2a-bc55-f24058b26ab7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:35.086637 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1359/2714] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:51:35.087770 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f940e-fba7-46ed-95c3-a5032b64b62f None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:35.097505 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f940e-fba7-46ed-95c3-a5032b64b62f None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:35.102212 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9700c-a1ef-4995-9d4a-1a8b37d6ce5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:35.102853 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9700c-a1ef-4995-9d4a-1a8b37d6ce5f admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:35.103131 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9700c-a1ef-4995-9d4a-1a8b37d6ce5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:35.103401 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9700c-a1ef-4995-9d4a-1a8b37d6ce5f admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:35.104102 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9700c-a1ef-4995-9d4a-1a8b37d6ce5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:35.106005 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9700c-a1ef-4995-9d4a-1a8b37d6ce5f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:35.138961 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1356/2715] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:51:35 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:51:35.142705 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6ef7e-1d11-4e2a-bc55-f24058b26ab7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:35.153356 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6ef7e-1d11-4e2a-bc55-f24058b26ab7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:35.208272 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b36466-4c1d-4279-ad20-54527b5e413c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:35.208942 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b36466-4c1d-4279-ad20-54527b5e413c admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:35.209259 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b36466-4c1d-4279-ad20-54527b5e413c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:35.209534 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b36466-4c1d-4279-ad20-54527b5e413c admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:35.210246 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b36466-4c1d-4279-ad20-54527b5e413c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:35.212164 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b36466-4c1d-4279-ad20-54527b5e413c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:35.234530 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1360/2716] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:51:35 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:35.239488 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9700c-a1ef-4995-9d4a-1a8b37d6ce5f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:35.249610 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9700c-a1ef-4995-9d4a-1a8b37d6ce5f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:35.254328 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0c236-e525-4053-a480-dab7576bba93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:35.254995 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0c236-e525-4053-a480-dab7576bba93 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:35.255286 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0c236-e525-4053-a480-dab7576bba93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:35.255560 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0c236-e525-4053-a480-dab7576bba93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:35.256303 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0c236-e525-4053-a480-dab7576bba93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:35.258197 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0c236-e525-4053-a480-dab7576bba93 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:35.271381 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1357/2717] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:35.275620 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b36466-4c1d-4279-ad20-54527b5e413c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:35.287095 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b36466-4c1d-4279-ad20-54527b5e413c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:35.291726 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354baea3-4a55-4f02-b331-b431741b81fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:35.292392 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354baea3-4a55-4f02-b331-b431741b81fc admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:35.292676 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354baea3-4a55-4f02-b331-b431741b81fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:35.292952 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354baea3-4a55-4f02-b331-b431741b81fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:35.293746 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354baea3-4a55-4f02-b331-b431741b81fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:35.295328 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354baea3-4a55-4f02-b331-b431741b81fc admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:35.305551 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1361/2718] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:35.311032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0c236-e525-4053-a480-dab7576bba93 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:35.320830 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0c236-e525-4053-a480-dab7576bba93 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:35.325970 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ff10e-6d52-4cc5-8843-00acb9081eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:35.327004 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ff10e-6d52-4cc5-8843-00acb9081eb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:35.327319 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ff10e-6d52-4cc5-8843-00acb9081eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:35.327600 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ff10e-6d52-4cc5-8843-00acb9081eb0 admin admin] PATH_INFO: `/v3/projects/c3b319f0bd6f4a8f9f91bf2a2c6c899e/users/9ce624fdccd24392a0eaf14b25fa83af/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:35.345266 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ff10e-6d52-4cc5-8843-00acb9081eb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b319f0bd6f4a8f9f91bf2a2c6c899e, user_id=9ce624fdccd24392a0eaf14b25fa83af, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:35.348551 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ff10e-6d52-4cc5-8843-00acb9081eb0 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:35.362121 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1358/2719] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:51:35 2022] PUT /identity/v3/projects/c3b319f0bd6f4a8f9f91bf2a2c6c899e/users/9ce624fdccd24392a0eaf14b25fa83af/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:35.372438 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1e634-159b-46ec-99ac-3b9e3a9d21d0 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:35.373040 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1e634-159b-46ec-99ac-3b9e3a9d21d0 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:35.373282 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1e634-159b-46ec-99ac-3b9e3a9d21d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:35.401151 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-fbb1e634-159b-46ec-99ac-3b9e3a9d21d0 None None] MFA Rules not processed for user `9ce624fdccd24392a0eaf14b25fa83af`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:35.402523 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fbb1e634-159b-46ec-99ac-3b9e3a9d21d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:35.488883 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1362/2720] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:35.501851 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ff10e-6d52-4cc5-8843-00acb9081eb0 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:35.504373 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-c40ff10e-6d52-4cc5-8843-00acb9081eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:35.599346 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ff10e-6d52-4cc5-8843-00acb9081eb0 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:35.603364 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f508e-4e1d-4a8d-b2ab-66f145378cc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:35.604025 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f508e-4e1d-4a8d-b2ab-66f145378cc6 service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:35.604308 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f508e-4e1d-4a8d-b2ab-66f145378cc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:35.604584 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f508e-4e1d-4a8d-b2ab-66f145378cc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:35.614201 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f508e-4e1d-4a8d-b2ab-66f145378cc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:35.615770 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f508e-4e1d-4a8d-b2ab-66f145378cc6 service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:35.633612 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1359/2721] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:51:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:51:47.857677 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1e634-159b-46ec-99ac-3b9e3a9d21d0 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:47.859086 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fbb1e634-159b-46ec-99ac-3b9e3a9d21d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:47.917541 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1e634-159b-46ec-99ac-3b9e3a9d21d0 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:47.921103 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ec7c0-da69-433b-a511-3022c9bdcdef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:47.921747 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ec7c0-da69-433b-a511-3022c9bdcdef service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:47.922032 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ec7c0-da69-433b-a511-3022c9bdcdef service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:47.922312 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ec7c0-da69-433b-a511-3022c9bdcdef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:47.924106 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c31ec7c0-da69-433b-a511-3022c9bdcdef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:47.984018 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ec7c0-da69-433b-a511-3022c9bdcdef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:47.985534 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ec7c0-da69-433b-a511-3022c9bdcdef service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:47.995721 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1363/2722] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:51:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:51:51.176875 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f508e-4e1d-4a8d-b2ab-66f145378cc6 service cinder] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:51.178346 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-763f508e-4e1d-4a8d-b2ab-66f145378cc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:51.201447 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f508e-4e1d-4a8d-b2ab-66f145378cc6 service cinder] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:51.201447 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950ac9a-e34e-4685-97c4-afd6afe78516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:51.201447 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950ac9a-e34e-4685-97c4-afd6afe78516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:51.201447 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950ac9a-e34e-4685-97c4-afd6afe78516 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:51.201879 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950ac9a-e34e-4685-97c4-afd6afe78516 admin admin] PATH_INFO: `/v3/users/c373e13cbd6c40ed9434caf0d2dec4b9` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:51.213264 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950ac9a-e34e-4685-97c4-afd6afe78516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c373e13cbd6c40ed9434caf0d2dec4b9)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:51.215188 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950ac9a-e34e-4685-97c4-afd6afe78516 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:51.263865 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0950ac9a-e34e-4685-97c4-afd6afe78516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c373e13cbd6c40ed9434caf0d2dec4b9'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:51.270842 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0950ac9a-e34e-4685-97c4-afd6afe78516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c373e13cbd6c40ed9434caf0d2dec4b9'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:51.271490 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0950ac9a-e34e-4685-97c4-afd6afe78516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c373e13cbd6c40ed9434caf0d2dec4b9'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:51.282800 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0950ac9a-e34e-4685-97c4-afd6afe78516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c373e13cbd6c40ed9434caf0d2dec4b9'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:51.289671 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0950ac9a-e34e-4685-97c4-afd6afe78516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c373e13cbd6c40ed9434caf0d2dec4b9'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:51.295345 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1360/2723] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:51:51 2022] DELETE /identity/v3/users/c373e13cbd6c40ed9434caf0d2dec4b9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:51.462232 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ec7c0-da69-433b-a511-3022c9bdcdef service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:51.472186 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ec7c0-da69-433b-a511-3022c9bdcdef service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:51.534217 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6cc44-561f-4da4-b22f-521ad6a0f4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:51.535065 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6cc44-561f-4da4-b22f-521ad6a0f4aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:51.535348 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6cc44-561f-4da4-b22f-521ad6a0f4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:51.535626 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6cc44-561f-4da4-b22f-521ad6a0f4aa admin admin] PATH_INFO: `/v3/projects/85be135f409d4f71944c325ee7356e39` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:51.545871 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6cc44-561f-4da4-b22f-521ad6a0f4aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=85be135f409d4f71944c325ee7356e39)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:51.547840 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6cc44-561f-4da4-b22f-521ad6a0f4aa admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:51.591812 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-35f6cc44-561f-4da4-b22f-521ad6a0f4aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85be135f409d4f71944c325ee7356e39', 'request_id': 'req-35f6cc44-561f-4da4-b22f-521ad6a0f4aa'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:51.598117 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-35f6cc44-561f-4da4-b22f-521ad6a0f4aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85be135f409d4f71944c325ee7356e39', 'request_id': 'req-35f6cc44-561f-4da4-b22f-521ad6a0f4aa'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:51.605023 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-35f6cc44-561f-4da4-b22f-521ad6a0f4aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85be135f409d4f71944c325ee7356e39', 'request_id': 'req-35f6cc44-561f-4da4-b22f-521ad6a0f4aa'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:51.615020 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-35f6cc44-561f-4da4-b22f-521ad6a0f4aa admin admin] The token cache is being invalidate because project 85be135f409d4f71944c325ee7356e39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:51:51.615307 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-35f6cc44-561f-4da4-b22f-521ad6a0f4aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:51.615924 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-35f6cc44-561f-4da4-b22f-521ad6a0f4aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:51.617493 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1364/2724] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:51:51 2022] DELETE /identity/v3/projects/85be135f409d4f71944c325ee7356e39 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:51:51.623138 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89163d5f-1ae0-44f2-a3a7-ddf55992b4d1 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:51.623423 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89163d5f-1ae0-44f2-a3a7-ddf55992b4d1 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:51.623709 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89163d5f-1ae0-44f2-a3a7-ddf55992b4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:51.641583 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-89163d5f-1ae0-44f2-a3a7-ddf55992b4d1 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:51.643070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-89163d5f-1ae0-44f2-a3a7-ddf55992b4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:51.700995 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1361/2725] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:51.710258 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44178e-0418-43f1-9ca5-e936a0c2fb91 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:51.710548 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44178e-0418-43f1-9ca5-e936a0c2fb91 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:51.710827 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44178e-0418-43f1-9ca5-e936a0c2fb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:51.728508 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-5f44178e-0418-43f1-9ca5-e936a0c2fb91 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:51.729737 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5f44178e-0418-43f1-9ca5-e936a0c2fb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:51.738007 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1365/2726] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:51.741913 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89163d5f-1ae0-44f2-a3a7-ddf55992b4d1 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:51.751545 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89163d5f-1ae0-44f2-a3a7-ddf55992b4d1 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:51.756688 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044242c-07dc-40d7-8984-d3e1e7cd9e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:51.757610 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044242c-07dc-40d7-8984-d3e1e7cd9e41 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:51.757892 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044242c-07dc-40d7-8984-d3e1e7cd9e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:51.758169 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044242c-07dc-40d7-8984-d3e1e7cd9e41 admin admin] PATH_INFO: `/v3/domains` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:51.758900 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044242c-07dc-40d7-8984-d3e1e7cd9e41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79176) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:51:51.759204 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044242c-07dc-40d7-8984-d3e1e7cd9e41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:51.760779 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044242c-07dc-40d7-8984-d3e1e7cd9e41 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:51.771735 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1362/2727] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:51:51.775807 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44178e-0418-43f1-9ca5-e936a0c2fb91 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:51.784769 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44178e-0418-43f1-9ca5-e936a0c2fb91 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:51.789331 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb6442-c9b1-43b1-a6d6-56e448fdd3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:51.789964 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb6442-c9b1-43b1-a6d6-56e448fdd3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:51.790244 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb6442-c9b1-43b1-a6d6-56e448fdd3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:51.790518 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bb6442-c9b1-43b1-a6d6-56e448fdd3b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:51.791204 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb6442-c9b1-43b1-a6d6-56e448fdd3b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:51.793138 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bb6442-c9b1-43b1-a6d6-56e448fdd3b1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:51.817982 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1366/2728] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:51:51 2022] POST /identity/v3/projects => generated 363 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:51.822000 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044242c-07dc-40d7-8984-d3e1e7cd9e41 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:51.831608 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044242c-07dc-40d7-8984-d3e1e7cd9e41 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:51.884067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741be23-f72e-48fc-96f0-9a49376c1917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:51.884718 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741be23-f72e-48fc-96f0-9a49376c1917 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:51.884998 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741be23-f72e-48fc-96f0-9a49376c1917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:51.885299 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741be23-f72e-48fc-96f0-9a49376c1917 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:51.885995 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741be23-f72e-48fc-96f0-9a49376c1917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:51.887887 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741be23-f72e-48fc-96f0-9a49376c1917 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:51.907132 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1363/2729] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:51:51 2022] POST /identity/v3/users => generated 282 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:51.911462 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb6442-c9b1-43b1-a6d6-56e448fdd3b1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:51.921565 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bb6442-c9b1-43b1-a6d6-56e448fdd3b1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:51.926643 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786dff97-13f2-469a-9d8c-45a908417b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:51.927299 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786dff97-13f2-469a-9d8c-45a908417b2c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:51.927584 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786dff97-13f2-469a-9d8c-45a908417b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:51.927866 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786dff97-13f2-469a-9d8c-45a908417b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:51.928611 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786dff97-13f2-469a-9d8c-45a908417b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:51.930242 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786dff97-13f2-469a-9d8c-45a908417b2c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:51.940847 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1367/2730] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:51.944757 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741be23-f72e-48fc-96f0-9a49376c1917 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:51.954447 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741be23-f72e-48fc-96f0-9a49376c1917 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:51.958951 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f19a3f-ffc6-401f-ac25-7212a82e425e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:51.959588 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f19a3f-ffc6-401f-ac25-7212a82e425e admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:51.959874 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f19a3f-ffc6-401f-ac25-7212a82e425e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:51.960170 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f19a3f-ffc6-401f-ac25-7212a82e425e admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:51.960895 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f19a3f-ffc6-401f-ac25-7212a82e425e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:51.962489 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f19a3f-ffc6-401f-ac25-7212a82e425e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:51.971834 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1364/2731] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:51.976464 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786dff97-13f2-469a-9d8c-45a908417b2c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:51.992734 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786dff97-13f2-469a-9d8c-45a908417b2c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:51.997228 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96c987-6e63-4065-9b5f-f3c8089c4f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:51.998108 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96c987-6e63-4065-9b5f-f3c8089c4f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:51.998381 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96c987-6e63-4065-9b5f-f3c8089c4f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:51.998650 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96c987-6e63-4065-9b5f-f3c8089c4f80 admin admin] PATH_INFO: `/v3/projects/48197e1dab024f5abafdd037f9a31e5b/users/0fdce8eab39240f980447e1c6c71e70e/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:52.013673 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96c987-6e63-4065-9b5f-f3c8089c4f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48197e1dab024f5abafdd037f9a31e5b, user_id=0fdce8eab39240f980447e1c6c71e70e, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:52.016325 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96c987-6e63-4065-9b5f-f3c8089c4f80 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:52.029601 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1368/2732] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:51:51 2022] PUT /identity/v3/projects/48197e1dab024f5abafdd037f9a31e5b/users/0fdce8eab39240f980447e1c6c71e70e/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:52.039562 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472053d4-8b31-4079-b195-a2c6f8510a8b None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:52.039869 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472053d4-8b31-4079-b195-a2c6f8510a8b None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:52.040172 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472053d4-8b31-4079-b195-a2c6f8510a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:52.066697 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-472053d4-8b31-4079-b195-a2c6f8510a8b None None] MFA Rules not processed for user `0fdce8eab39240f980447e1c6c71e70e`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:52.067866 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-472053d4-8b31-4079-b195-a2c6f8510a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:52.126359 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1365/2733] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:52 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:52.131297 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96c987-6e63-4065-9b5f-f3c8089c4f80 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:52.189452 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96c987-6e63-4065-9b5f-f3c8089c4f80 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:52.194089 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f059d-7cf2-4256-958b-4e94aa237f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:52.194748 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f059d-7cf2-4256-958b-4e94aa237f3f admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:52.195028 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f059d-7cf2-4256-958b-4e94aa237f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:52.195305 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f059d-7cf2-4256-958b-4e94aa237f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:52.196001 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f059d-7cf2-4256-958b-4e94aa237f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:52.198011 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f059d-7cf2-4256-958b-4e94aa237f3f admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:52.221960 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1369/2734] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:51:52 2022] POST /identity/v3/projects => generated 363 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:52.226311 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472053d4-8b31-4079-b195-a2c6f8510a8b None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:52.236510 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472053d4-8b31-4079-b195-a2c6f8510a8b None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:52.295056 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db97b3-385c-4c2b-b92a-b3b3450eeb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:52.295735 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db97b3-385c-4c2b-b92a-b3b3450eeb85 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:52.296020 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db97b3-385c-4c2b-b92a-b3b3450eeb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:52.296315 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db97b3-385c-4c2b-b92a-b3b3450eeb85 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:52.297028 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db97b3-385c-4c2b-b92a-b3b3450eeb85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:52.298944 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db97b3-385c-4c2b-b92a-b3b3450eeb85 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:52.318512 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1366/2735] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:51:52 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:52.322525 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f059d-7cf2-4256-958b-4e94aa237f3f admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:52.333188 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f059d-7cf2-4256-958b-4e94aa237f3f admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:52.337791 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c41c8-cc44-48e7-a168-65333f9e1b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:52.338440 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c41c8-cc44-48e7-a168-65333f9e1b85 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:52.338721 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c41c8-cc44-48e7-a168-65333f9e1b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:52.338995 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c41c8-cc44-48e7-a168-65333f9e1b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:52.339727 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c41c8-cc44-48e7-a168-65333f9e1b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:52.341367 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c41c8-cc44-48e7-a168-65333f9e1b85 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:52.352037 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1370/2736] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:52.356117 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db97b3-385c-4c2b-b92a-b3b3450eeb85 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:52.366535 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db97b3-385c-4c2b-b92a-b3b3450eeb85 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:52.371142 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251a169-32fa-45d1-8f8d-1fcfe90ef669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:52.372010 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251a169-32fa-45d1-8f8d-1fcfe90ef669 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:52.372293 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251a169-32fa-45d1-8f8d-1fcfe90ef669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:52.372572 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251a169-32fa-45d1-8f8d-1fcfe90ef669 admin admin] PATH_INFO: `/v3/projects/35ea7a2c056745eebe1056aeb2b46bb8/users/c3b145e086154585bc0d100512a9899c/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:52.386833 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251a169-32fa-45d1-8f8d-1fcfe90ef669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35ea7a2c056745eebe1056aeb2b46bb8, user_id=c3b145e086154585bc0d100512a9899c, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:52.389544 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251a169-32fa-45d1-8f8d-1fcfe90ef669 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:52.402000 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1367/2737] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:51:52 2022] PUT /identity/v3/projects/35ea7a2c056745eebe1056aeb2b46bb8/users/c3b145e086154585bc0d100512a9899c/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:51:52.405859 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c41c8-cc44-48e7-a168-65333f9e1b85 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:52.416062 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c41c8-cc44-48e7-a168-65333f9e1b85 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:52.467540 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c4efa-4d22-477c-ba32-5f6ea9eec611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:52.468188 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c4efa-4d22-477c-ba32-5f6ea9eec611 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:52.468469 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c4efa-4d22-477c-ba32-5f6ea9eec611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:52.468744 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c4efa-4d22-477c-ba32-5f6ea9eec611 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:52.469496 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c4efa-4d22-477c-ba32-5f6ea9eec611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:52.471078 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c4efa-4d22-477c-ba32-5f6ea9eec611 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:52.480912 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1371/2738] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:52.484899 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251a169-32fa-45d1-8f8d-1fcfe90ef669 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:52.495630 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251a169-32fa-45d1-8f8d-1fcfe90ef669 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:52.500192 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77cf50-4964-4331-b87a-bf9f7fd36c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:52.501092 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77cf50-4964-4331-b87a-bf9f7fd36c8b admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:52.501379 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77cf50-4964-4331-b87a-bf9f7fd36c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:52.501656 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77cf50-4964-4331-b87a-bf9f7fd36c8b admin admin] PATH_INFO: `/v3/projects/35ea7a2c056745eebe1056aeb2b46bb8/users/c3b145e086154585bc0d100512a9899c/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:52.503652 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77cf50-4964-4331-b87a-bf9f7fd36c8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=35ea7a2c056745eebe1056aeb2b46bb8, user_id=c3b145e086154585bc0d100512a9899c, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:52.506316 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77cf50-4964-4331-b87a-bf9f7fd36c8b admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:52.516775 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1368/2739] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:51:52 2022] PUT /identity/v3/projects/35ea7a2c056745eebe1056aeb2b46bb8/users/c3b145e086154585bc0d100512a9899c/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:51:52.528282 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95793e-4383-4281-9cac-7d5d7b49b549 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:52.528568 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95793e-4383-4281-9cac-7d5d7b49b549 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:52.528845 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95793e-4383-4281-9cac-7d5d7b49b549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:52.555217 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2b95793e-4383-4281-9cac-7d5d7b49b549 None None] MFA Rules not processed for user `c3b145e086154585bc0d100512a9899c`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:52.556408 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2b95793e-4383-4281-9cac-7d5d7b49b549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:52.620203 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1372/2740] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:52 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:52.631583 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77cf50-4964-4331-b87a-bf9f7fd36c8b admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:52.634530 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-1b77cf50-4964-4331-b87a-bf9f7fd36c8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:52.698043 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77cf50-4964-4331-b87a-bf9f7fd36c8b admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:52.701794 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5eead0-4e6b-42f8-ae37-9a614858d95e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:52.702442 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5eead0-4e6b-42f8-ae37-9a614858d95e service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:52.702722 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5eead0-4e6b-42f8-ae37-9a614858d95e service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:52.702996 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5eead0-4e6b-42f8-ae37-9a614858d95e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:52.712465 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5eead0-4e6b-42f8-ae37-9a614858d95e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:52.713925 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5eead0-4e6b-42f8-ae37-9a614858d95e service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:52.724176 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1369/2741] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:51:52 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:51:52.875460 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95793e-4383-4281-9cac-7d5d7b49b549 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:52.935748 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95793e-4383-4281-9cac-7d5d7b49b549 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:52.940220 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06195027-94c6-44d9-acc4-04803f74c2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:52.941100 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06195027-94c6-44d9-acc4-04803f74c2c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:52.941385 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06195027-94c6-44d9-acc4-04803f74c2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:52.941664 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06195027-94c6-44d9-acc4-04803f74c2c7 admin admin] PATH_INFO: `/v3/users/0fdce8eab39240f980447e1c6c71e70e` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:52.942857 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06195027-94c6-44d9-acc4-04803f74c2c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fdce8eab39240f980447e1c6c71e70e)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:52.944781 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06195027-94c6-44d9-acc4-04803f74c2c7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:52.987589 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-06195027-94c6-44d9-acc4-04803f74c2c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fdce8eab39240f980447e1c6c71e70e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:52.995342 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-06195027-94c6-44d9-acc4-04803f74c2c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fdce8eab39240f980447e1c6c71e70e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:52.996242 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-06195027-94c6-44d9-acc4-04803f74c2c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fdce8eab39240f980447e1c6c71e70e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:53.011983 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-06195027-94c6-44d9-acc4-04803f74c2c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fdce8eab39240f980447e1c6c71e70e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:53.021285 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-06195027-94c6-44d9-acc4-04803f74c2c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fdce8eab39240f980447e1c6c71e70e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:53.027334 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1373/2742] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:51:52 2022] DELETE /identity/v3/users/0fdce8eab39240f980447e1c6c71e70e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:53.032049 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3d432-a36f-48b4-a6f4-5e24c451eab3 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:53.032256 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3d432-a36f-48b4-a6f4-5e24c451eab3 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:53.032555 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3d432-a36f-48b4-a6f4-5e24c451eab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:53.056228 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-17f3d432-a36f-48b4-a6f4-5e24c451eab3 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:53.057452 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-17f3d432-a36f-48b4-a6f4-5e24c451eab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:53.112836 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1370/2743] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:53.122411 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06195027-94c6-44d9-acc4-04803f74c2c7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:53.123816 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-06195027-94c6-44d9-acc4-04803f74c2c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:53.178218 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06195027-94c6-44d9-acc4-04803f74c2c7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:53.181806 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d073f-3d62-4c01-b489-5c35bd1da727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:53.182644 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d073f-3d62-4c01-b489-5c35bd1da727 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:53.182951 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d073f-3d62-4c01-b489-5c35bd1da727 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:53.183225 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d073f-3d62-4c01-b489-5c35bd1da727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:53.192258 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d073f-3d62-4c01-b489-5c35bd1da727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:53.193735 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d073f-3d62-4c01-b489-5c35bd1da727 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:53.202963 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1374/2744] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:51:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:51:53.468789 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3d432-a36f-48b4-a6f4-5e24c451eab3 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:53.470276 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-17f3d432-a36f-48b4-a6f4-5e24c451eab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:53.482265 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3d432-a36f-48b4-a6f4-5e24c451eab3 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:53.486989 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e0c29-d7b1-4ebb-95f9-30b20546a2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:53.487832 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e0c29-d7b1-4ebb-95f9-30b20546a2db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:53.488108 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e0c29-d7b1-4ebb-95f9-30b20546a2db admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:53.488377 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e0c29-d7b1-4ebb-95f9-30b20546a2db admin admin] PATH_INFO: `/v3/projects/48197e1dab024f5abafdd037f9a31e5b` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:53.489584 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e0c29-d7b1-4ebb-95f9-30b20546a2db admin admin] RBAC: Authorizing `identity:delete_project(project_id=48197e1dab024f5abafdd037f9a31e5b)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:53.491588 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e0c29-d7b1-4ebb-95f9-30b20546a2db admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:53.536593 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-457e0c29-d7b1-4ebb-95f9-30b20546a2db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48197e1dab024f5abafdd037f9a31e5b', 'request_id': 'req-457e0c29-d7b1-4ebb-95f9-30b20546a2db'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:53.542889 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-457e0c29-d7b1-4ebb-95f9-30b20546a2db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48197e1dab024f5abafdd037f9a31e5b', 'request_id': 'req-457e0c29-d7b1-4ebb-95f9-30b20546a2db'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:53.549897 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-457e0c29-d7b1-4ebb-95f9-30b20546a2db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48197e1dab024f5abafdd037f9a31e5b', 'request_id': 'req-457e0c29-d7b1-4ebb-95f9-30b20546a2db'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:53.559762 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-457e0c29-d7b1-4ebb-95f9-30b20546a2db admin admin] The token cache is being invalidate because project 48197e1dab024f5abafdd037f9a31e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:51:53.560172 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-457e0c29-d7b1-4ebb-95f9-30b20546a2db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:53.561091 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-457e0c29-d7b1-4ebb-95f9-30b20546a2db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:53.562552 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1371/2745] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:51:53 2022] DELETE /identity/v3/projects/48197e1dab024f5abafdd037f9a31e5b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:53.567070 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d073f-3d62-4c01-b489-5c35bd1da727 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:53.576505 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d073f-3d62-4c01-b489-5c35bd1da727 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:53.629495 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fdfb59-c5d2-4b0c-84cd-9fd42e9f3df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:53.630349 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdfb59-c5d2-4b0c-84cd-9fd42e9f3df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:53.630630 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdfb59-c5d2-4b0c-84cd-9fd42e9f3df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:53.630903 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fdfb59-c5d2-4b0c-84cd-9fd42e9f3df4 admin admin] PATH_INFO: `/v3/users/c3b145e086154585bc0d100512a9899c` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:53.632074 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdfb59-c5d2-4b0c-84cd-9fd42e9f3df4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3b145e086154585bc0d100512a9899c)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:53.634281 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fdfb59-c5d2-4b0c-84cd-9fd42e9f3df4 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:53.677678 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-16fdfb59-c5d2-4b0c-84cd-9fd42e9f3df4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3b145e086154585bc0d100512a9899c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:53.684171 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-16fdfb59-c5d2-4b0c-84cd-9fd42e9f3df4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3b145e086154585bc0d100512a9899c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:53.684819 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-16fdfb59-c5d2-4b0c-84cd-9fd42e9f3df4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3b145e086154585bc0d100512a9899c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:53.696580 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-16fdfb59-c5d2-4b0c-84cd-9fd42e9f3df4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3b145e086154585bc0d100512a9899c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:53.702962 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-16fdfb59-c5d2-4b0c-84cd-9fd42e9f3df4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3b145e086154585bc0d100512a9899c'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:53.709514 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1375/2746] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:51:53 2022] DELETE /identity/v3/users/c3b145e086154585bc0d100512a9899c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:53.968898 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e0c29-d7b1-4ebb-95f9-30b20546a2db admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:53.970423 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-457e0c29-d7b1-4ebb-95f9-30b20546a2db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:53.985543 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e0c29-d7b1-4ebb-95f9-30b20546a2db admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:54.052320 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa26126-d239-4b55-bc70-0510149c2a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:54.053241 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa26126-d239-4b55-bc70-0510149c2a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:54.053522 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa26126-d239-4b55-bc70-0510149c2a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:54.054771 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa26126-d239-4b55-bc70-0510149c2a73 admin admin] PATH_INFO: `/v3/projects/35ea7a2c056745eebe1056aeb2b46bb8` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:54.054981 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa26126-d239-4b55-bc70-0510149c2a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35ea7a2c056745eebe1056aeb2b46bb8)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:54.056876 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa26126-d239-4b55-bc70-0510149c2a73 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:54.106542 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3fa26126-d239-4b55-bc70-0510149c2a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35ea7a2c056745eebe1056aeb2b46bb8', 'request_id': 'req-3fa26126-d239-4b55-bc70-0510149c2a73'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:54.113892 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3fa26126-d239-4b55-bc70-0510149c2a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35ea7a2c056745eebe1056aeb2b46bb8', 'request_id': 'req-3fa26126-d239-4b55-bc70-0510149c2a73'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:54.120149 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3fa26126-d239-4b55-bc70-0510149c2a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35ea7a2c056745eebe1056aeb2b46bb8', 'request_id': 'req-3fa26126-d239-4b55-bc70-0510149c2a73'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:54.130526 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3fa26126-d239-4b55-bc70-0510149c2a73 admin admin] The token cache is being invalidate because project 35ea7a2c056745eebe1056aeb2b46bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:51:54.130808 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3fa26126-d239-4b55-bc70-0510149c2a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:54.131427 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-3fa26126-d239-4b55-bc70-0510149c2a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:54.133228 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1372/2747] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:51:53 2022] DELETE /identity/v3/projects/35ea7a2c056745eebe1056aeb2b46bb8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:54.138969 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09854410-53a9-4d73-8339-37f5a000ab02 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:54.139255 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09854410-53a9-4d73-8339-37f5a000ab02 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:54.139532 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09854410-53a9-4d73-8339-37f5a000ab02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:54.157674 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-09854410-53a9-4d73-8339-37f5a000ab02 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:54.158887 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-09854410-53a9-4d73-8339-37f5a000ab02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:54.215254 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1376/2748] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:54.223267 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05880a03-980f-4910-9199-62516c3f5482 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:54.223560 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05880a03-980f-4910-9199-62516c3f5482 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:54.223839 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05880a03-980f-4910-9199-62516c3f5482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:54.242953 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-05880a03-980f-4910-9199-62516c3f5482 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:54.244145 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-05880a03-980f-4910-9199-62516c3f5482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:54.251873 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1373/2749] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:54.256170 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09854410-53a9-4d73-8339-37f5a000ab02 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:54.265871 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09854410-53a9-4d73-8339-37f5a000ab02 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:54.271067 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e2c80-f463-4adc-8cc5-a09fe46e8d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:54.271723 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e2c80-f463-4adc-8cc5-a09fe46e8d9c admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:54.272005 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e2c80-f463-4adc-8cc5-a09fe46e8d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:54.272278 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e2c80-f463-4adc-8cc5-a09fe46e8d9c admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:54.273037 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e2c80-f463-4adc-8cc5-a09fe46e8d9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:51:54.273352 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e2c80-f463-4adc-8cc5-a09fe46e8d9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:54.274947 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e2c80-f463-4adc-8cc5-a09fe46e8d9c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:54.286943 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1377/2750] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:51:54.290997 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05880a03-980f-4910-9199-62516c3f5482 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:54.299946 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05880a03-980f-4910-9199-62516c3f5482 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:54.304510 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295db0f-e9cb-43a5-9e97-6686bf9a45b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:54.305241 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295db0f-e9cb-43a5-9e97-6686bf9a45b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:54.305483 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295db0f-e9cb-43a5-9e97-6686bf9a45b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:54.305740 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295db0f-e9cb-43a5-9e97-6686bf9a45b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:54.306442 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295db0f-e9cb-43a5-9e97-6686bf9a45b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:54.308349 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295db0f-e9cb-43a5-9e97-6686bf9a45b9 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:54.334178 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1374/2751] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:51:54 2022] POST /identity/v3/projects => generated 367 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:51:54.338600 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e2c80-f463-4adc-8cc5-a09fe46e8d9c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:54.350305 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e2c80-f463-4adc-8cc5-a09fe46e8d9c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:54.407114 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32178f46-b0df-4633-9f36-c3c5dd42cd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:54.407793 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32178f46-b0df-4633-9f36-c3c5dd42cd94 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:54.408226 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32178f46-b0df-4633-9f36-c3c5dd42cd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:54.408512 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32178f46-b0df-4633-9f36-c3c5dd42cd94 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:54.409275 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32178f46-b0df-4633-9f36-c3c5dd42cd94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:54.411238 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32178f46-b0df-4633-9f36-c3c5dd42cd94 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:54.432181 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1378/2752] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:51:54 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:51:54.436386 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295db0f-e9cb-43a5-9e97-6686bf9a45b9 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:54.446810 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295db0f-e9cb-43a5-9e97-6686bf9a45b9 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:54.451361 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e6b61-64da-4549-a47b-625933b8724d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:54.451998 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e6b61-64da-4549-a47b-625933b8724d admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:54.452341 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e6b61-64da-4549-a47b-625933b8724d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:54.452621 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e6b61-64da-4549-a47b-625933b8724d admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:54.453387 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e6b61-64da-4549-a47b-625933b8724d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:54.454966 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e6b61-64da-4549-a47b-625933b8724d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:54.465786 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1375/2753] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:51:54.470236 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32178f46-b0df-4633-9f36-c3c5dd42cd94 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:54.480713 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32178f46-b0df-4633-9f36-c3c5dd42cd94 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:54.485458 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c92be3-d653-49a6-8bee-3538d7ceae64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:54.486113 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c92be3-d653-49a6-8bee-3538d7ceae64 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:54.486393 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c92be3-d653-49a6-8bee-3538d7ceae64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:54.486667 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c92be3-d653-49a6-8bee-3538d7ceae64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:54.487587 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c92be3-d653-49a6-8bee-3538d7ceae64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:54.489271 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c92be3-d653-49a6-8bee-3538d7ceae64 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:54.499400 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1379/2754] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:54.504122 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e6b61-64da-4549-a47b-625933b8724d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:54.514218 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e6b61-64da-4549-a47b-625933b8724d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:54.518822 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da6b22-7dd7-4460-8a07-19e759f409aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:54.519687 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da6b22-7dd7-4460-8a07-19e759f409aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:54.519964 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da6b22-7dd7-4460-8a07-19e759f409aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:54.520230 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da6b22-7dd7-4460-8a07-19e759f409aa admin admin] PATH_INFO: `/v3/projects/8806c2a458be40d1bbab6c242b05d811/users/11a3883f9e1145189de40cd4baa9d125/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:54.534721 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da6b22-7dd7-4460-8a07-19e759f409aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8806c2a458be40d1bbab6c242b05d811, user_id=11a3883f9e1145189de40cd4baa9d125, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:54.537545 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da6b22-7dd7-4460-8a07-19e759f409aa admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:54.551793 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1376/2755] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:51:54 2022] PUT /identity/v3/projects/8806c2a458be40d1bbab6c242b05d811/users/11a3883f9e1145189de40cd4baa9d125/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:51:54.561962 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371728d-1432-4046-9931-1c028f528a95 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:54.562352 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371728d-1432-4046-9931-1c028f528a95 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:54.562474 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371728d-1432-4046-9931-1c028f528a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:54.599823 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-0371728d-1432-4046-9931-1c028f528a95 None None] MFA Rules not processed for user `11a3883f9e1145189de40cd4baa9d125`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:54.601122 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0371728d-1432-4046-9931-1c028f528a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:54.678039 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1380/2756] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:51:54.682607 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da6b22-7dd7-4460-8a07-19e759f409aa admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:54.745631 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da6b22-7dd7-4460-8a07-19e759f409aa admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:54.750483 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bdb32-b97e-429d-9146-f843ad66e041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:54.751158 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bdb32-b97e-429d-9146-f843ad66e041 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:54.751440 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bdb32-b97e-429d-9146-f843ad66e041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:54.751715 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bdb32-b97e-429d-9146-f843ad66e041 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:54.752423 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bdb32-b97e-429d-9146-f843ad66e041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:54.754334 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bdb32-b97e-429d-9146-f843ad66e041 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:54.779127 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1377/2757] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:51:54 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:54.783276 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371728d-1432-4046-9931-1c028f528a95 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:54.794350 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371728d-1432-4046-9931-1c028f528a95 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:54.845999 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0e3ef-fc8e-4d77-8746-c05ae225c1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:54.847158 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0e3ef-fc8e-4d77-8746-c05ae225c1eb admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:54.847442 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0e3ef-fc8e-4d77-8746-c05ae225c1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:54.847718 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0e3ef-fc8e-4d77-8746-c05ae225c1eb admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:54.848421 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0e3ef-fc8e-4d77-8746-c05ae225c1eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:54.850373 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0e3ef-fc8e-4d77-8746-c05ae225c1eb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:54.869197 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1381/2758] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:51:54 2022] POST /identity/v3/users => generated 289 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:54.873308 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bdb32-b97e-429d-9146-f843ad66e041 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:54.884449 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bdb32-b97e-429d-9146-f843ad66e041 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:54.888925 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db428606-22a8-4248-8f0d-eb58a540c7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:54.889607 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db428606-22a8-4248-8f0d-eb58a540c7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:54.889892 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db428606-22a8-4248-8f0d-eb58a540c7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:54.890170 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db428606-22a8-4248-8f0d-eb58a540c7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:54.890905 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db428606-22a8-4248-8f0d-eb58a540c7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:54.892709 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db428606-22a8-4248-8f0d-eb58a540c7e2 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:54.903777 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1378/2759] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:54.907994 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0e3ef-fc8e-4d77-8746-c05ae225c1eb admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:54.918289 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0e3ef-fc8e-4d77-8746-c05ae225c1eb admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:54.922869 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35e800-87c7-478c-abf5-6b890aa6e0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:54.923739 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35e800-87c7-478c-abf5-6b890aa6e0d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:54.924022 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35e800-87c7-478c-abf5-6b890aa6e0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:54.924322 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35e800-87c7-478c-abf5-6b890aa6e0d0 admin admin] PATH_INFO: `/v3/projects/4da4b7c877af4a4b86b72a116f7e87cd/users/d0d496559c6b4a759fd4b63852fbdafa/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:54.938389 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35e800-87c7-478c-abf5-6b890aa6e0d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da4b7c877af4a4b86b72a116f7e87cd, user_id=d0d496559c6b4a759fd4b63852fbdafa, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:54.941109 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35e800-87c7-478c-abf5-6b890aa6e0d0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:54.953415 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1382/2760] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:51:54 2022] PUT /identity/v3/projects/4da4b7c877af4a4b86b72a116f7e87cd/users/d0d496559c6b4a759fd4b63852fbdafa/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:54.958005 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db428606-22a8-4248-8f0d-eb58a540c7e2 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:54.967809 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db428606-22a8-4248-8f0d-eb58a540c7e2 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:55.021901 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014dd269-e24c-4806-b144-98beb1bf683a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:55.022557 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dd269-e24c-4806-b144-98beb1bf683a admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:55.022837 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dd269-e24c-4806-b144-98beb1bf683a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:55.023115 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014dd269-e24c-4806-b144-98beb1bf683a admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:55.023838 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014dd269-e24c-4806-b144-98beb1bf683a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:55.025453 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014dd269-e24c-4806-b144-98beb1bf683a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:55.034706 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1379/2761] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:55.038790 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35e800-87c7-478c-abf5-6b890aa6e0d0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:55.048653 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35e800-87c7-478c-abf5-6b890aa6e0d0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:55.053773 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8296bd-df8f-47fb-a2a1-527e793350cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:55.054641 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8296bd-df8f-47fb-a2a1-527e793350cb admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:55.054924 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8296bd-df8f-47fb-a2a1-527e793350cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:55.055201 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8296bd-df8f-47fb-a2a1-527e793350cb admin admin] PATH_INFO: `/v3/projects/4da4b7c877af4a4b86b72a116f7e87cd/users/d0d496559c6b4a759fd4b63852fbdafa/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:55.057203 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8296bd-df8f-47fb-a2a1-527e793350cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da4b7c877af4a4b86b72a116f7e87cd, user_id=d0d496559c6b4a759fd4b63852fbdafa, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:55.059838 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8296bd-df8f-47fb-a2a1-527e793350cb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:55.070596 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1383/2762] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:51:55 2022] PUT /identity/v3/projects/4da4b7c877af4a4b86b72a116f7e87cd/users/d0d496559c6b4a759fd4b63852fbdafa/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:55.081774 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c2965-009b-4950-b1d8-5d5260956504 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:55.082070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c2965-009b-4950-b1d8-5d5260956504 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:55.082349 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c2965-009b-4950-b1d8-5d5260956504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:55.108068 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-ae8c2965-009b-4950-b1d8-5d5260956504 None None] MFA Rules not processed for user `d0d496559c6b4a759fd4b63852fbdafa`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:55.109258 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-ae8c2965-009b-4950-b1d8-5d5260956504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:55.173464 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1380/2763] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:55 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:55.184058 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8296bd-df8f-47fb-a2a1-527e793350cb admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:55.185764 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1c8296bd-df8f-47fb-a2a1-527e793350cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:55.242314 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8296bd-df8f-47fb-a2a1-527e793350cb admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:55.246914 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead417c7-915a-4cf2-9ba3-22158224a50a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:55.247677 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead417c7-915a-4cf2-9ba3-22158224a50a service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:55.247961 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead417c7-915a-4cf2-9ba3-22158224a50a service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:55.248246 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead417c7-915a-4cf2-9ba3-22158224a50a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:55.258438 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead417c7-915a-4cf2-9ba3-22158224a50a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:55.259873 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead417c7-915a-4cf2-9ba3-22158224a50a service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:55.268953 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1384/2764] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:51:55 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:51:55.345400 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c2965-009b-4950-b1d8-5d5260956504 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:55.355346 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c2965-009b-4950-b1d8-5d5260956504 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:55.358995 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a070e-e67f-4bc0-92ce-fe81d7c3d75d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:55.359594 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a070e-e67f-4bc0-92ce-fe81d7c3d75d service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:55.359873 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a070e-e67f-4bc0-92ce-fe81d7c3d75d service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:55.360147 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a070e-e67f-4bc0-92ce-fe81d7c3d75d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:55.416867 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a070e-e67f-4bc0-92ce-fe81d7c3d75d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:55.418353 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a070e-e67f-4bc0-92ce-fe81d7c3d75d service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:55.427459 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1381/2765] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:51:55 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:51:58.174142 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead417c7-915a-4cf2-9ba3-22158224a50a service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:58.176195 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-ead417c7-915a-4cf2-9ba3-22158224a50a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:58.241377 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead417c7-915a-4cf2-9ba3-22158224a50a service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:58.246742 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295cc97-c0ef-44cb-83a7-2e66ebf7c135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:58.247725 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295cc97-c0ef-44cb-83a7-2e66ebf7c135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:58.249224 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295cc97-c0ef-44cb-83a7-2e66ebf7c135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:58.249512 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295cc97-c0ef-44cb-83a7-2e66ebf7c135 admin admin] PATH_INFO: `/v3/users/9ce624fdccd24392a0eaf14b25fa83af` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:58.250736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295cc97-c0ef-44cb-83a7-2e66ebf7c135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ce624fdccd24392a0eaf14b25fa83af)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:58.252701 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295cc97-c0ef-44cb-83a7-2e66ebf7c135 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:58.304150 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a295cc97-c0ef-44cb-83a7-2e66ebf7c135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ce624fdccd24392a0eaf14b25fa83af'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:58.310944 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a295cc97-c0ef-44cb-83a7-2e66ebf7c135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ce624fdccd24392a0eaf14b25fa83af'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:58.311640 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a295cc97-c0ef-44cb-83a7-2e66ebf7c135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ce624fdccd24392a0eaf14b25fa83af'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:58.322956 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a295cc97-c0ef-44cb-83a7-2e66ebf7c135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ce624fdccd24392a0eaf14b25fa83af'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:58.330757 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-a295cc97-c0ef-44cb-83a7-2e66ebf7c135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ce624fdccd24392a0eaf14b25fa83af'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:58.337168 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1385/2766] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:51:58 2022] DELETE /identity/v3/users/9ce624fdccd24392a0eaf14b25fa83af => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:58.341425 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0346e87-82e3-4633-94b6-dd94b3839454 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:58.341915 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0346e87-82e3-4633-94b6-dd94b3839454 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:58.342023 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0346e87-82e3-4633-94b6-dd94b3839454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:58.359860 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-e0346e87-82e3-4633-94b6-dd94b3839454 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:58.361098 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-e0346e87-82e3-4633-94b6-dd94b3839454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:58.419084 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1382/2767] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:58.429038 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295cc97-c0ef-44cb-83a7-2e66ebf7c135 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:58.430454 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a295cc97-c0ef-44cb-83a7-2e66ebf7c135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:58.489650 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295cc97-c0ef-44cb-83a7-2e66ebf7c135 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:58.493629 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b6d70-1616-448d-8dc5-ac0f84eed98e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:58.494668 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b6d70-1616-448d-8dc5-ac0f84eed98e service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:58.494954 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b6d70-1616-448d-8dc5-ac0f84eed98e service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:58.495287 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b6d70-1616-448d-8dc5-ac0f84eed98e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:58.504912 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b6d70-1616-448d-8dc5-ac0f84eed98e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:58.506395 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b6d70-1616-448d-8dc5-ac0f84eed98e service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:58.515907 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1386/2768] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:51:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:51:58.788150 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0346e87-82e3-4633-94b6-dd94b3839454 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:58.792716 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-e0346e87-82e3-4633-94b6-dd94b3839454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:58.802128 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0346e87-82e3-4633-94b6-dd94b3839454 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:58.811363 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb72fff-2779-4b68-abac-9b840f7d35e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:58.812385 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb72fff-2779-4b68-abac-9b840f7d35e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:58.812742 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb72fff-2779-4b68-abac-9b840f7d35e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:58.813052 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb72fff-2779-4b68-abac-9b840f7d35e0 admin admin] PATH_INFO: `/v3/projects/c3b319f0bd6f4a8f9f91bf2a2c6c899e` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:58.814272 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb72fff-2779-4b68-abac-9b840f7d35e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3b319f0bd6f4a8f9f91bf2a2c6c899e)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:58.816311 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb72fff-2779-4b68-abac-9b840f7d35e0 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:58.870982 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7fb72fff-2779-4b68-abac-9b840f7d35e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3b319f0bd6f4a8f9f91bf2a2c6c899e', 'request_id': 'req-7fb72fff-2779-4b68-abac-9b840f7d35e0'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:58.878441 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7fb72fff-2779-4b68-abac-9b840f7d35e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3b319f0bd6f4a8f9f91bf2a2c6c899e', 'request_id': 'req-7fb72fff-2779-4b68-abac-9b840f7d35e0'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:58.884865 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7fb72fff-2779-4b68-abac-9b840f7d35e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3b319f0bd6f4a8f9f91bf2a2c6c899e', 'request_id': 'req-7fb72fff-2779-4b68-abac-9b840f7d35e0'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:58.895732 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7fb72fff-2779-4b68-abac-9b840f7d35e0 admin admin] The token cache is being invalidate because project c3b319f0bd6f4a8f9f91bf2a2c6c899e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:51:58.896016 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7fb72fff-2779-4b68-abac-9b840f7d35e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:58.896645 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-7fb72fff-2779-4b68-abac-9b840f7d35e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:51:58.898200 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1383/2769] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:51:58 2022] DELETE /identity/v3/projects/c3b319f0bd6f4a8f9f91bf2a2c6c899e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:51:58.903961 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0323a-49f0-40af-a564-8829a2a82bfb None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:58.904304 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0323a-49f0-40af-a564-8829a2a82bfb None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:58.904591 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0323a-49f0-40af-a564-8829a2a82bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:58.923305 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-4de0323a-49f0-40af-a564-8829a2a82bfb None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:58.924580 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-4de0323a-49f0-40af-a564-8829a2a82bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:58.983814 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1387/2770] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:59.042074 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ff168-2d03-441e-930f-2babb7ffbe76 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:59.042290 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ff168-2d03-441e-930f-2babb7ffbe76 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:59.042531 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ff168-2d03-441e-930f-2babb7ffbe76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:59.060772 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-068ff168-2d03-441e-930f-2babb7ffbe76 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:59.061982 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-068ff168-2d03-441e-930f-2babb7ffbe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:59.069668 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1384/2771] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:59.073691 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0323a-49f0-40af-a564-8829a2a82bfb None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:59.083366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0323a-49f0-40af-a564-8829a2a82bfb None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:59.087933 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c992a-5f81-4c5e-8b62-f8dea79f60d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:59.088580 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c992a-5f81-4c5e-8b62-f8dea79f60d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:59.088864 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c992a-5f81-4c5e-8b62-f8dea79f60d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:59.089165 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c992a-5f81-4c5e-8b62-f8dea79f60d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:59.089907 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c992a-5f81-4c5e-8b62-f8dea79f60d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:51:59.090217 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c992a-5f81-4c5e-8b62-f8dea79f60d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:59.091821 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394c992a-5f81-4c5e-8b62-f8dea79f60d1 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:59.103800 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1388/2772] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:51:59.108024 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ff168-2d03-441e-930f-2babb7ffbe76 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:59.117454 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ff168-2d03-441e-930f-2babb7ffbe76 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:59.121983 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79206ca-c69d-4b60-a08b-0625dbdc9661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:59.122612 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79206ca-c69d-4b60-a08b-0625dbdc9661 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:59.122892 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79206ca-c69d-4b60-a08b-0625dbdc9661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:59.123161 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79206ca-c69d-4b60-a08b-0625dbdc9661 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:59.123864 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79206ca-c69d-4b60-a08b-0625dbdc9661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:59.125762 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79206ca-c69d-4b60-a08b-0625dbdc9661 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:59.149617 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1385/2773] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:51:59 2022] POST /identity/v3/projects => generated 371 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:51:59.153605 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c992a-5f81-4c5e-8b62-f8dea79f60d1 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:59.163773 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c992a-5f81-4c5e-8b62-f8dea79f60d1 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:59.216888 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db38eb-0186-4395-8d2a-f2170731ef90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:59.217579 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db38eb-0186-4395-8d2a-f2170731ef90 admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:59.217861 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db38eb-0186-4395-8d2a-f2170731ef90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:59.218160 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db38eb-0186-4395-8d2a-f2170731ef90 admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:59.218854 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db38eb-0186-4395-8d2a-f2170731ef90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:59.220770 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db38eb-0186-4395-8d2a-f2170731ef90 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:59.239633 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1389/2774] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:51:59 2022] POST /identity/v3/users => generated 286 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:51:59.243912 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79206ca-c69d-4b60-a08b-0625dbdc9661 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:59.254030 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79206ca-c69d-4b60-a08b-0625dbdc9661 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:59.258830 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45174612-00d7-4a39-a20d-ec8116ce5845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:59.259474 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45174612-00d7-4a39-a20d-ec8116ce5845 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:59.259755 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45174612-00d7-4a39-a20d-ec8116ce5845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:59.260024 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45174612-00d7-4a39-a20d-ec8116ce5845 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:59.260753 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45174612-00d7-4a39-a20d-ec8116ce5845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:59.262356 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45174612-00d7-4a39-a20d-ec8116ce5845 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:59.273751 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1386/2775] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:59.277584 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db38eb-0186-4395-8d2a-f2170731ef90 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:59.287756 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db38eb-0186-4395-8d2a-f2170731ef90 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:59.292380 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d36027-720c-4894-8592-39abb62ef1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:59.292974 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d36027-720c-4894-8592-39abb62ef1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:59.293293 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d36027-720c-4894-8592-39abb62ef1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:59.293573 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d36027-720c-4894-8592-39abb62ef1b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:59.294566 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d36027-720c-4894-8592-39abb62ef1b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:59.296553 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d36027-720c-4894-8592-39abb62ef1b3 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:59.306206 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1390/2776] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:51:59.310282 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45174612-00d7-4a39-a20d-ec8116ce5845 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:59.319734 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45174612-00d7-4a39-a20d-ec8116ce5845 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:59.324201 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1062d55-a548-467f-a3b8-e87665079ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:59.325082 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1062d55-a548-467f-a3b8-e87665079ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:59.325360 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1062d55-a548-467f-a3b8-e87665079ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:59.325682 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1062d55-a548-467f-a3b8-e87665079ad7 admin admin] PATH_INFO: `/v3/projects/b5754e8f1ef149fc8d9469a1033be25e/users/9301ab5eca7a4a978b7b79c0db3632cc/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:59.342562 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1062d55-a548-467f-a3b8-e87665079ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5754e8f1ef149fc8d9469a1033be25e, user_id=9301ab5eca7a4a978b7b79c0db3632cc, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:59.345414 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1062d55-a548-467f-a3b8-e87665079ad7 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:59.359181 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1387/2777] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:51:59 2022] PUT /identity/v3/projects/b5754e8f1ef149fc8d9469a1033be25e/users/9301ab5eca7a4a978b7b79c0db3632cc/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:51:59.364459 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34ca2f-5c6c-4204-941c-4527d9cfa4b6 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:59.364749 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34ca2f-5c6c-4204-941c-4527d9cfa4b6 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:59.365045 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34ca2f-5c6c-4204-941c-4527d9cfa4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:59.382290 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-7b34ca2f-5c6c-4204-941c-4527d9cfa4b6 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:51:59.383738 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7b34ca2f-5c6c-4204-941c-4527d9cfa4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:59.441306 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1391/2778] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:51:59.450894 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1062d55-a548-467f-a3b8-e87665079ad7 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:51:59.452551 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-c1062d55-a548-467f-a3b8-e87665079ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:51:59.507297 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1062d55-a548-467f-a3b8-e87665079ad7 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:51:59.511207 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9649d2-9332-4da2-ae6b-8f86f8f393a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:51:59.511835 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9649d2-9332-4da2-ae6b-8f86f8f393a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:51:59.512114 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9649d2-9332-4da2-ae6b-8f86f8f393a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:51:59.512388 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9649d2-9332-4da2-ae6b-8f86f8f393a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:51:59.521243 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9649d2-9332-4da2-ae6b-8f86f8f393a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:51:59.522653 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9649d2-9332-4da2-ae6b-8f86f8f393a3 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:51:59.531708 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1388/2779] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:51:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:52:00.025276 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34ca2f-5c6c-4204-941c-4527d9cfa4b6 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:00.026747 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7b34ca2f-5c6c-4204-941c-4527d9cfa4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:00.038162 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34ca2f-5c6c-4204-941c-4527d9cfa4b6 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:00.042660 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3db6d-d0b0-4764-9099-dbc43052bf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:00.043563 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3db6d-d0b0-4764-9099-dbc43052bf28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:00.043842 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3db6d-d0b0-4764-9099-dbc43052bf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:00.044115 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c3db6d-d0b0-4764-9099-dbc43052bf28 admin admin] PATH_INFO: `/v3/users/11a3883f9e1145189de40cd4baa9d125` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:00.045351 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3db6d-d0b0-4764-9099-dbc43052bf28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11a3883f9e1145189de40cd4baa9d125)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:00.047787 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c3db6d-d0b0-4764-9099-dbc43052bf28 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:00.097753 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f7c3db6d-d0b0-4764-9099-dbc43052bf28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11a3883f9e1145189de40cd4baa9d125'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:00.104901 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f7c3db6d-d0b0-4764-9099-dbc43052bf28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11a3883f9e1145189de40cd4baa9d125'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:00.105638 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f7c3db6d-d0b0-4764-9099-dbc43052bf28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11a3883f9e1145189de40cd4baa9d125'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:00.118109 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f7c3db6d-d0b0-4764-9099-dbc43052bf28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11a3883f9e1145189de40cd4baa9d125'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:00.126532 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-f7c3db6d-d0b0-4764-9099-dbc43052bf28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11a3883f9e1145189de40cd4baa9d125'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:00.133927 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1392/2780] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:52:00 2022] DELETE /identity/v3/users/11a3883f9e1145189de40cd4baa9d125 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:52:00.138481 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159a2b3-9190-4e04-8447-972eef77da53 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:00.139031 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159a2b3-9190-4e04-8447-972eef77da53 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:00.139289 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159a2b3-9190-4e04-8447-972eef77da53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:00.159125 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-7159a2b3-9190-4e04-8447-972eef77da53 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:52:00.161438 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7159a2b3-9190-4e04-8447-972eef77da53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:00.250888 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1389/2781] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:52:00.252017 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3db6d-d0b0-4764-9099-dbc43052bf28 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:00.256350 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f7c3db6d-d0b0-4764-9099-dbc43052bf28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:00.329031 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c3db6d-d0b0-4764-9099-dbc43052bf28 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:00.336175 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac3718-ade1-44e2-ab56-2e3943993367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:00.337065 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac3718-ade1-44e2-ab56-2e3943993367 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:00.338087 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac3718-ade1-44e2-ab56-2e3943993367 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:00.338659 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac3718-ade1-44e2-ab56-2e3943993367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:00.350879 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac3718-ade1-44e2-ab56-2e3943993367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:00.352595 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac3718-ade1-44e2-ab56-2e3943993367 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:00.363204 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1393/2782] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:52:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:52:00.786565 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159a2b3-9190-4e04-8447-972eef77da53 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:00.788019 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7159a2b3-9190-4e04-8447-972eef77da53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:00.800644 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159a2b3-9190-4e04-8447-972eef77da53 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:00.805908 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f65c26-011e-4c23-a112-c7fdf0a4ed6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:00.807821 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f65c26-011e-4c23-a112-c7fdf0a4ed6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:00.808113 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f65c26-011e-4c23-a112-c7fdf0a4ed6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:00.808397 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f65c26-011e-4c23-a112-c7fdf0a4ed6a admin admin] PATH_INFO: `/v3/projects/8806c2a458be40d1bbab6c242b05d811` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:00.809677 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f65c26-011e-4c23-a112-c7fdf0a4ed6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8806c2a458be40d1bbab6c242b05d811)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:00.811766 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f65c26-011e-4c23-a112-c7fdf0a4ed6a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:00.869143 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-36f65c26-011e-4c23-a112-c7fdf0a4ed6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8806c2a458be40d1bbab6c242b05d811', 'request_id': 'req-36f65c26-011e-4c23-a112-c7fdf0a4ed6a'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:00.877576 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-36f65c26-011e-4c23-a112-c7fdf0a4ed6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8806c2a458be40d1bbab6c242b05d811', 'request_id': 'req-36f65c26-011e-4c23-a112-c7fdf0a4ed6a'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:00.886959 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-36f65c26-011e-4c23-a112-c7fdf0a4ed6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8806c2a458be40d1bbab6c242b05d811', 'request_id': 'req-36f65c26-011e-4c23-a112-c7fdf0a4ed6a'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:00.903959 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-36f65c26-011e-4c23-a112-c7fdf0a4ed6a admin admin] The token cache is being invalidate because project 8806c2a458be40d1bbab6c242b05d811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:52:00.904305 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-36f65c26-011e-4c23-a112-c7fdf0a4ed6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:00.904959 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-36f65c26-011e-4c23-a112-c7fdf0a4ed6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:00.906527 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1390/2783] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:52:00 2022] DELETE /identity/v3/projects/8806c2a458be40d1bbab6c242b05d811 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:52:00.913938 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac3718-ade1-44e2-ab56-2e3943993367 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:00.928215 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac3718-ade1-44e2-ab56-2e3943993367 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:01.006785 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c2e2d7-3fcd-4b1a-99fd-f9a43bb22972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:01.008456 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2e2d7-3fcd-4b1a-99fd-f9a43bb22972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:01.008947 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2e2d7-3fcd-4b1a-99fd-f9a43bb22972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:01.009318 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c2e2d7-3fcd-4b1a-99fd-f9a43bb22972 admin admin] PATH_INFO: `/v3/users/d0d496559c6b4a759fd4b63852fbdafa` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:01.010728 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2e2d7-3fcd-4b1a-99fd-f9a43bb22972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0d496559c6b4a759fd4b63852fbdafa)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:01.012664 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c2e2d7-3fcd-4b1a-99fd-f9a43bb22972 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:01.068532 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-71c2e2d7-3fcd-4b1a-99fd-f9a43bb22972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0d496559c6b4a759fd4b63852fbdafa'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:01.078816 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-71c2e2d7-3fcd-4b1a-99fd-f9a43bb22972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0d496559c6b4a759fd4b63852fbdafa'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:01.079602 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-71c2e2d7-3fcd-4b1a-99fd-f9a43bb22972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0d496559c6b4a759fd4b63852fbdafa'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:01.091629 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-71c2e2d7-3fcd-4b1a-99fd-f9a43bb22972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0d496559c6b4a759fd4b63852fbdafa'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:01.099628 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-71c2e2d7-3fcd-4b1a-99fd-f9a43bb22972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0d496559c6b4a759fd4b63852fbdafa'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:01.105633 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1394/2784] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:52:00 2022] DELETE /identity/v3/users/d0d496559c6b4a759fd4b63852fbdafa => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:52:01.540027 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f65c26-011e-4c23-a112-c7fdf0a4ed6a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:01.541576 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-36f65c26-011e-4c23-a112-c7fdf0a4ed6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:01.558949 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f65c26-011e-4c23-a112-c7fdf0a4ed6a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:01.627452 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5478d6-e210-4c31-8794-fe6681c27583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:01.628247 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5478d6-e210-4c31-8794-fe6681c27583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:01.628601 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5478d6-e210-4c31-8794-fe6681c27583 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:01.628960 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5478d6-e210-4c31-8794-fe6681c27583 admin admin] PATH_INFO: `/v3/projects/4da4b7c877af4a4b86b72a116f7e87cd` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:01.630322 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5478d6-e210-4c31-8794-fe6681c27583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da4b7c877af4a4b86b72a116f7e87cd)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:01.632299 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5478d6-e210-4c31-8794-fe6681c27583 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:01.687056 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-1b5478d6-e210-4c31-8794-fe6681c27583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da4b7c877af4a4b86b72a116f7e87cd', 'request_id': 'req-1b5478d6-e210-4c31-8794-fe6681c27583'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:01.695296 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-1b5478d6-e210-4c31-8794-fe6681c27583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da4b7c877af4a4b86b72a116f7e87cd', 'request_id': 'req-1b5478d6-e210-4c31-8794-fe6681c27583'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:01.702247 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-1b5478d6-e210-4c31-8794-fe6681c27583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da4b7c877af4a4b86b72a116f7e87cd', 'request_id': 'req-1b5478d6-e210-4c31-8794-fe6681c27583'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:01.713079 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-1b5478d6-e210-4c31-8794-fe6681c27583 admin admin] The token cache is being invalidate because project 4da4b7c877af4a4b86b72a116f7e87cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:52:01.713459 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-1b5478d6-e210-4c31-8794-fe6681c27583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:01.714165 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-1b5478d6-e210-4c31-8794-fe6681c27583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:01.716002 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1391/2785] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:52:01 2022] DELETE /identity/v3/projects/4da4b7c877af4a4b86b72a116f7e87cd => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:52:01.722086 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568c2fc-5056-4937-8b0b-a3ded895da94 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:01.723453 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568c2fc-5056-4937-8b0b-a3ded895da94 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:01.723883 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568c2fc-5056-4937-8b0b-a3ded895da94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:01.745395 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-7568c2fc-5056-4937-8b0b-a3ded895da94 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:52:01.747037 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-7568c2fc-5056-4937-8b0b-a3ded895da94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:01.821816 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1395/2786] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:52:01.824428 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddf89b-6b42-4f43-8074-f4aa6b330944 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:01.824899 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddf89b-6b42-4f43-8074-f4aa6b330944 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:01.824899 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddf89b-6b42-4f43-8074-f4aa6b330944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:01.847590 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-e2ddf89b-6b42-4f43-8074-f4aa6b330944 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:52:01.849025 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-e2ddf89b-6b42-4f43-8074-f4aa6b330944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:01.857719 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1392/2787] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:52:01.863100 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568c2fc-5056-4937-8b0b-a3ded895da94 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:01.874945 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568c2fc-5056-4937-8b0b-a3ded895da94 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:01.880791 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f85ae-6466-4ae0-a9b6-1b35d1df7a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:01.882626 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f85ae-6466-4ae0-a9b6-1b35d1df7a78 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:01.882912 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f85ae-6466-4ae0-a9b6-1b35d1df7a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:01.883186 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f85ae-6466-4ae0-a9b6-1b35d1df7a78 admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:01.883953 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f85ae-6466-4ae0-a9b6-1b35d1df7a78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:52:01.884410 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f85ae-6466-4ae0-a9b6-1b35d1df7a78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:01.886128 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f85ae-6466-4ae0-a9b6-1b35d1df7a78 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:01.903724 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1396/2788] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:52:01.907835 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddf89b-6b42-4f43-8074-f4aa6b330944 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:01.921721 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddf89b-6b42-4f43-8074-f4aa6b330944 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:01.928047 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce0635-1069-45a9-a886-4fd74a2c05ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:01.929675 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce0635-1069-45a9-a886-4fd74a2c05ae admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:01.930141 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce0635-1069-45a9-a886-4fd74a2c05ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:01.930589 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce0635-1069-45a9-a886-4fd74a2c05ae admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:01.931858 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce0635-1069-45a9-a886-4fd74a2c05ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:01.934358 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce0635-1069-45a9-a886-4fd74a2c05ae admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:01.966848 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1393/2789] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:52:01 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:52:01.972334 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f85ae-6466-4ae0-a9b6-1b35d1df7a78 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:01.993352 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f85ae-6466-4ae0-a9b6-1b35d1df7a78 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:02.066098 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1bf70-ec19-4234-81f7-de4326c2516c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:02.066959 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1bf70-ec19-4234-81f7-de4326c2516c admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:02.067362 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1bf70-ec19-4234-81f7-de4326c2516c admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:02.067736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1bf70-ec19-4234-81f7-de4326c2516c admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:02.068549 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1bf70-ec19-4234-81f7-de4326c2516c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:02.070652 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1bf70-ec19-4234-81f7-de4326c2516c admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:02.098465 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1397/2790] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:52:01 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:52:02.102325 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce0635-1069-45a9-a886-4fd74a2c05ae admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:02.113456 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce0635-1069-45a9-a886-4fd74a2c05ae admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:02.117635 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7a98c-14c0-4ca6-b1cc-1a26d7d2466a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:02.118365 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7a98c-14c0-4ca6-b1cc-1a26d7d2466a admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:02.118716 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7a98c-14c0-4ca6-b1cc-1a26d7d2466a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:02.119082 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7a98c-14c0-4ca6-b1cc-1a26d7d2466a admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:02.119879 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7a98c-14c0-4ca6-b1cc-1a26d7d2466a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:02.121682 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7a98c-14c0-4ca6-b1cc-1a26d7d2466a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:02.133247 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1394/2791] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:52:02.137036 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1bf70-ec19-4234-81f7-de4326c2516c admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:02.150138 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1bf70-ec19-4234-81f7-de4326c2516c admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:02.155356 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4cd2c-3a07-42ad-a156-157cfc31cc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:02.156273 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4cd2c-3a07-42ad-a156-157cfc31cc54 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:02.156568 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4cd2c-3a07-42ad-a156-157cfc31cc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:02.156874 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4cd2c-3a07-42ad-a156-157cfc31cc54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:02.157777 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4cd2c-3a07-42ad-a156-157cfc31cc54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:02.159430 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4cd2c-3a07-42ad-a156-157cfc31cc54 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:02.170333 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1398/2792] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:52:02.174196 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7a98c-14c0-4ca6-b1cc-1a26d7d2466a admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:02.184531 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7a98c-14c0-4ca6-b1cc-1a26d7d2466a admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:02.190515 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce8fc1-5b67-434c-ac8e-008fb689d917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:02.191534 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce8fc1-5b67-434c-ac8e-008fb689d917 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:02.191908 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce8fc1-5b67-434c-ac8e-008fb689d917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:02.192278 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce8fc1-5b67-434c-ac8e-008fb689d917 admin admin] PATH_INFO: `/v3/projects/a225cecbfca840a196dc96873bd92816/users/43ef0b713440424486a0432d8d47d54e/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:02.211335 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce8fc1-5b67-434c-ac8e-008fb689d917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a225cecbfca840a196dc96873bd92816, user_id=43ef0b713440424486a0432d8d47d54e, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:02.214222 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dce8fc1-5b67-434c-ac8e-008fb689d917 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:02.231342 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1395/2793] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:52:02 2022] PUT /identity/v3/projects/a225cecbfca840a196dc96873bd92816/users/43ef0b713440424486a0432d8d47d54e/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:52:02.242071 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c821a-cd86-4b7c-aff2-947611f94e1c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:02.242367 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c821a-cd86-4b7c-aff2-947611f94e1c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:02.242647 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c821a-cd86-4b7c-aff2-947611f94e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:02.271330 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-054c821a-cd86-4b7c-aff2-947611f94e1c None None] MFA Rules not processed for user `43ef0b713440424486a0432d8d47d54e`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:52:02.272725 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-054c821a-cd86-4b7c-aff2-947611f94e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:02.342525 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1399/2794] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:52:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:52:02.347332 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce8fc1-5b67-434c-ac8e-008fb689d917 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:02.413734 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dce8fc1-5b67-434c-ac8e-008fb689d917 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:02.419544 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636e01d-5b4f-4147-bc2e-726893abf3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:02.420346 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636e01d-5b4f-4147-bc2e-726893abf3ed admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:02.420726 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636e01d-5b4f-4147-bc2e-726893abf3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:02.421174 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636e01d-5b4f-4147-bc2e-726893abf3ed admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:02.422003 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636e01d-5b4f-4147-bc2e-726893abf3ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:02.425187 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636e01d-5b4f-4147-bc2e-726893abf3ed admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:02.457557 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1396/2795] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:52:02 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:52:02.461449 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c821a-cd86-4b7c-aff2-947611f94e1c None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:02.474506 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c821a-cd86-4b7c-aff2-947611f94e1c None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:02.536809 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1632246-3048-45f7-9ee9-d6a4f572293e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:02.537935 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1632246-3048-45f7-9ee9-d6a4f572293e admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:02.537935 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1632246-3048-45f7-9ee9-d6a4f572293e admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:02.538386 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1632246-3048-45f7-9ee9-d6a4f572293e admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:02.539934 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1632246-3048-45f7-9ee9-d6a4f572293e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:02.541393 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1632246-3048-45f7-9ee9-d6a4f572293e admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:02.565816 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1400/2796] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:52:02 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:52:02.570011 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636e01d-5b4f-4147-bc2e-726893abf3ed admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:02.586879 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636e01d-5b4f-4147-bc2e-726893abf3ed admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:02.591808 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115caa3c-8ec0-478b-ad54-3b77141aa48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:02.592628 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115caa3c-8ec0-478b-ad54-3b77141aa48f admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:02.593030 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115caa3c-8ec0-478b-ad54-3b77141aa48f admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:02.593435 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115caa3c-8ec0-478b-ad54-3b77141aa48f admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:02.594284 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115caa3c-8ec0-478b-ad54-3b77141aa48f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:02.596067 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115caa3c-8ec0-478b-ad54-3b77141aa48f admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:02.611006 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1397/2797] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:52:02.612303 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1632246-3048-45f7-9ee9-d6a4f572293e admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:02.623221 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1632246-3048-45f7-9ee9-d6a4f572293e admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:02.628476 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6d261-5867-4cf6-a920-ddb623c07f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:02.629614 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6d261-5867-4cf6-a920-ddb623c07f2b admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:02.629761 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6d261-5867-4cf6-a920-ddb623c07f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:02.630027 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6d261-5867-4cf6-a920-ddb623c07f2b admin admin] PATH_INFO: `/v3/projects/5f620e28465b4a83817b500ee2b96108/users/7e8a70921613493fbfe1103736d1663d/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:02.656173 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6d261-5867-4cf6-a920-ddb623c07f2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f620e28465b4a83817b500ee2b96108, user_id=7e8a70921613493fbfe1103736d1663d, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:02.658966 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6d261-5867-4cf6-a920-ddb623c07f2b admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:02.679654 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1401/2798] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:52:02 2022] PUT /identity/v3/projects/5f620e28465b4a83817b500ee2b96108/users/7e8a70921613493fbfe1103736d1663d/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:52:02.684598 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115caa3c-8ec0-478b-ad54-3b77141aa48f admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:02.697753 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115caa3c-8ec0-478b-ad54-3b77141aa48f admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:02.776396 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f525566-d3fb-44b7-9c3e-7f1534bc4f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:02.777245 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f525566-d3fb-44b7-9c3e-7f1534bc4f5e admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:02.777599 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f525566-d3fb-44b7-9c3e-7f1534bc4f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:02.777939 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f525566-d3fb-44b7-9c3e-7f1534bc4f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:02.778751 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f525566-d3fb-44b7-9c3e-7f1534bc4f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:02.780413 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f525566-d3fb-44b7-9c3e-7f1534bc4f5e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:02.790695 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1398/2799] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:52:02.794966 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6d261-5867-4cf6-a920-ddb623c07f2b admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:02.806222 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6d261-5867-4cf6-a920-ddb623c07f2b admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:02.811559 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106257f-e17c-4633-b946-d30b43552ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:02.812520 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106257f-e17c-4633-b946-d30b43552ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:02.812974 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106257f-e17c-4633-b946-d30b43552ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:02.813695 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106257f-e17c-4633-b946-d30b43552ed6 admin admin] PATH_INFO: `/v3/projects/5f620e28465b4a83817b500ee2b96108/users/7e8a70921613493fbfe1103736d1663d/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:02.816652 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1106257f-e17c-4633-b946-d30b43552ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f620e28465b4a83817b500ee2b96108, user_id=7e8a70921613493fbfe1103736d1663d, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:02.819577 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1106257f-e17c-4633-b946-d30b43552ed6 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:02.832052 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1402/2800] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:52:02 2022] PUT /identity/v3/projects/5f620e28465b4a83817b500ee2b96108/users/7e8a70921613493fbfe1103736d1663d/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:52:02.843666 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b52c4-18ae-42e3-a569-6ec4e09f30b0 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:02.844268 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b52c4-18ae-42e3-a569-6ec4e09f30b0 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:02.844268 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b52c4-18ae-42e3-a569-6ec4e09f30b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:02.872482 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-b98b52c4-18ae-42e3-a569-6ec4e09f30b0 None None] MFA Rules not processed for user `7e8a70921613493fbfe1103736d1663d`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:52:02.873780 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-b98b52c4-18ae-42e3-a569-6ec4e09f30b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:02.960400 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1399/2801] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:52:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:52:02.970692 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106257f-e17c-4633-b946-d30b43552ed6 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:02.972566 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-1106257f-e17c-4633-b946-d30b43552ed6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:03.047525 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106257f-e17c-4633-b946-d30b43552ed6 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:03.053168 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633636d-0715-4b88-a25d-26f60295e417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:03.053851 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633636d-0715-4b88-a25d-26f60295e417 service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:03.054140 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633636d-0715-4b88-a25d-26f60295e417 service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:03.054424 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633636d-0715-4b88-a25d-26f60295e417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:03.068539 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633636d-0715-4b88-a25d-26f60295e417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:03.070366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633636d-0715-4b88-a25d-26f60295e417 service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:03.082949 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1403/2802] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:52:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:52:03.169455 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b52c4-18ae-42e3-a569-6ec4e09f30b0 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:03.180715 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b52c4-18ae-42e3-a569-6ec4e09f30b0 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:03.184691 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327b3b7-b88a-4acc-8bc4-bda35f5356c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:03.185444 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327b3b7-b88a-4acc-8bc4-bda35f5356c2 service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:03.185791 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327b3b7-b88a-4acc-8bc4-bda35f5356c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:03.186826 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327b3b7-b88a-4acc-8bc4-bda35f5356c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:03.247108 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327b3b7-b88a-4acc-8bc4-bda35f5356c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:03.248660 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327b3b7-b88a-4acc-8bc4-bda35f5356c2 service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:03.260634 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1400/2803] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:52:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:52:03.560114 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633636d-0715-4b88-a25d-26f60295e417 service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:03.639220 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633636d-0715-4b88-a25d-26f60295e417 service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:03.648438 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222a7ce-9311-416f-a6ea-0df464003581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:03.649720 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222a7ce-9311-416f-a6ea-0df464003581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:03.650011 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222a7ce-9311-416f-a6ea-0df464003581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:03.650288 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222a7ce-9311-416f-a6ea-0df464003581 admin admin] PATH_INFO: `/v3/users/43ef0b713440424486a0432d8d47d54e` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:03.651646 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222a7ce-9311-416f-a6ea-0df464003581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43ef0b713440424486a0432d8d47d54e)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:03.654967 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222a7ce-9311-416f-a6ea-0df464003581 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:03.731474 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c222a7ce-9311-416f-a6ea-0df464003581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43ef0b713440424486a0432d8d47d54e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:03.739397 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c222a7ce-9311-416f-a6ea-0df464003581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43ef0b713440424486a0432d8d47d54e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:03.740329 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c222a7ce-9311-416f-a6ea-0df464003581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43ef0b713440424486a0432d8d47d54e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:03.753411 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c222a7ce-9311-416f-a6ea-0df464003581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43ef0b713440424486a0432d8d47d54e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:03.762061 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-c222a7ce-9311-416f-a6ea-0df464003581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43ef0b713440424486a0432d8d47d54e'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:03.768490 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1404/2804] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:52:03 2022] DELETE /identity/v3/users/43ef0b713440424486a0432d8d47d54e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:52:03.773308 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e2328-d87e-4e0c-98f0-50ad8a9fff70 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:03.773695 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e2328-d87e-4e0c-98f0-50ad8a9fff70 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:03.774071 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e2328-d87e-4e0c-98f0-50ad8a9fff70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:03.791094 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-a68e2328-d87e-4e0c-98f0-50ad8a9fff70 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:52:03.792471 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-a68e2328-d87e-4e0c-98f0-50ad8a9fff70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:03.878428 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1401/2805] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:52:03.890063 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222a7ce-9311-416f-a6ea-0df464003581 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:03.891526 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c222a7ce-9311-416f-a6ea-0df464003581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:03.955010 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222a7ce-9311-416f-a6ea-0df464003581 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:03.958871 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067565b-7b68-4a78-9192-d776b219f365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:03.959510 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067565b-7b68-4a78-9192-d776b219f365 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:03.959803 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067565b-7b68-4a78-9192-d776b219f365 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:03.960085 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067565b-7b68-4a78-9192-d776b219f365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:03.970325 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067565b-7b68-4a78-9192-d776b219f365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:03.972055 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067565b-7b68-4a78-9192-d776b219f365 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:03.982586 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1405/2806] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:52:04.006241 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72115a47-d3dd-4ba4-b6b2-59a876ff371a None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:04.006524 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72115a47-d3dd-4ba4-b6b2-59a876ff371a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:04.006983 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72115a47-d3dd-4ba4-b6b2-59a876ff371a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:04.063976 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-72115a47-d3dd-4ba4-b6b2-59a876ff371a None None] MFA Rules not processed for user `9301ab5eca7a4a978b7b79c0db3632cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:52:04.066121 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-72115a47-d3dd-4ba4-b6b2-59a876ff371a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:04.147777 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1402/2807] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:52:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:52:04.152233 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067565b-7b68-4a78-9192-d776b219f365 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:04.153722 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-f067565b-7b68-4a78-9192-d776b219f365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:04.169270 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067565b-7b68-4a78-9192-d776b219f365 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:04.174167 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837d2e8-b8dd-46b7-8fbe-2e6f3e119ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:04.175678 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837d2e8-b8dd-46b7-8fbe-2e6f3e119ffb admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:04.176028 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837d2e8-b8dd-46b7-8fbe-2e6f3e119ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:04.176366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837d2e8-b8dd-46b7-8fbe-2e6f3e119ffb admin admin] PATH_INFO: `/v3/projects` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:04.177186 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837d2e8-b8dd-46b7-8fbe-2e6f3e119ffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:04.179202 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837d2e8-b8dd-46b7-8fbe-2e6f3e119ffb admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:04.209227 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1406/2808] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:52:04 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:52:04.213371 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72115a47-d3dd-4ba4-b6b2-59a876ff371a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:04.225747 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72115a47-d3dd-4ba4-b6b2-59a876ff371a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:04.302967 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837d2e8-b8dd-46b7-8fbe-2e6f3e119ffb admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:04.305175 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e837d2e8-b8dd-46b7-8fbe-2e6f3e119ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:04.311354 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6625c-31bd-487e-9292-61abe5c55184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:04.312048 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6625c-31bd-487e-9292-61abe5c55184 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:04.312332 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6625c-31bd-487e-9292-61abe5c55184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:04.312608 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6625c-31bd-487e-9292-61abe5c55184 admin admin] PATH_INFO: `/v3/users` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:04.313696 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6625c-31bd-487e-9292-61abe5c55184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:04.315839 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6625c-31bd-487e-9292-61abe5c55184 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:04.319653 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837d2e8-b8dd-46b7-8fbe-2e6f3e119ffb admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:04.324858 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dcbbe-16ac-4a64-9d88-bc168a405acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:04.326376 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dcbbe-16ac-4a64-9d88-bc168a405acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:04.326736 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dcbbe-16ac-4a64-9d88-bc168a405acf admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:04.327403 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dcbbe-16ac-4a64-9d88-bc168a405acf admin admin] PATH_INFO: `/v3/projects/a225cecbfca840a196dc96873bd92816` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:04.329282 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76dcbbe-16ac-4a64-9d88-bc168a405acf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a225cecbfca840a196dc96873bd92816)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:04.331666 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76dcbbe-16ac-4a64-9d88-bc168a405acf admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:04.347479 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1403/2809] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:52:04 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:52:04.351355 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6625c-31bd-487e-9292-61abe5c55184 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:04.364175 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6625c-31bd-487e-9292-61abe5c55184 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:04.369320 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727745d2-3968-4f9d-bf34-116fd8816302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:04.369986 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727745d2-3968-4f9d-bf34-116fd8816302 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:04.370282 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727745d2-3968-4f9d-bf34-116fd8816302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:04.370583 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727745d2-3968-4f9d-bf34-116fd8816302 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:04.371371 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727745d2-3968-4f9d-bf34-116fd8816302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:04.372977 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727745d2-3968-4f9d-bf34-116fd8816302 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:04.384528 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1404/2810] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:52:04.388571 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727745d2-3968-4f9d-bf34-116fd8816302 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:04.395865 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e76dcbbe-16ac-4a64-9d88-bc168a405acf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a225cecbfca840a196dc96873bd92816', 'request_id': 'req-e76dcbbe-16ac-4a64-9d88-bc168a405acf'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:04.398935 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727745d2-3968-4f9d-bf34-116fd8816302 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:04.406031 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e76dcbbe-16ac-4a64-9d88-bc168a405acf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a225cecbfca840a196dc96873bd92816', 'request_id': 'req-e76dcbbe-16ac-4a64-9d88-bc168a405acf'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:04.415561 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e76dcbbe-16ac-4a64-9d88-bc168a405acf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a225cecbfca840a196dc96873bd92816', 'request_id': 'req-e76dcbbe-16ac-4a64-9d88-bc168a405acf'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:04.427747 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e76dcbbe-16ac-4a64-9d88-bc168a405acf admin admin] The token cache is being invalidate because project a225cecbfca840a196dc96873bd92816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79177) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:52:04.428037 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e76dcbbe-16ac-4a64-9d88-bc168a405acf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:04.428718 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-e76dcbbe-16ac-4a64-9d88-bc168a405acf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:04.430534 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1407/2811] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:52:04 2022] DELETE /identity/v3/projects/a225cecbfca840a196dc96873bd92816 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:52:04.434378 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dcbbe-16ac-4a64-9d88-bc168a405acf admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:04.435822 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-e76dcbbe-16ac-4a64-9d88-bc168a405acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:04.470457 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c5c90-44fd-4b7b-9533-ef6239c1b1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:04.472200 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c5c90-44fd-4b7b-9533-ef6239c1b1f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:04.472638 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c5c90-44fd-4b7b-9533-ef6239c1b1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:04.473150 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c5c90-44fd-4b7b-9533-ef6239c1b1f6 admin admin] PATH_INFO: `/v3/projects/9879a86bfcc34631aaed0f23fee45cd8/users/67ca02c5cc4b4bbd8519138de72ad581/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:04.490656 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c5c90-44fd-4b7b-9533-ef6239c1b1f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9879a86bfcc34631aaed0f23fee45cd8, user_id=67ca02c5cc4b4bbd8519138de72ad581, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:04.494241 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c5c90-44fd-4b7b-9533-ef6239c1b1f6 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:04.512226 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1405/2812] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:52:04 2022] PUT /identity/v3/projects/9879a86bfcc34631aaed0f23fee45cd8/users/67ca02c5cc4b4bbd8519138de72ad581/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:52:04.514411 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dcbbe-16ac-4a64-9d88-bc168a405acf admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:04.516049 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c5c90-44fd-4b7b-9533-ef6239c1b1f6 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:04.517760 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-e42c5c90-44fd-4b7b-9533-ef6239c1b1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:04.604046 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7aa2f-f80c-406b-942d-29197e05b8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:04.605220 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7aa2f-f80c-406b-942d-29197e05b8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:04.605617 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7aa2f-f80c-406b-942d-29197e05b8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:04.605967 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7aa2f-f80c-406b-942d-29197e05b8cf admin admin] PATH_INFO: `/v3/users/7e8a70921613493fbfe1103736d1663d` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:04.609673 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7aa2f-f80c-406b-942d-29197e05b8cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e8a70921613493fbfe1103736d1663d)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:04.610543 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c5c90-44fd-4b7b-9533-ef6239c1b1f6 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:04.613152 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7aa2f-f80c-406b-942d-29197e05b8cf admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:04.615985 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f1f6a-62c0-47a6-bcc5-07bacd68076e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:04.616768 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f1f6a-62c0-47a6-bcc5-07bacd68076e admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:04.617151 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f1f6a-62c0-47a6-bcc5-07bacd68076e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:04.617455 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f1f6a-62c0-47a6-bcc5-07bacd68076e admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:04.618336 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f1f6a-62c0-47a6-bcc5-07bacd68076e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:04.620015 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439f1f6a-62c0-47a6-bcc5-07bacd68076e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:04.631241 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1406/2813] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:52:04.635514 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f1f6a-62c0-47a6-bcc5-07bacd68076e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:04.647853 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f1f6a-62c0-47a6-bcc5-07bacd68076e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:04.652692 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64586c-255d-45de-9925-273658f1e903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:04.653578 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64586c-255d-45de-9925-273658f1e903 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:04.653863 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64586c-255d-45de-9925-273658f1e903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:04.654157 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64586c-255d-45de-9925-273658f1e903 admin admin] PATH_INFO: `/v3/projects/9879a86bfcc34631aaed0f23fee45cd8/users/67ca02c5cc4b4bbd8519138de72ad581/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:04.656390 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64586c-255d-45de-9925-273658f1e903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9879a86bfcc34631aaed0f23fee45cd8, user_id=67ca02c5cc4b4bbd8519138de72ad581, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:04.659514 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64586c-255d-45de-9925-273658f1e903 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:04.674356 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1407/2814] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:52:04 2022] PUT /identity/v3/projects/9879a86bfcc34631aaed0f23fee45cd8/users/67ca02c5cc4b4bbd8519138de72ad581/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:52:04.698546 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-32b7aa2f-f80c-406b-942d-29197e05b8cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e8a70921613493fbfe1103736d1663d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:04.709602 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-32b7aa2f-f80c-406b-942d-29197e05b8cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e8a70921613493fbfe1103736d1663d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:04.710344 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-32b7aa2f-f80c-406b-942d-29197e05b8cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e8a70921613493fbfe1103736d1663d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:04.725965 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-32b7aa2f-f80c-406b-942d-29197e05b8cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e8a70921613493fbfe1103736d1663d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:04.736035 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-32b7aa2f-f80c-406b-942d-29197e05b8cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e8a70921613493fbfe1103736d1663d'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:04.743925 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1408/2815] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:52:04 2022] DELETE /identity/v3/users/7e8a70921613493fbfe1103736d1663d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 04:52:05.111594 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64586c-255d-45de-9925-273658f1e903 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:05.113337 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-9f64586c-255d-45de-9925-273658f1e903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:05.219569 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64586c-255d-45de-9925-273658f1e903 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:05.288400 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62dc75-ca60-41fa-90e6-afc665b3ded1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:05.289318 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62dc75-ca60-41fa-90e6-afc665b3ded1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:05.289600 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62dc75-ca60-41fa-90e6-afc665b3ded1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:05.289875 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62dc75-ca60-41fa-90e6-afc665b3ded1 admin admin] PATH_INFO: `/v3/projects/5f620e28465b4a83817b500ee2b96108` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:05.291137 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62dc75-ca60-41fa-90e6-afc665b3ded1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f620e28465b4a83817b500ee2b96108)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:05.293136 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62dc75-ca60-41fa-90e6-afc665b3ded1 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:05.342542 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0a62dc75-ca60-41fa-90e6-afc665b3ded1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f620e28465b4a83817b500ee2b96108', 'request_id': 'req-0a62dc75-ca60-41fa-90e6-afc665b3ded1'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:05.353328 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0a62dc75-ca60-41fa-90e6-afc665b3ded1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f620e28465b4a83817b500ee2b96108', 'request_id': 'req-0a62dc75-ca60-41fa-90e6-afc665b3ded1'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:05.360334 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0a62dc75-ca60-41fa-90e6-afc665b3ded1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f620e28465b4a83817b500ee2b96108', 'request_id': 'req-0a62dc75-ca60-41fa-90e6-afc665b3ded1'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:05.371716 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0a62dc75-ca60-41fa-90e6-afc665b3ded1 admin admin] The token cache is being invalidate because project 5f620e28465b4a83817b500ee2b96108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:52:05.372013 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0a62dc75-ca60-41fa-90e6-afc665b3ded1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:05.373283 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-0a62dc75-ca60-41fa-90e6-afc665b3ded1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:05.374932 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1408/2816] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:52:05 2022] DELETE /identity/v3/projects/5f620e28465b4a83817b500ee2b96108 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:52:05.382349 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f048504-6b57-4cd9-8b05-b4ae3c05aed4 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:05.383162 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f048504-6b57-4cd9-8b05-b4ae3c05aed4 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:05.383162 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f048504-6b57-4cd9-8b05-b4ae3c05aed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:05.404292 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-8f048504-6b57-4cd9-8b05-b4ae3c05aed4 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:52:05.405921 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-8f048504-6b57-4cd9-8b05-b4ae3c05aed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:05.495613 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1409/2817] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:52:05.503743 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c31d2-1aae-46fe-8799-9cc9f363469c None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:05.504029 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c31d2-1aae-46fe-8799-9cc9f363469c None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:05.504316 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c31d2-1aae-46fe-8799-9cc9f363469c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:05.532365 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-205c31d2-1aae-46fe-8799-9cc9f363469c None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:52:05.533658 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-205c31d2-1aae-46fe-8799-9cc9f363469c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:05.547616 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f048504-6b57-4cd9-8b05-b4ae3c05aed4 None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:05.553907 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1409/2818] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:52:05.558874 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f048504-6b57-4cd9-8b05-b4ae3c05aed4 None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:05.564557 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c0cef-4073-4b85-8796-489c966534ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:05.565416 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c0cef-4073-4b85-8796-489c966534ef admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:05.565817 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c0cef-4073-4b85-8796-489c966534ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:05.566195 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c0cef-4073-4b85-8796-489c966534ef admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:05.567224 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c0cef-4073-4b85-8796-489c966534ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:52:05.567626 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c0cef-4073-4b85-8796-489c966534ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:05.569810 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c0cef-4073-4b85-8796-489c966534ef admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:05.586635 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1410/2819] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:52:05.589931 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c31d2-1aae-46fe-8799-9cc9f363469c None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:05.600769 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c31d2-1aae-46fe-8799-9cc9f363469c None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:05.605779 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa11f34-a4d0-4d73-a9b1-99db83299a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:05.606564 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa11f34-a4d0-4d73-a9b1-99db83299a33 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:05.606851 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa11f34-a4d0-4d73-a9b1-99db83299a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:05.607128 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa11f34-a4d0-4d73-a9b1-99db83299a33 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:05.608032 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa11f34-a4d0-4d73-a9b1-99db83299a33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:05.609973 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa11f34-a4d0-4d73-a9b1-99db83299a33 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:05.644124 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1410/2820] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:52:05 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:52:05.648454 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c0cef-4073-4b85-8796-489c966534ef admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:05.658758 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c0cef-4073-4b85-8796-489c966534ef admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:05.721861 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef593084-0fc6-471e-87a6-914cf411b9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:05.722606 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef593084-0fc6-471e-87a6-914cf411b9ec admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:05.723088 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef593084-0fc6-471e-87a6-914cf411b9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:05.723371 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef593084-0fc6-471e-87a6-914cf411b9ec admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:05.724154 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef593084-0fc6-471e-87a6-914cf411b9ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:05.726336 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef593084-0fc6-471e-87a6-914cf411b9ec admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:05.747007 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1411/2821] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:52:05 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:52:05.750905 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa11f34-a4d0-4d73-a9b1-99db83299a33 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:05.762577 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa11f34-a4d0-4d73-a9b1-99db83299a33 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:05.767700 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394baee-2b8f-43cb-b938-2daff837274e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:05.768937 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394baee-2b8f-43cb-b938-2daff837274e admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:05.769253 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394baee-2b8f-43cb-b938-2daff837274e admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:05.769532 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394baee-2b8f-43cb-b938-2daff837274e admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:05.770339 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394baee-2b8f-43cb-b938-2daff837274e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:05.771946 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394baee-2b8f-43cb-b938-2daff837274e admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:05.783086 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1411/2822] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:52:05.787089 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef593084-0fc6-471e-87a6-914cf411b9ec admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:05.798870 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef593084-0fc6-471e-87a6-914cf411b9ec admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:05.804554 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a47b59-a007-47a2-aed3-2e05af04b2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:05.805546 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a47b59-a007-47a2-aed3-2e05af04b2da admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:05.805972 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a47b59-a007-47a2-aed3-2e05af04b2da admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:05.806098 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a47b59-a007-47a2-aed3-2e05af04b2da admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:05.807360 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a47b59-a007-47a2-aed3-2e05af04b2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:05.808662 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a47b59-a007-47a2-aed3-2e05af04b2da admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:05.824068 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394baee-2b8f-43cb-b938-2daff837274e admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:05.824509 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1412/2823] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:52:05.835348 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394baee-2b8f-43cb-b938-2daff837274e admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:05.840583 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1be98-e446-4819-af26-6ea073f08f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:05.841656 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1be98-e446-4819-af26-6ea073f08f24 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:05.842127 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1be98-e446-4819-af26-6ea073f08f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:05.842476 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1be98-e446-4819-af26-6ea073f08f24 admin admin] PATH_INFO: `/v3/projects/7ad7ad396cf0450fa7b42bc7bbabfa05/users/349af00dafca4dd79bdd32ade71afbbe/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:05.862270 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1be98-e446-4819-af26-6ea073f08f24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad7ad396cf0450fa7b42bc7bbabfa05, user_id=349af00dafca4dd79bdd32ade71afbbe, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:05.865616 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1be98-e446-4819-af26-6ea073f08f24 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:05.884718 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1412/2824] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:52:05 2022] PUT /identity/v3/projects/7ad7ad396cf0450fa7b42bc7bbabfa05/users/349af00dafca4dd79bdd32ade71afbbe/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:52:05.896919 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95beb073-386f-4b53-b295-adad99c8de6d None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:05.897309 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95beb073-386f-4b53-b295-adad99c8de6d None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:05.897600 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95beb073-386f-4b53-b295-adad99c8de6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:05.943909 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-95beb073-386f-4b53-b295-adad99c8de6d None None] MFA Rules not processed for user `349af00dafca4dd79bdd32ade71afbbe`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:52:05.945372 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-95beb073-386f-4b53-b295-adad99c8de6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:06.022318 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1413/2825] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:52:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:52:06.034540 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1be98-e446-4819-af26-6ea073f08f24 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:06.036407 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-cbd1be98-e446-4819-af26-6ea073f08f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:06.114777 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1be98-e446-4819-af26-6ea073f08f24 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:06.121081 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd2f57-bbc8-4d76-80b4-7abccf25f976 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:06.122206 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd2f57-bbc8-4d76-80b4-7abccf25f976 service cinder] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:06.122517 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd2f57-bbc8-4d76-80b4-7abccf25f976 service cinder] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:06.122779 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd2f57-bbc8-4d76-80b4-7abccf25f976 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:06.155135 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd2f57-bbc8-4d76-80b4-7abccf25f976 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:06.157486 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd2f57-bbc8-4d76-80b4-7abccf25f976 service cinder] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:06.172234 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1413/2826] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:52:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:52:07.648193 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069d43a-4b00-48e3-a3c8-7dc084dc23c6 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:07.648733 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069d43a-4b00-48e3-a3c8-7dc084dc23c6 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:07.648845 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069d43a-4b00-48e3-a3c8-7dc084dc23c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:07.684547 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-5069d43a-4b00-48e3-a3c8-7dc084dc23c6 None None] MFA Rules not processed for user `349af00dafca4dd79bdd32ade71afbbe`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:52:07.686821 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5069d43a-4b00-48e3-a3c8-7dc084dc23c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:07.702349 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1414/2827] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:52:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:52:08.389785 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd2f57-bbc8-4d76-80b4-7abccf25f976 service cinder] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:08.391800 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-0bcd2f57-bbc8-4d76-80b4-7abccf25f976 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:08.519497 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd2f57-bbc8-4d76-80b4-7abccf25f976 service cinder] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:08.527075 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c15f78-06dc-4595-aa93-9664db3aaad2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add56fc0cfd8403b86c5ef23fd374a5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:08.527971 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c15f78-06dc-4595-aa93-9664db3aaad2 service placement] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:08.528424 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c15f78-06dc-4595-aa93-9664db3aaad2 service placement] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:08.529626 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c15f78-06dc-4595-aa93-9664db3aaad2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:08.531746 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-78c15f78-06dc-4595-aa93-9664db3aaad2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:08.545904 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c15f78-06dc-4595-aa93-9664db3aaad2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:08.555629 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c15f78-06dc-4595-aa93-9664db3aaad2 service placement] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:08.569492 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1414/2828] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:52:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:52:09.450657 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a236da4-18ec-47be-b8ea-506132fc994c None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:09.451227 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a236da4-18ec-47be-b8ea-506132fc994c None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:09.451447 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a236da4-18ec-47be-b8ea-506132fc994c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:09.484464 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-6a236da4-18ec-47be-b8ea-506132fc994c None None] MFA Rules not processed for user `67ca02c5cc4b4bbd8519138de72ad581`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:52:09.485831 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-6a236da4-18ec-47be-b8ea-506132fc994c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:09.556745 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1415/2829] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:52:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 09 04:52:09.570249 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c15f78-06dc-4595-aa93-9664db3aaad2 service placement] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:09.572320 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-78c15f78-06dc-4595-aa93-9664db3aaad2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:09.659873 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c15f78-06dc-4595-aa93-9664db3aaad2 service placement] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:09.665600 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cb3ea-6585-42cd-a534-e211a8a61cb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:09.666506 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cb3ea-6585-42cd-a534-e211a8a61cb1 service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:09.666789 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cb3ea-6585-42cd-a534-e211a8a61cb1 service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:09.667066 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cb3ea-6585-42cd-a534-e211a8a61cb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:09.669437 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-de8cb3ea-6585-42cd-a534-e211a8a61cb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:09.755583 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cb3ea-6585-42cd-a534-e211a8a61cb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:09.761361 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cb3ea-6585-42cd-a534-e211a8a61cb1 service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:09.790559 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1415/2830] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:52:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:52:12.020226 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12011e7-c97c-4d82-85be-909dd3fc756b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:12.020771 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12011e7-c97c-4d82-85be-909dd3fc756b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:12.020771 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12011e7-c97c-4d82-85be-909dd3fc756b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:12.049328 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-b12011e7-c97c-4d82-85be-909dd3fc756b None None] MFA Rules not processed for user `9301ab5eca7a4a978b7b79c0db3632cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:52:12.051228 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b12011e7-c97c-4d82-85be-909dd3fc756b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:12.077421 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1416/2831] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:52:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:52:16.333070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cb3ea-6585-42cd-a534-e211a8a61cb1 service nova] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:16.344174 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cb3ea-6585-42cd-a534-e211a8a61cb1 service nova] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:16.350126 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88b86c-f2c6-46cb-a530-d2b4c95f049b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:16.350756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88b86c-f2c6-46cb-a530-d2b4c95f049b service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:16.351034 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88b86c-f2c6-46cb-a530-d2b4c95f049b service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:16.351307 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88b86c-f2c6-46cb-a530-d2b4c95f049b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:16.353172 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-0c88b86c-f2c6-46cb-a530-d2b4c95f049b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:16.367137 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88b86c-f2c6-46cb-a530-d2b4c95f049b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:16.368715 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88b86c-f2c6-46cb-a530-d2b4c95f049b service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:16.379855 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1416/2832] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:52:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:52:22.875585 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36bf24-7103-4433-96ae-c546ee958f51 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:22.876060 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36bf24-7103-4433-96ae-c546ee958f51 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:22.876155 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36bf24-7103-4433-96ae-c546ee958f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:22.894885 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-5a36bf24-7103-4433-96ae-c546ee958f51 None None] MFA Rules not processed for user `98a27dbe620c4aff967363a7d48c46e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:52:22.896094 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5a36bf24-7103-4433-96ae-c546ee958f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:22.949457 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1417/2833] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Feb 9 04:52:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:52:22.996186 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88b86c-f2c6-46cb-a530-d2b4c95f049b service nova] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:22.997593 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-0c88b86c-f2c6-46cb-a530-d2b4c95f049b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:23.062496 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88b86c-f2c6-46cb-a530-d2b4c95f049b service nova] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:23.067863 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a4c4f-b8ff-452f-aa4a-ba0a449a9b8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66fd482451f743cdb692677e57508764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:23.068617 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a4c4f-b8ff-452f-aa4a-ba0a449a9b8d service swift] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:23.068899 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a4c4f-b8ff-452f-aa4a-ba0a449a9b8d service swift] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:23.069206 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a4c4f-b8ff-452f-aa4a-ba0a449a9b8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:23.076893 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a4c4f-b8ff-452f-aa4a-ba0a449a9b8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:23.078479 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a4c4f-b8ff-452f-aa4a-ba0a449a9b8d service swift] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:23.086786 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1417/2834] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Feb 9 04:52:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:52:23.591547 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4852ce8-db43-4c65-91b8-913a013443e2 None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:23.591834 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4852ce8-db43-4c65-91b8-913a013443e2 None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:23.592106 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4852ce8-db43-4c65-91b8-913a013443e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:23.609295 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-d4852ce8-db43-4c65-91b8-913a013443e2 None None] MFA Rules not processed for user `98a27dbe620c4aff967363a7d48c46e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:52:23.610504 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-d4852ce8-db43-4c65-91b8-913a013443e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:23.618427 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1418/2835] 10.222.0.36 () {58 vars in 967 bytes} [Wed Feb 9 04:52:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:52:23.631005 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a4c4f-b8ff-452f-aa4a-ba0a449a9b8d service swift] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:23.641859 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a4c4f-b8ff-452f-aa4a-ba0a449a9b8d service swift] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:23.646851 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5232d-8cbb-49f5-9af9-ddf57d08eb15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66fd482451f743cdb692677e57508764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:23.647476 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5232d-8cbb-49f5-9af9-ddf57d08eb15 service swift] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:23.647761 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5232d-8cbb-49f5-9af9-ddf57d08eb15 service swift] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:23.648039 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5232d-8cbb-49f5-9af9-ddf57d08eb15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:23.655885 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5232d-8cbb-49f5-9af9-ddf57d08eb15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:23.657476 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5232d-8cbb-49f5-9af9-ddf57d08eb15 service swift] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:23.665756 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1418/2836] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Feb 9 04:52:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 09 04:52:23.853674 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdc667-5df2-4fee-b7d7-d693b0edc82b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:23.853964 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdc667-5df2-4fee-b7d7-d693b0edc82b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:23.854238 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffdc667-5df2-4fee-b7d7-d693b0edc82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:23.872805 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-cffdc667-5df2-4fee-b7d7-d693b0edc82b None None] MFA Rules not processed for user `98a27dbe620c4aff967363a7d48c46e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:52:23.874046 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-cffdc667-5df2-4fee-b7d7-d693b0edc82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:23.881861 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1419/2837] 10.222.0.36 () {58 vars in 1009 bytes} [Wed Feb 9 04:52:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:52:23.893616 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5232d-8cbb-49f5-9af9-ddf57d08eb15 service swift] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:23.903903 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5232d-8cbb-49f5-9af9-ddf57d08eb15 service swift] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:23.909527 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0ae67-09ad-4a13-991b-03b4ed0ba9a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66fd482451f743cdb692677e57508764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:23.910158 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0ae67-09ad-4a13-991b-03b4ed0ba9a6 service swift] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:23.910435 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0ae67-09ad-4a13-991b-03b4ed0ba9a6 service swift] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:23.910704 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0ae67-09ad-4a13-991b-03b4ed0ba9a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:23.918573 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0ae67-09ad-4a13-991b-03b4ed0ba9a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:23.920118 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0ae67-09ad-4a13-991b-03b4ed0ba9a6 service swift] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:23.928392 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1419/2838] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Feb 9 04:52:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:52:24.240249 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640ae25-0d7f-4dcd-ae46-ee5c3bcf21ac None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:24.240625 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640ae25-0d7f-4dcd-ae46-ee5c3bcf21ac None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:24.240964 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640ae25-0d7f-4dcd-ae46-ee5c3bcf21ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:24.259221 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-b640ae25-0d7f-4dcd-ae46-ee5c3bcf21ac None None] MFA Rules not processed for user `98a27dbe620c4aff967363a7d48c46e6`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:52:24.260412 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-b640ae25-0d7f-4dcd-ae46-ee5c3bcf21ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:24.267707 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1420/2839] 10.222.0.36 () {58 vars in 967 bytes} [Wed Feb 9 04:52:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:52:24.279833 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0ae67-09ad-4a13-991b-03b4ed0ba9a6 service swift] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:24.291066 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0ae67-09ad-4a13-991b-03b4ed0ba9a6 service swift] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:24.296083 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c212e2-f7bb-48e2-9195-a2d2ae24bee5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66fd482451f743cdb692677e57508764', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:24.296701 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c212e2-f7bb-48e2-9195-a2d2ae24bee5 service swift] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:24.296981 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c212e2-f7bb-48e2-9195-a2d2ae24bee5 service swift] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:24.297279 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c212e2-f7bb-48e2-9195-a2d2ae24bee5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:24.305222 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c212e2-f7bb-48e2-9195-a2d2ae24bee5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:24.306788 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c212e2-f7bb-48e2-9195-a2d2ae24bee5 service swift] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:24.314633 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1420/2840] 10.222.0.36 () {60 vars in 1384 bytes} [Wed Feb 9 04:52:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 09 04:52:26.303070 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640ae25-0d7f-4dcd-ae46-ee5c3bcf21ac None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:26.362874 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640ae25-0d7f-4dcd-ae46-ee5c3bcf21ac None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:26.367243 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9c3be-6ac2-4103-9abb-6747a3a9f1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:26.368090 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9c3be-6ac2-4103-9abb-6747a3a9f1fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:26.368366 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9c3be-6ac2-4103-9abb-6747a3a9f1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:26.368636 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9c3be-6ac2-4103-9abb-6747a3a9f1fe admin admin] PATH_INFO: `/v3/users/349af00dafca4dd79bdd32ade71afbbe` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:26.369845 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9c3be-6ac2-4103-9abb-6747a3a9f1fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=349af00dafca4dd79bdd32ade71afbbe)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:26.371759 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9c3be-6ac2-4103-9abb-6747a3a9f1fe admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:26.415392 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-16d9c3be-6ac2-4103-9abb-6747a3a9f1fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '349af00dafca4dd79bdd32ade71afbbe'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:26.421934 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-16d9c3be-6ac2-4103-9abb-6747a3a9f1fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '349af00dafca4dd79bdd32ade71afbbe'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:26.422649 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-16d9c3be-6ac2-4103-9abb-6747a3a9f1fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '349af00dafca4dd79bdd32ade71afbbe'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:26.434115 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-16d9c3be-6ac2-4103-9abb-6747a3a9f1fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '349af00dafca4dd79bdd32ade71afbbe'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:26.442205 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-16d9c3be-6ac2-4103-9abb-6747a3a9f1fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '349af00dafca4dd79bdd32ade71afbbe'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:26.447893 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1421/2841] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:52:26 2022] DELETE /identity/v3/users/349af00dafca4dd79bdd32ade71afbbe => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:52:26.452485 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b47f4-fe40-437b-9958-b1092dc04d36 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:26.452958 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b47f4-fe40-437b-9958-b1092dc04d36 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:26.453096 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b47f4-fe40-437b-9958-b1092dc04d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:26.471619 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-548b47f4-fe40-437b-9958-b1092dc04d36 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:52:26.472812 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-548b47f4-fe40-437b-9958-b1092dc04d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:26.532606 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1421/2842] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:52:26.542804 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9c3be-6ac2-4103-9abb-6747a3a9f1fe admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:26.544652 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-16d9c3be-6ac2-4103-9abb-6747a3a9f1fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:26.599592 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9c3be-6ac2-4103-9abb-6747a3a9f1fe admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:26.603252 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01457a6a-6b59-4b4b-afb4-3692a9b12a47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:26.603889 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01457a6a-6b59-4b4b-afb4-3692a9b12a47 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:26.604172 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01457a6a-6b59-4b4b-afb4-3692a9b12a47 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:26.604447 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01457a6a-6b59-4b4b-afb4-3692a9b12a47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:26.613278 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01457a6a-6b59-4b4b-afb4-3692a9b12a47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:26.614655 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01457a6a-6b59-4b4b-afb4-3692a9b12a47 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:26.623806 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1422/2843] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:52:26.791924 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b47f4-fe40-437b-9958-b1092dc04d36 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:26.793748 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-548b47f4-fe40-437b-9958-b1092dc04d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:26.805606 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b47f4-fe40-437b-9958-b1092dc04d36 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:26.810207 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad9fed-ed9a-4d1f-8317-923e52213c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:26.811059 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad9fed-ed9a-4d1f-8317-923e52213c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:26.811342 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad9fed-ed9a-4d1f-8317-923e52213c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:26.811619 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad9fed-ed9a-4d1f-8317-923e52213c54 admin admin] PATH_INFO: `/v3/projects/7ad7ad396cf0450fa7b42bc7bbabfa05` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:26.812811 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad9fed-ed9a-4d1f-8317-923e52213c54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad7ad396cf0450fa7b42bc7bbabfa05)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:26.815371 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad9fed-ed9a-4d1f-8317-923e52213c54 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:26.859763 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-31ad9fed-ed9a-4d1f-8317-923e52213c54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad7ad396cf0450fa7b42bc7bbabfa05', 'request_id': 'req-31ad9fed-ed9a-4d1f-8317-923e52213c54'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:26.866446 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-31ad9fed-ed9a-4d1f-8317-923e52213c54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad7ad396cf0450fa7b42bc7bbabfa05', 'request_id': 'req-31ad9fed-ed9a-4d1f-8317-923e52213c54'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:26.872505 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-31ad9fed-ed9a-4d1f-8317-923e52213c54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad7ad396cf0450fa7b42bc7bbabfa05', 'request_id': 'req-31ad9fed-ed9a-4d1f-8317-923e52213c54'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:26.884110 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-31ad9fed-ed9a-4d1f-8317-923e52213c54 admin admin] The token cache is being invalidate because project 7ad7ad396cf0450fa7b42bc7bbabfa05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:52:26.884395 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-31ad9fed-ed9a-4d1f-8317-923e52213c54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:26.885055 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-31ad9fed-ed9a-4d1f-8317-923e52213c54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:52:26.886886 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1422/2844] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:52:26 2022] DELETE /identity/v3/projects/7ad7ad396cf0450fa7b42bc7bbabfa05 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:52:26.892494 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e113936-843a-4666-8610-c63e10f2d66b None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:26.892905 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e113936-843a-4666-8610-c63e10f2d66b None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:26.893762 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e113936-843a-4666-8610-c63e10f2d66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:26.911558 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-0e113936-843a-4666-8610-c63e10f2d66b None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:52:26.912741 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0e113936-843a-4666-8610-c63e10f2d66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:26.968639 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1423/2845] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:52:26.977128 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f29210-2259-4e95-82cb-ab2a857f3f32 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:26.977415 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f29210-2259-4e95-82cb-ab2a857f3f32 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:26.977687 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f29210-2259-4e95-82cb-ab2a857f3f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:26.995631 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-02f29210-2259-4e95-82cb-ab2a857f3f32 None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:52:26.996801 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-02f29210-2259-4e95-82cb-ab2a857f3f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:27.005068 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1423/2846] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:52:27.009233 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e113936-843a-4666-8610-c63e10f2d66b None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:27.018665 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e113936-843a-4666-8610-c63e10f2d66b None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:27.023212 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334e415-0c28-4bfe-a1e3-3d79968c894d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:27.023857 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334e415-0c28-4bfe-a1e3-3d79968c894d admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:27.024139 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334e415-0c28-4bfe-a1e3-3d79968c894d admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:27.024442 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334e415-0c28-4bfe-a1e3-3d79968c894d admin admin] PATH_INFO: `/v3/domains` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:27.025225 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334e415-0c28-4bfe-a1e3-3d79968c894d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79177) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 09 04:52:27.025535 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334e415-0c28-4bfe-a1e3-3d79968c894d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:27.027144 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334e415-0c28-4bfe-a1e3-3d79968c894d admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:27.038376 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1424/2847] 10.222.0.36 () {58 vars in 1152 bytes} [Wed Feb 9 04:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 09 04:52:27.042535 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f29210-2259-4e95-82cb-ab2a857f3f32 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:27.052270 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f29210-2259-4e95-82cb-ab2a857f3f32 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:27.056736 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37044a67-0da9-407a-8a88-2542c368f078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:27.057392 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37044a67-0da9-407a-8a88-2542c368f078 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:27.057670 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37044a67-0da9-407a-8a88-2542c368f078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:27.057940 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37044a67-0da9-407a-8a88-2542c368f078 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:27.058635 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37044a67-0da9-407a-8a88-2542c368f078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:27.060523 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37044a67-0da9-407a-8a88-2542c368f078 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:27.085209 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1424/2848] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:52:27 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:52:27.089153 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334e415-0c28-4bfe-a1e3-3d79968c894d admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:27.098841 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334e415-0c28-4bfe-a1e3-3d79968c894d admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:27.154471 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884922a-4b17-433a-8d07-5065bb9d67be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:27.155148 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884922a-4b17-433a-8d07-5065bb9d67be admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:27.155434 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884922a-4b17-433a-8d07-5065bb9d67be admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:27.155710 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884922a-4b17-433a-8d07-5065bb9d67be admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:27.156415 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884922a-4b17-433a-8d07-5065bb9d67be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:27.158435 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884922a-4b17-433a-8d07-5065bb9d67be admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:27.182229 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1425/2849] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:52:27 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:52:27.186074 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37044a67-0da9-407a-8a88-2542c368f078 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:27.196866 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37044a67-0da9-407a-8a88-2542c368f078 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:27.201602 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95129895-f9e3-422e-9c45-0c8a5b2b27ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:27.202256 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95129895-f9e3-422e-9c45-0c8a5b2b27ea admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:27.202534 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95129895-f9e3-422e-9c45-0c8a5b2b27ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:27.202806 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95129895-f9e3-422e-9c45-0c8a5b2b27ea admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:27.203565 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95129895-f9e3-422e-9c45-0c8a5b2b27ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:27.205747 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95129895-f9e3-422e-9c45-0c8a5b2b27ea admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:27.217039 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1425/2850] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:52:27.220767 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884922a-4b17-433a-8d07-5065bb9d67be admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:27.230855 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884922a-4b17-433a-8d07-5065bb9d67be admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:27.235814 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d101f-7355-4e65-9ec9-082f4e20ea15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:27.237054 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d101f-7355-4e65-9ec9-082f4e20ea15 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:27.237569 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d101f-7355-4e65-9ec9-082f4e20ea15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:27.238085 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d101f-7355-4e65-9ec9-082f4e20ea15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:27.239234 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d101f-7355-4e65-9ec9-082f4e20ea15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:27.241114 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294d101f-7355-4e65-9ec9-082f4e20ea15 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:27.253033 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1426/2851] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:52:27.257126 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95129895-f9e3-422e-9c45-0c8a5b2b27ea admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:27.267290 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95129895-f9e3-422e-9c45-0c8a5b2b27ea admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:27.271822 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e4f44-0402-482f-bf60-59a409223166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:27.272685 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e4f44-0402-482f-bf60-59a409223166 admin admin] REQUEST_METHOD: `PUT` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:27.272963 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e4f44-0402-482f-bf60-59a409223166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:27.273271 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e4f44-0402-482f-bf60-59a409223166 admin admin] PATH_INFO: `/v3/projects/e74b6e2144f542a78fbb5aa5e310fa1f/users/83ae0a819660449989b794128ad81503/roles/102f883957d846419d33ce22fdec0cce` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:27.287451 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e4f44-0402-482f-bf60-59a409223166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e74b6e2144f542a78fbb5aa5e310fa1f, user_id=83ae0a819660449989b794128ad81503, role_id=102f883957d846419d33ce22fdec0cce)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:27.290128 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e4f44-0402-482f-bf60-59a409223166 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:27.302916 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1426/2852] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:52:27 2022] PUT /identity/v3/projects/e74b6e2144f542a78fbb5aa5e310fa1f/users/83ae0a819660449989b794128ad81503/roles/102f883957d846419d33ce22fdec0cce => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:52:27.308012 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02528930-f9a6-4390-9219-43f1eb53c92f None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:27.308468 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02528930-f9a6-4390-9219-43f1eb53c92f None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:27.308586 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02528930-f9a6-4390-9219-43f1eb53c92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:27.326326 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-02528930-f9a6-4390-9219-43f1eb53c92f None None] MFA Rules not processed for user `149f2cba29a24507ab7090c3c8fa1691`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:52:27.327518 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-02528930-f9a6-4390-9219-43f1eb53c92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:27.385641 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1427/2853] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:52:27.395229 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e4f44-0402-482f-bf60-59a409223166 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:27.396849 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-9e9e4f44-0402-482f-bf60-59a409223166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:27.450977 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e4f44-0402-482f-bf60-59a409223166 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:27.454638 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf947742-98d9-44a5-ad04-368d4240f507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:27.455309 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf947742-98d9-44a5-ad04-368d4240f507 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:27.455581 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf947742-98d9-44a5-ad04-368d4240f507 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:27.455858 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf947742-98d9-44a5-ad04-368d4240f507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:27.465125 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf947742-98d9-44a5-ad04-368d4240f507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:27.466582 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf947742-98d9-44a5-ad04-368d4240f507 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:27.477125 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1427/2854] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:52:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:52:31.369815 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021f755-cc9e-47d0-bc8b-0cee69cdf38e None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:31.370705 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021f755-cc9e-47d0-bc8b-0cee69cdf38e None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:31.371256 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2021f755-cc9e-47d0-bc8b-0cee69cdf38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:31.405964 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-2021f755-cc9e-47d0-bc8b-0cee69cdf38e None None] MFA Rules not processed for user `83ae0a819660449989b794128ad81503`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:52:31.407200 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-2021f755-cc9e-47d0-bc8b-0cee69cdf38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:31.479543 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1428/2855] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:52:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:52:31.483977 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf947742-98d9-44a5-ad04-368d4240f507 service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:31.494199 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf947742-98d9-44a5-ad04-368d4240f507 service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:31.498907 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d2f02-1ac9-4c6e-855b-8302b16c09c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:31.499693 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d2f02-1ac9-4c6e-855b-8302b16c09c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:31.500156 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d2f02-1ac9-4c6e-855b-8302b16c09c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:31.500612 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d2f02-1ac9-4c6e-855b-8302b16c09c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:31.501558 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d2f02-1ac9-4c6e-855b-8302b16c09c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:31.504009 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d2f02-1ac9-4c6e-855b-8302b16c09c8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:31.533878 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1428/2856] 10.222.0.36 () {60 vars in 1152 bytes} [Wed Feb 9 04:52:31 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 09 04:52:31.537947 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021f755-cc9e-47d0-bc8b-0cee69cdf38e None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:31.551199 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2021f755-cc9e-47d0-bc8b-0cee69cdf38e None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:31.635673 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834c39f-6b25-4357-92a6-c845e1db2ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:31.636357 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834c39f-6b25-4357-92a6-c845e1db2ece admin admin] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:31.636641 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834c39f-6b25-4357-92a6-c845e1db2ece admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:31.636989 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834c39f-6b25-4357-92a6-c845e1db2ece admin admin] PATH_INFO: `/v3/users` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:31.637947 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834c39f-6b25-4357-92a6-c845e1db2ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:31.641146 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834c39f-6b25-4357-92a6-c845e1db2ece admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:31.667501 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1429/2857] 10.222.0.36 () {60 vars in 1143 bytes} [Wed Feb 9 04:52:31 2022] POST /identity/v3/users => generated 295 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 09 04:52:31.671650 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d2f02-1ac9-4c6e-855b-8302b16c09c8 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:31.684211 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d2f02-1ac9-4c6e-855b-8302b16c09c8 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:31.688927 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c07d5d-207d-4eb5-8b75-e3ca39974304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:31.690380 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c07d5d-207d-4eb5-8b75-e3ca39974304 admin admin] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:31.690856 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c07d5d-207d-4eb5-8b75-e3ca39974304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:31.691113 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c07d5d-207d-4eb5-8b75-e3ca39974304 admin admin] PATH_INFO: `/v3/roles` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:31.692058 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c07d5d-207d-4eb5-8b75-e3ca39974304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:31.693685 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c07d5d-207d-4eb5-8b75-e3ca39974304 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:31.704949 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1429/2858] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 09 04:52:31.709155 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834c39f-6b25-4357-92a6-c845e1db2ece admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:31.720924 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834c39f-6b25-4357-92a6-c845e1db2ece admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:31.726499 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f226bb8-52d2-49ea-9f4e-ddcc09eb92c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:31.727470 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f226bb8-52d2-49ea-9f4e-ddcc09eb92c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:31.727810 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f226bb8-52d2-49ea-9f4e-ddcc09eb92c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:31.728150 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f226bb8-52d2-49ea-9f4e-ddcc09eb92c7 admin admin] PATH_INFO: `/v3/projects/b6b8aa1ffe054408b2806635cdb5b511/users/c125a17909574c35ae457a895efebfb6/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:31.749972 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f226bb8-52d2-49ea-9f4e-ddcc09eb92c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b8aa1ffe054408b2806635cdb5b511, user_id=c125a17909574c35ae457a895efebfb6, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:31.753439 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f226bb8-52d2-49ea-9f4e-ddcc09eb92c7 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:31.762857 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c07d5d-207d-4eb5-8b75-e3ca39974304 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:31.769436 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1430/2859] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:52:31 2022] PUT /identity/v3/projects/b6b8aa1ffe054408b2806635cdb5b511/users/c125a17909574c35ae457a895efebfb6/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:52:31.773243 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f226bb8-52d2-49ea-9f4e-ddcc09eb92c7 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:31.823436 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c07d5d-207d-4eb5-8b75-e3ca39974304 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:31.840706 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f226bb8-52d2-49ea-9f4e-ddcc09eb92c7 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:31.845673 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441ee22-9d14-44f0-a837-a46349a70303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:31.846283 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441ee22-9d14-44f0-a837-a46349a70303 admin admin] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:31.846565 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441ee22-9d14-44f0-a837-a46349a70303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:31.846842 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441ee22-9d14-44f0-a837-a46349a70303 admin admin] PATH_INFO: `/v3/roles` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:31.847617 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441ee22-9d14-44f0-a837-a46349a70303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:31.849269 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441ee22-9d14-44f0-a837-a46349a70303 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:31.863073 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1431/2860] 10.222.0.36 () {58 vars in 1121 bytes} [Wed Feb 9 04:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 09 04:52:31.867890 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441ee22-9d14-44f0-a837-a46349a70303 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:31.875303 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1831c177-4642-479e-9f80-ac38c9e5c979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:31.875941 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831c177-4642-479e-9f80-ac38c9e5c979 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:31.876221 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831c177-4642-479e-9f80-ac38c9e5c979 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:31.876529 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1831c177-4642-479e-9f80-ac38c9e5c979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:31.878776 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441ee22-9d14-44f0-a837-a46349a70303 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:31.878916 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-1831c177-4642-479e-9f80-ac38c9e5c979 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:31.883711 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54f43a-3b2e-4981-8a04-9f814cf152ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:31.884598 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54f43a-3b2e-4981-8a04-9f814cf152ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:31.884889 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54f43a-3b2e-4981-8a04-9f814cf152ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:31.885186 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54f43a-3b2e-4981-8a04-9f814cf152ce admin admin] PATH_INFO: `/v3/projects/b6b8aa1ffe054408b2806635cdb5b511/users/c125a17909574c35ae457a895efebfb6/roles/05ca9a16ef2a450b8cc73ade47f5c7d0` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:31.887223 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54f43a-3b2e-4981-8a04-9f814cf152ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b8aa1ffe054408b2806635cdb5b511, user_id=c125a17909574c35ae457a895efebfb6, role_id=05ca9a16ef2a450b8cc73ade47f5c7d0)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:31.889449 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831c177-4642-479e-9f80-ac38c9e5c979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:31.889952 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54f43a-3b2e-4981-8a04-9f814cf152ce admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:31.890877 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1831c177-4642-479e-9f80-ac38c9e5c979 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:31.899565 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1430/2861] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:52:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:52:31.902582 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1432/2862] 10.222.0.36 () {60 vars in 1482 bytes} [Wed Feb 9 04:52:31 2022] PUT /identity/v3/projects/b6b8aa1ffe054408b2806635cdb5b511/users/c125a17909574c35ae457a895efebfb6/roles/05ca9a16ef2a450b8cc73ade47f5c7d0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:52:38.024243 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164d28d-3fe0-4170-a976-b64fb0da0bd6 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:38.024825 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164d28d-3fe0-4170-a976-b64fb0da0bd6 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:38.024825 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164d28d-3fe0-4170-a976-b64fb0da0bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:38.053753 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-b164d28d-3fe0-4170-a976-b64fb0da0bd6 None None] MFA Rules not processed for user `c125a17909574c35ae457a895efebfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:52:38.054990 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-b164d28d-3fe0-4170-a976-b64fb0da0bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:38.122590 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1431/2863] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:52:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:52:38.136672 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54f43a-3b2e-4981-8a04-9f814cf152ce admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:38.138584 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-5d54f43a-3b2e-4981-8a04-9f814cf152ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:38.232216 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54f43a-3b2e-4981-8a04-9f814cf152ce admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:38.239411 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b0dba-a102-42c6-b70b-bb458945f2cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:38.240755 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b0dba-a102-42c6-b70b-bb458945f2cd service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:38.241065 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b0dba-a102-42c6-b70b-bb458945f2cd service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:38.241339 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b0dba-a102-42c6-b70b-bb458945f2cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:38.299050 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b0dba-a102-42c6-b70b-bb458945f2cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:38.300664 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b0dba-a102-42c6-b70b-bb458945f2cd service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:38.310525 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1433/2864] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:52:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:52:49.650213 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164d28d-3fe0-4170-a976-b64fb0da0bd6 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:52:49.651633 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-b164d28d-3fe0-4170-a976-b64fb0da0bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:49.713867 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164d28d-3fe0-4170-a976-b64fb0da0bd6 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:52:49.717351 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcc3ae-2cc2-46e8-8f15-b10a161f0cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:52:49.717978 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcc3ae-2cc2-46e8-8f15-b10a161f0cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:52:49.718259 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcc3ae-2cc2-46e8-8f15-b10a161f0cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:52:49.718537 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcc3ae-2cc2-46e8-8f15-b10a161f0cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:52:49.720247 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-4bbcc3ae-2cc2-46e8-8f15-b10a161f0cc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:52:49.779390 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcc3ae-2cc2-46e8-8f15-b10a161f0cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:52:49.780793 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcc3ae-2cc2-46e8-8f15-b10a161f0cc1 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:52:49.790634 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1432/2865] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:52:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:53:01.134122 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf481c4-add7-430a-a5a9-5d48683168ec None None] REQUEST_METHOD: `POST` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:53:01.134627 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf481c4-add7-430a-a5a9-5d48683168ec None None] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:53:01.134733 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf481c4-add7-430a-a5a9-5d48683168ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:53:01.152199 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.auth.core [None req-cdf481c4-add7-430a-a5a9-5d48683168ec None None] MFA Rules not processed for user `83ae0a819660449989b794128ad81503`. Rule list: `[]` (Enabled: `True`). {{(pid=79177) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:53:01.153426 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-cdf481c4-add7-430a-a5a9-5d48683168ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:53:01.175346 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1434/2866] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:53:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:53:01.476833 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcc3ae-2cc2-46e8-8f15-b10a161f0cc1 service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:53:01.512508 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcc3ae-2cc2-46e8-8f15-b10a161f0cc1 service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:53:01.516241 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd2d3d-2a48-431e-85b2-6cd0c199345e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:53:01.516872 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd2d3d-2a48-431e-85b2-6cd0c199345e service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:53:01.517187 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd2d3d-2a48-431e-85b2-6cd0c199345e service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:53:01.517491 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dd2d3d-2a48-431e-85b2-6cd0c199345e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:53:01.519242 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-96dd2d3d-2a48-431e-85b2-6cd0c199345e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:53:01.539681 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd2d3d-2a48-431e-85b2-6cd0c199345e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:53:01.541064 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dd2d3d-2a48-431e-85b2-6cd0c199345e service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:53:01.549154 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1433/2867] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:53:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:53:17.374872 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf481c4-add7-430a-a5a9-5d48683168ec None None] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:53:17.384727 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf481c4-add7-430a-a5a9-5d48683168ec None None] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:53:17.388213 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26342ad-358f-405a-b669-77b86c5b6edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:53:17.388846 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26342ad-358f-405a-b669-77b86c5b6edc service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:53:17.389160 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26342ad-358f-405a-b669-77b86c5b6edc service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:53:17.389434 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26342ad-358f-405a-b669-77b86c5b6edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:53:17.404478 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26342ad-358f-405a-b669-77b86c5b6edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:53:17.405933 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26342ad-358f-405a-b669-77b86c5b6edc service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:53:17.415482 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1435/2868] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:53:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:53:29.170798 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd2d3d-2a48-431e-85b2-6cd0c199345e service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:53:29.172206 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-96dd2d3d-2a48-431e-85b2-6cd0c199345e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:53:29.257673 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dd2d3d-2a48-431e-85b2-6cd0c199345e service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:53:29.262910 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab2dea-fc75-4818-91cd-6f4c4558a7fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add56fc0cfd8403b86c5ef23fd374a5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:53:29.263538 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab2dea-fc75-4818-91cd-6f4c4558a7fc service placement] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:53:29.263817 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab2dea-fc75-4818-91cd-6f4c4558a7fc service placement] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:53:29.264092 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab2dea-fc75-4818-91cd-6f4c4558a7fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:53:29.265869 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-95ab2dea-fc75-4818-91cd-6f4c4558a7fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:53:29.277527 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab2dea-fc75-4818-91cd-6f4c4558a7fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:53:29.279111 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab2dea-fc75-4818-91cd-6f4c4558a7fc service placement] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:53:29.288541 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1434/2869] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:53:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:55:06.447621 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26342ad-358f-405a-b669-77b86c5b6edc service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:55:06.456644 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26342ad-358f-405a-b669-77b86c5b6edc service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:55:06.460177 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935a16c-ccbe-400d-aff0-a90d2ea40d2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:55:06.460797 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935a16c-ccbe-400d-aff0-a90d2ea40d2b service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:55:06.461113 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935a16c-ccbe-400d-aff0-a90d2ea40d2b service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:55:06.461390 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935a16c-ccbe-400d-aff0-a90d2ea40d2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:55:06.463134 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a935a16c-ccbe-400d-aff0-a90d2ea40d2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:55:06.494488 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935a16c-ccbe-400d-aff0-a90d2ea40d2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:55:06.496460 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935a16c-ccbe-400d-aff0-a90d2ea40d2b service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:55:06.516809 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1436/2870] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:55:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:55:07.692377 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab2dea-fc75-4818-91cd-6f4c4558a7fc service placement] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:55:07.702089 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab2dea-fc75-4818-91cd-6f4c4558a7fc service placement] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:55:07.705611 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0145af17-1a07-4ce8-be27-1efcd67ab041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:55:07.706231 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145af17-1a07-4ce8-be27-1efcd67ab041 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:55:07.706510 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145af17-1a07-4ce8-be27-1efcd67ab041 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:55:07.706784 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145af17-1a07-4ce8-be27-1efcd67ab041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:55:07.708483 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-0145af17-1a07-4ce8-be27-1efcd67ab041 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:55:07.722650 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145af17-1a07-4ce8-be27-1efcd67ab041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:55:07.724070 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0145af17-1a07-4ce8-be27-1efcd67ab041 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:55:07.734958 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1435/2871] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:55:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:55:19.672197 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935a16c-ccbe-400d-aff0-a90d2ea40d2b service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:55:19.680840 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935a16c-ccbe-400d-aff0-a90d2ea40d2b service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:55:19.685138 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d7661-576f-4612-90fc-658017a95aaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:55:19.685848 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d7661-576f-4612-90fc-658017a95aaa service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:55:19.686200 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d7661-576f-4612-90fc-658017a95aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:55:19.686544 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d7661-576f-4612-90fc-658017a95aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:55:19.688371 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c36d7661-576f-4612-90fc-658017a95aaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:55:19.698022 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d7661-576f-4612-90fc-658017a95aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:55:19.700028 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d7661-576f-4612-90fc-658017a95aaa service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:55:19.708316 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1437/2872] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:55:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 09 04:55:36.987631 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcbeda-a89c-433c-8c4a-c4976890b122 None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:55:36.988140 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcbeda-a89c-433c-8c4a-c4976890b122 None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:55:36.988249 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcbeda-a89c-433c-8c4a-c4976890b122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:55:37.005849 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-01dcbeda-a89c-433c-8c4a-c4976890b122 None None] MFA Rules not processed for user `83ae0a819660449989b794128ad81503`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:55:37.007046 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-01dcbeda-a89c-433c-8c4a-c4976890b122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:55:37.014943 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1436/2873] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:55:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:55:39.456468 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d7661-576f-4612-90fc-658017a95aaa service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:55:39.465183 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d7661-576f-4612-90fc-658017a95aaa service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:55:39.469037 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22973eea-dc90-45fc-8489-562270bc2cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:55:39.469693 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22973eea-dc90-45fc-8489-562270bc2cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:55:39.469977 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22973eea-dc90-45fc-8489-562270bc2cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:55:39.470255 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22973eea-dc90-45fc-8489-562270bc2cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:55:39.472020 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-22973eea-dc90-45fc-8489-562270bc2cc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:55:39.482251 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22973eea-dc90-45fc-8489-562270bc2cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:55:39.483706 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22973eea-dc90-45fc-8489-562270bc2cc5 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:55:39.492236 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1438/2874] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:55:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:55:56.146216 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcbeda-a89c-433c-8c4a-c4976890b122 None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:55:56.147635 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-01dcbeda-a89c-433c-8c4a-c4976890b122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:55:56.164564 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcbeda-a89c-433c-8c4a-c4976890b122 None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:55:56.170238 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a9843-021f-42e3-835c-50f582d84438 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:55:56.170876 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a9843-021f-42e3-835c-50f582d84438 service nova] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:55:56.171157 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a9843-021f-42e3-835c-50f582d84438 service nova] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:55:56.171433 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a9843-021f-42e3-835c-50f582d84438 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:55:56.173227 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-4f8a9843-021f-42e3-835c-50f582d84438 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:55:56.185146 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a9843-021f-42e3-835c-50f582d84438 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:55:56.186931 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a9843-021f-42e3-835c-50f582d84438 service nova] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:55:56.198120 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1437/2875] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:55:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:57:00.953891 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22973eea-dc90-45fc-8489-562270bc2cc5 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:57:00.971371 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22973eea-dc90-45fc-8489-562270bc2cc5 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:57:00.977260 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a33395-1082-4b26-a86d-160b58b84fe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:57:00.977906 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a33395-1082-4b26-a86d-160b58b84fe9 service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:57:00.978213 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a33395-1082-4b26-a86d-160b58b84fe9 service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:57:00.978607 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a33395-1082-4b26-a86d-160b58b84fe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:57:00.980369 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-08a33395-1082-4b26-a86d-160b58b84fe9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:57:00.994256 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a33395-1082-4b26-a86d-160b58b84fe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:57:00.995838 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a33395-1082-4b26-a86d-160b58b84fe9 service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:57:01.006557 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1439/2876] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:57:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:57:02.327318 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a9843-021f-42e3-835c-50f582d84438 service nova] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:57:02.336529 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a9843-021f-42e3-835c-50f582d84438 service nova] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:57:02.340116 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310c5ee-b3b3-4b8f-8b2e-867f96f9adf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:57:02.340685 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310c5ee-b3b3-4b8f-8b2e-867f96f9adf2 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:57:02.340971 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310c5ee-b3b3-4b8f-8b2e-867f96f9adf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:57:02.341348 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310c5ee-b3b3-4b8f-8b2e-867f96f9adf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:57:02.343669 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7310c5ee-b3b3-4b8f-8b2e-867f96f9adf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:57:02.425464 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310c5ee-b3b3-4b8f-8b2e-867f96f9adf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:57:02.426890 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310c5ee-b3b3-4b8f-8b2e-867f96f9adf2 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:57:02.444597 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1438/2877] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:57:08.528104 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a33395-1082-4b26-a86d-160b58b84fe9 service nova] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:57:08.530943 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-08a33395-1082-4b26-a86d-160b58b84fe9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:57:08.572102 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a33395-1082-4b26-a86d-160b58b84fe9 service nova] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:57:08.576793 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd2e9f-93c8-40da-8a23-db8440c56c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:57:08.578450 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd2e9f-93c8-40da-8a23-db8440c56c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:57:08.578742 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd2e9f-93c8-40da-8a23-db8440c56c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:57:08.579128 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd2e9f-93c8-40da-8a23-db8440c56c60 admin admin] PATH_INFO: `/v3/users/9301ab5eca7a4a978b7b79c0db3632cc` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:57:08.581557 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd2e9f-93c8-40da-8a23-db8440c56c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9301ab5eca7a4a978b7b79c0db3632cc)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:57:08.584523 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd2e9f-93c8-40da-8a23-db8440c56c60 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:57:08.629755 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-27dd2e9f-93c8-40da-8a23-db8440c56c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9301ab5eca7a4a978b7b79c0db3632cc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:57:08.636401 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-27dd2e9f-93c8-40da-8a23-db8440c56c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9301ab5eca7a4a978b7b79c0db3632cc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:57:08.637094 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-27dd2e9f-93c8-40da-8a23-db8440c56c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9301ab5eca7a4a978b7b79c0db3632cc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:57:08.649226 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-27dd2e9f-93c8-40da-8a23-db8440c56c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9301ab5eca7a4a978b7b79c0db3632cc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:57:08.656628 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-27dd2e9f-93c8-40da-8a23-db8440c56c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9301ab5eca7a4a978b7b79c0db3632cc'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:57:08.662255 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1440/2878] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:57:08 2022] DELETE /identity/v3/users/9301ab5eca7a4a978b7b79c0db3632cc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:57:08.827604 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310c5ee-b3b3-4b8f-8b2e-867f96f9adf2 service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:57:08.843448 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310c5ee-b3b3-4b8f-8b2e-867f96f9adf2 service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:57:08.910107 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc1b71-8c07-44a2-a876-72fddb55f1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:57:08.910958 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc1b71-8c07-44a2-a876-72fddb55f1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:57:08.911239 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc1b71-8c07-44a2-a876-72fddb55f1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:57:08.911510 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc1b71-8c07-44a2-a876-72fddb55f1e8 admin admin] PATH_INFO: `/v3/projects/b5754e8f1ef149fc8d9469a1033be25e` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:57:08.912893 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc1b71-8c07-44a2-a876-72fddb55f1e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5754e8f1ef149fc8d9469a1033be25e)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:57:08.914843 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc1b71-8c07-44a2-a876-72fddb55f1e8 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:57:08.959827 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-b0bc1b71-8c07-44a2-a876-72fddb55f1e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5754e8f1ef149fc8d9469a1033be25e', 'request_id': 'req-b0bc1b71-8c07-44a2-a876-72fddb55f1e8'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:57:08.966478 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-b0bc1b71-8c07-44a2-a876-72fddb55f1e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5754e8f1ef149fc8d9469a1033be25e', 'request_id': 'req-b0bc1b71-8c07-44a2-a876-72fddb55f1e8'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:57:08.973084 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-b0bc1b71-8c07-44a2-a876-72fddb55f1e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5754e8f1ef149fc8d9469a1033be25e', 'request_id': 'req-b0bc1b71-8c07-44a2-a876-72fddb55f1e8'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:57:08.982984 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-b0bc1b71-8c07-44a2-a876-72fddb55f1e8 admin admin] The token cache is being invalidate because project b5754e8f1ef149fc8d9469a1033be25e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:57:08.983267 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-b0bc1b71-8c07-44a2-a876-72fddb55f1e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:57:08.983879 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-b0bc1b71-8c07-44a2-a876-72fddb55f1e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:57:08.985419 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1439/2879] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:57:08 2022] DELETE /identity/v3/projects/b5754e8f1ef149fc8d9469a1033be25e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:57:08.989498 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd2e9f-93c8-40da-8a23-db8440c56c60 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:57:08.990946 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-27dd2e9f-93c8-40da-8a23-db8440c56c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:57:09.003661 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd2e9f-93c8-40da-8a23-db8440c56c60 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:57:09.058339 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c162667-d974-4c17-9499-a7e9f8626812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:57:09.059191 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c162667-d974-4c17-9499-a7e9f8626812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:57:09.059476 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c162667-d974-4c17-9499-a7e9f8626812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:57:09.059752 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c162667-d974-4c17-9499-a7e9f8626812 admin admin] PATH_INFO: `/v3/users/67ca02c5cc4b4bbd8519138de72ad581` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:57:09.060938 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c162667-d974-4c17-9499-a7e9f8626812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ca02c5cc4b4bbd8519138de72ad581)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:57:09.063949 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c162667-d974-4c17-9499-a7e9f8626812 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:57:09.106026 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0c162667-d974-4c17-9499-a7e9f8626812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ca02c5cc4b4bbd8519138de72ad581'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:57:09.112530 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0c162667-d974-4c17-9499-a7e9f8626812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ca02c5cc4b4bbd8519138de72ad581'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:57:09.113204 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0c162667-d974-4c17-9499-a7e9f8626812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ca02c5cc4b4bbd8519138de72ad581'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:57:09.124700 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0c162667-d974-4c17-9499-a7e9f8626812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ca02c5cc4b4bbd8519138de72ad581'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:57:09.131403 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-0c162667-d974-4c17-9499-a7e9f8626812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ca02c5cc4b4bbd8519138de72ad581'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:57:09.137419 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1441/2880] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 04:57:08 2022] DELETE /identity/v3/users/67ca02c5cc4b4bbd8519138de72ad581 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:57:09.300824 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc1b71-8c07-44a2-a876-72fddb55f1e8 admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:57:09.302372 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-b0bc1b71-8c07-44a2-a876-72fddb55f1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:57:09.316498 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc1b71-8c07-44a2-a876-72fddb55f1e8 admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:57:09.375091 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af492f7e-52dc-4394-bd42-0da4f3f09654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:57:09.375938 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af492f7e-52dc-4394-bd42-0da4f3f09654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:57:09.376221 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af492f7e-52dc-4394-bd42-0da4f3f09654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:57:09.376494 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af492f7e-52dc-4394-bd42-0da4f3f09654 admin admin] PATH_INFO: `/v3/projects/9879a86bfcc34631aaed0f23fee45cd8` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:57:09.377682 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af492f7e-52dc-4394-bd42-0da4f3f09654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9879a86bfcc34631aaed0f23fee45cd8)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:57:09.379571 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af492f7e-52dc-4394-bd42-0da4f3f09654 admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:57:09.423125 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-af492f7e-52dc-4394-bd42-0da4f3f09654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9879a86bfcc34631aaed0f23fee45cd8', 'request_id': 'req-af492f7e-52dc-4394-bd42-0da4f3f09654'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:57:09.429758 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-af492f7e-52dc-4394-bd42-0da4f3f09654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9879a86bfcc34631aaed0f23fee45cd8', 'request_id': 'req-af492f7e-52dc-4394-bd42-0da4f3f09654'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:57:09.435742 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-af492f7e-52dc-4394-bd42-0da4f3f09654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9879a86bfcc34631aaed0f23fee45cd8', 'request_id': 'req-af492f7e-52dc-4394-bd42-0da4f3f09654'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:57:09.446742 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-af492f7e-52dc-4394-bd42-0da4f3f09654 admin admin] The token cache is being invalidate because project 9879a86bfcc34631aaed0f23fee45cd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 04:57:09.447028 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-af492f7e-52dc-4394-bd42-0da4f3f09654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:57:09.448186 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-af492f7e-52dc-4394-bd42-0da4f3f09654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 04:57:09.449719 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1440/2881] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 04:57:09 2022] DELETE /identity/v3/projects/9879a86bfcc34631aaed0f23fee45cd8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 04:57:58.136695 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c162667-d974-4c17-9499-a7e9f8626812 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:57:58.138279 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-0c162667-d974-4c17-9499-a7e9f8626812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:57:58.212688 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c162667-d974-4c17-9499-a7e9f8626812 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:57:58.260076 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426185c-5ce2-4e27-b4bb-95f1cfb09c8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2856d2356604d8192c8772e33c85d7c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:57:58.260749 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426185c-5ce2-4e27-b4bb-95f1cfb09c8c service cinder] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:57:58.261052 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426185c-5ce2-4e27-b4bb-95f1cfb09c8c service cinder] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:57:58.261332 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426185c-5ce2-4e27-b4bb-95f1cfb09c8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:57:58.266016 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3426185c-5ce2-4e27-b4bb-95f1cfb09c8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:57:58.328327 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426185c-5ce2-4e27-b4bb-95f1cfb09c8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:57:58.329791 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426185c-5ce2-4e27-b4bb-95f1cfb09c8c service cinder] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:57:58.338384 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1442/2882] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:57:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:58:07.235155 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4277e-a571-4804-b0a7-f731d82e8c5a None None] REQUEST_METHOD: `POST` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:58:07.235781 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4277e-a571-4804-b0a7-f731d82e8c5a None None] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:58:07.235781 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4277e-a571-4804-b0a7-f731d82e8c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:58:07.253870 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.auth.core [None req-8ce4277e-a571-4804-b0a7-f731d82e8c5a None None] MFA Rules not processed for user `83ae0a819660449989b794128ad81503`. Rule list: `[]` (Enabled: `True`). {{(pid=79176) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 09 04:58:07.255141 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-8ce4277e-a571-4804-b0a7-f731d82e8c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:58:07.262498 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1441/2883] 10.222.0.36 () {58 vars in 957 bytes} [Wed Feb 9 04:58:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 09 04:58:07.784189 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426185c-5ce2-4e27-b4bb-95f1cfb09c8c service cinder] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:58:07.785657 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-3426185c-5ce2-4e27-b4bb-95f1cfb09c8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:58:07.838666 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426185c-5ce2-4e27-b4bb-95f1cfb09c8c service cinder] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:58:07.842234 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c9ef3-e66c-429f-a0fa-76682da9c03f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:58:07.842867 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c9ef3-e66c-429f-a0fa-76682da9c03f service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:58:07.843151 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c9ef3-e66c-429f-a0fa-76682da9c03f service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:58:07.843429 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c9ef3-e66c-429f-a0fa-76682da9c03f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:58:07.845190 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-4b5c9ef3-e66c-429f-a0fa-76682da9c03f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:58:07.854490 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c9ef3-e66c-429f-a0fa-76682da9c03f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:58:07.855955 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c9ef3-e66c-429f-a0fa-76682da9c03f service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:58:07.864244 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1443/2884] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:58:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:58:10.299808 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4277e-a571-4804-b0a7-f731d82e8c5a None None] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:58:10.301251 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-8ce4277e-a571-4804-b0a7-f731d82e8c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:58:10.368354 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4277e-a571-4804-b0a7-f731d82e8c5a None None] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:58:10.373267 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac8d5b-37fd-4bd3-9226-9ef0587e3ee6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add56fc0cfd8403b86c5ef23fd374a5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:58:10.373904 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac8d5b-37fd-4bd3-9226-9ef0587e3ee6 service placement] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:58:10.374188 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac8d5b-37fd-4bd3-9226-9ef0587e3ee6 service placement] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:58:10.374459 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac8d5b-37fd-4bd3-9226-9ef0587e3ee6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:58:10.376814 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-58ac8d5b-37fd-4bd3-9226-9ef0587e3ee6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:58:10.388548 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac8d5b-37fd-4bd3-9226-9ef0587e3ee6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:58:10.390174 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac8d5b-37fd-4bd3-9226-9ef0587e3ee6 service placement] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:58:10.401175 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1442/2885] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:58:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:58:28.117432 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c9ef3-e66c-429f-a0fa-76682da9c03f service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:58:28.119291 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-4b5c9ef3-e66c-429f-a0fa-76682da9c03f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:58:28.198520 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c9ef3-e66c-429f-a0fa-76682da9c03f service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:58:28.204180 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe639da3-729a-4077-be88-0a6a6780d13f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63fe98c10e974c019e05a2f68d012ba8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:58:28.204829 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe639da3-729a-4077-be88-0a6a6780d13f service nova] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:58:28.205139 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe639da3-729a-4077-be88-0a6a6780d13f service nova] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:58:28.205417 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe639da3-729a-4077-be88-0a6a6780d13f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:58:28.207184 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-fe639da3-729a-4077-be88-0a6a6780d13f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:58:28.222507 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe639da3-729a-4077-be88-0a6a6780d13f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:58:28.223809 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe639da3-729a-4077-be88-0a6a6780d13f service nova] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:58:28.235303 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1444/2886] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:58:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:58:30.400824 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac8d5b-37fd-4bd3-9226-9ef0587e3ee6 service placement] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:58:30.410522 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac8d5b-37fd-4bd3-9226-9ef0587e3ee6 service placement] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:58:30.414072 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febb137-0319-4b9f-af74-ad47b279bae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:58:30.414697 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febb137-0319-4b9f-af74-ad47b279bae6 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:58:30.414984 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febb137-0319-4b9f-af74-ad47b279bae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:58:30.415266 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febb137-0319-4b9f-af74-ad47b279bae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:58:30.417037 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7febb137-0319-4b9f-af74-ad47b279bae6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:58:30.476179 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febb137-0319-4b9f-af74-ad47b279bae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:58:30.477638 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febb137-0319-4b9f-af74-ad47b279bae6 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:58:30.486842 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1443/2887] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:58:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 04:58:34.158063 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe639da3-729a-4077-be88-0a6a6780d13f service nova] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 04:58:34.168857 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe639da3-729a-4077-be88-0a6a6780d13f service nova] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 04:58:34.174646 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c82e2-3f39-4ee2-ab59-f59e81d51e93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add56fc0cfd8403b86c5ef23fd374a5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 04:58:34.175314 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c82e2-3f39-4ee2-ab59-f59e81d51e93 service placement] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 04:58:34.175600 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c82e2-3f39-4ee2-ab59-f59e81d51e93 service placement] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 04:58:34.175877 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c82e2-3f39-4ee2-ab59-f59e81d51e93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 04:58:34.177671 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-c78c82e2-3f39-4ee2-ab59-f59e81d51e93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 04:58:34.189655 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c82e2-3f39-4ee2-ab59-f59e81d51e93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 04:58:34.191294 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c82e2-3f39-4ee2-ab59-f59e81d51e93 service placement] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 04:58:34.201020 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1445/2888] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 04:58:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 05:00:13.762704 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febb137-0319-4b9f-af74-ad47b279bae6 service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 05:00:13.765040 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-7febb137-0319-4b9f-af74-ad47b279bae6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 05:00:13.777461 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febb137-0319-4b9f-af74-ad47b279bae6 service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 05:00:13.781473 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2b7f4-f453-426d-85c4-53f3606a2f00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 05:00:13.782043 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2b7f4-f453-426d-85c4-53f3606a2f00 service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 05:00:13.782321 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2b7f4-f453-426d-85c4-53f3606a2f00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 05:00:13.782594 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2b7f4-f453-426d-85c4-53f3606a2f00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 05:00:13.784940 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-ebe2b7f4-f453-426d-85c4-53f3606a2f00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 05:00:13.798505 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2b7f4-f453-426d-85c4-53f3606a2f00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 05:00:13.800040 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2b7f4-f453-426d-85c4-53f3606a2f00 service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 05:00:13.811607 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1444/2889] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 05:00:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 05:00:15.080708 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c82e2-3f39-4ee2-ab59-f59e81d51e93 service placement] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 05:00:15.090043 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c82e2-3f39-4ee2-ab59-f59e81d51e93 service placement] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 05:00:15.093568 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c8973-4c07-4f1f-aeeb-c67fd0759886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 05:00:15.094201 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c8973-4c07-4f1f-aeeb-c67fd0759886 service neutron] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 05:00:15.094483 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c8973-4c07-4f1f-aeeb-c67fd0759886 service neutron] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 05:00:15.094758 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c8973-4c07-4f1f-aeeb-c67fd0759886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 05:00:15.096531 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a03c8973-4c07-4f1f-aeeb-c67fd0759886 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 05:00:15.109904 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c8973-4c07-4f1f-aeeb-c67fd0759886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 05:00:15.111331 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c8973-4c07-4f1f-aeeb-c67fd0759886 service neutron] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 05:00:15.122249 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1446/2890] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 05:00:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 05:00:26.027748 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2b7f4-f453-426d-85c4-53f3606a2f00 service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 05:00:26.036878 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2b7f4-f453-426d-85c4-53f3606a2f00 service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 05:00:26.040450 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad0db2-7263-49ca-be7e-52b00cf5b42a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80015d086ec24caf9414d2ef5f660f08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 05:00:26.041109 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad0db2-7263-49ca-be7e-52b00cf5b42a service neutron] REQUEST_METHOD: `GET` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 05:00:26.041386 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad0db2-7263-49ca-be7e-52b00cf5b42a service neutron] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 05:00:26.041658 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad0db2-7263-49ca-be7e-52b00cf5b42a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 05:00:26.043400 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-41ad0db2-7263-49ca-be7e-52b00cf5b42a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 05:00:26.104887 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad0db2-7263-49ca-be7e-52b00cf5b42a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 05:00:26.106237 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad0db2-7263-49ca-be7e-52b00cf5b42a service neutron] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 05:00:26.115356 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1445/2891] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 05:00:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 09 05:00:32.395174 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c8973-4c07-4f1f-aeeb-c67fd0759886 service neutron] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 05:00:32.396592 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-a03c8973-4c07-4f1f-aeeb-c67fd0759886 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 05:00:32.411078 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c8973-4c07-4f1f-aeeb-c67fd0759886 service neutron] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 05:00:32.415604 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31001607-a3d5-4554-9a2a-b775dc882fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 05:00:32.416468 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31001607-a3d5-4554-9a2a-b775dc882fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 05:00:32.416745 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31001607-a3d5-4554-9a2a-b775dc882fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 05:00:32.417033 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31001607-a3d5-4554-9a2a-b775dc882fd0 admin admin] PATH_INFO: `/v3/users/83ae0a819660449989b794128ad81503` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 05:00:32.418353 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31001607-a3d5-4554-9a2a-b775dc882fd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83ae0a819660449989b794128ad81503)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 05:00:32.420589 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31001607-a3d5-4554-9a2a-b775dc882fd0 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 05:00:32.468884 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-31001607-a3d5-4554-9a2a-b775dc882fd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83ae0a819660449989b794128ad81503'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 05:00:32.476701 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-31001607-a3d5-4554-9a2a-b775dc882fd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83ae0a819660449989b794128ad81503'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 05:00:32.477493 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-31001607-a3d5-4554-9a2a-b775dc882fd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83ae0a819660449989b794128ad81503'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 05:00:32.490883 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-31001607-a3d5-4554-9a2a-b775dc882fd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83ae0a819660449989b794128ad81503'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 05:00:32.498298 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-31001607-a3d5-4554-9a2a-b775dc882fd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83ae0a819660449989b794128ad81503'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 05:00:32.505620 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1447/2892] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 05:00:32 2022] DELETE /identity/v3/users/83ae0a819660449989b794128ad81503 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 05:00:32.670749 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad0db2-7263-49ca-be7e-52b00cf5b42a service neutron] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 05:00:32.686061 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad0db2-7263-49ca-be7e-52b00cf5b42a service neutron] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 05:00:32.739147 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4996aa-5c3f-4928-8064-599f9412619d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 05:00:32.739987 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4996aa-5c3f-4928-8064-599f9412619d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 05:00:32.740265 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4996aa-5c3f-4928-8064-599f9412619d admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 05:00:32.740531 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4996aa-5c3f-4928-8064-599f9412619d admin admin] PATH_INFO: `/v3/projects/e74b6e2144f542a78fbb5aa5e310fa1f` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 05:00:32.741718 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4996aa-5c3f-4928-8064-599f9412619d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e74b6e2144f542a78fbb5aa5e310fa1f)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 05:00:32.743589 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4996aa-5c3f-4928-8064-599f9412619d admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 05:00:32.787794 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-ab4996aa-5c3f-4928-8064-599f9412619d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e74b6e2144f542a78fbb5aa5e310fa1f', 'request_id': 'req-ab4996aa-5c3f-4928-8064-599f9412619d'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 05:00:32.793968 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-ab4996aa-5c3f-4928-8064-599f9412619d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e74b6e2144f542a78fbb5aa5e310fa1f', 'request_id': 'req-ab4996aa-5c3f-4928-8064-599f9412619d'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 05:00:32.800761 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-ab4996aa-5c3f-4928-8064-599f9412619d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e74b6e2144f542a78fbb5aa5e310fa1f', 'request_id': 'req-ab4996aa-5c3f-4928-8064-599f9412619d'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 05:00:32.810660 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-ab4996aa-5c3f-4928-8064-599f9412619d admin admin] The token cache is being invalidate because project e74b6e2144f542a78fbb5aa5e310fa1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 05:00:32.811019 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-ab4996aa-5c3f-4928-8064-599f9412619d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 05:00:32.811636 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-ab4996aa-5c3f-4928-8064-599f9412619d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 05:00:32.813208 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1446/2893] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 05:00:32 2022] DELETE /identity/v3/projects/e74b6e2144f542a78fbb5aa5e310fa1f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 05:00:32.817818 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31001607-a3d5-4554-9a2a-b775dc882fd0 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 05:00:32.819210 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-31001607-a3d5-4554-9a2a-b775dc882fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 05:00:32.831700 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31001607-a3d5-4554-9a2a-b775dc882fd0 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 05:00:32.884887 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19431477-1afc-4812-9b8f-a570603b57f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 05:00:32.885775 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19431477-1afc-4812-9b8f-a570603b57f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 05:00:32.886058 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19431477-1afc-4812-9b8f-a570603b57f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 05:00:32.886344 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19431477-1afc-4812-9b8f-a570603b57f2 admin admin] PATH_INFO: `/v3/users/c125a17909574c35ae457a895efebfb6` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 05:00:32.887585 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19431477-1afc-4812-9b8f-a570603b57f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c125a17909574c35ae457a895efebfb6)` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 05:00:32.889554 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19431477-1afc-4812-9b8f-a570603b57f2 admin admin] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 05:00:32.937309 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-19431477-1afc-4812-9b8f-a570603b57f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c125a17909574c35ae457a895efebfb6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 05:00:32.952760 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-19431477-1afc-4812-9b8f-a570603b57f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c125a17909574c35ae457a895efebfb6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 05:00:32.953561 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-19431477-1afc-4812-9b8f-a570603b57f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c125a17909574c35ae457a895efebfb6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 05:00:32.968538 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-19431477-1afc-4812-9b8f-a570603b57f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c125a17909574c35ae457a895efebfb6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 05:00:32.977434 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.notifications [None req-19431477-1afc-4812-9b8f-a570603b57f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c125a17909574c35ae457a895efebfb6'} {{(pid=79177) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 05:00:32.984112 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1448/2894] 10.222.0.36 () {58 vars in 1223 bytes} [Wed Feb 9 05:00:32 2022] DELETE /identity/v3/users/c125a17909574c35ae457a895efebfb6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 09 05:00:33.155974 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4996aa-5c3f-4928-8064-599f9412619d admin admin] Authenticating user token {{(pid=79176) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 05:00:33.158085 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.fernet_utils [None req-ab4996aa-5c3f-4928-8064-599f9412619d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79176) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 05:00:33.170465 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4996aa-5c3f-4928-8064-599f9412619d admin admin] Validating token access rules against request {{(pid=79176) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 05:00:33.227408 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70760d1c-5de0-4711-89f8-29d12390fc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '149f2cba29a24507ab7090c3c8fa1691', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '583a6798f0f24da3a88ba3f8de9474df', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79176) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 05:00:33.228237 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70760d1c-5de0-4711-89f8-29d12390fc0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 05:00:33.228519 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70760d1c-5de0-4711-89f8-29d12390fc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 05:00:33.228792 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70760d1c-5de0-4711-89f8-29d12390fc0a admin admin] PATH_INFO: `/v3/projects/b6b8aa1ffe054408b2806635cdb5b511` {{(pid=79176) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 05:00:33.229992 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70760d1c-5de0-4711-89f8-29d12390fc0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6b8aa1ffe054408b2806635cdb5b511)` {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 05:00:33.231872 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70760d1c-5de0-4711-89f8-29d12390fc0a admin admin] RBAC: Authorization granted {{(pid=79176) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 05:00:33.278011 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-70760d1c-5de0-4711-89f8-29d12390fc0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6b8aa1ffe054408b2806635cdb5b511', 'request_id': 'req-70760d1c-5de0-4711-89f8-29d12390fc0a'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 05:00:33.285299 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-70760d1c-5de0-4711-89f8-29d12390fc0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6b8aa1ffe054408b2806635cdb5b511', 'request_id': 'req-70760d1c-5de0-4711-89f8-29d12390fc0a'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 05:00:33.291401 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-70760d1c-5de0-4711-89f8-29d12390fc0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6b8aa1ffe054408b2806635cdb5b511', 'request_id': 'req-70760d1c-5de0-4711-89f8-29d12390fc0a'} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 05:00:33.301348 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-70760d1c-5de0-4711-89f8-29d12390fc0a admin admin] The token cache is being invalidate because project b6b8aa1ffe054408b2806635cdb5b511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79176) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 09 05:00:33.301633 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-70760d1c-5de0-4711-89f8-29d12390fc0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 05:00:33.302259 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: DEBUG keystone.notifications [None req-70760d1c-5de0-4711-89f8-29d12390fc0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79176) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 09 05:00:33.303773 dv-cinder-798783-3-iscsi devstack@keystone.service[79176]: [pid: 79176|app: 0|req: 1447/2895] 10.222.0.36 () {58 vars in 1232 bytes} [Wed Feb 9 05:00:33 2022] DELETE /identity/v3/projects/b6b8aa1ffe054408b2806635cdb5b511 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 09 05:03:39.147766 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19431477-1afc-4812-9b8f-a570603b57f2 admin admin] Authenticating user token {{(pid=79177) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 09 05:03:39.149195 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-19431477-1afc-4812-9b8f-a570603b57f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 05:03:39.280675 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19431477-1afc-4812-9b8f-a570603b57f2 admin admin] Validating token access rules against request {{(pid=79177) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 09 05:03:39.336735 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166135bf-dec1-4767-a439-8d6fea04e448 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'add56fc0cfd8403b86c5ef23fd374a5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e618c4377ec64e2e8a6d332696019fac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79177) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 09 05:03:39.337414 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166135bf-dec1-4767-a439-8d6fea04e448 service placement] REQUEST_METHOD: `GET` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 09 05:03:39.337696 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166135bf-dec1-4767-a439-8d6fea04e448 service placement] SCRIPT_NAME: `/identity` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 09 05:03:39.337972 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166135bf-dec1-4767-a439-8d6fea04e448 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79177) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 09 05:03:39.339825 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.fernet_utils [None req-166135bf-dec1-4767-a439-8d6fea04e448 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79177) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 09 05:03:39.350772 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166135bf-dec1-4767-a439-8d6fea04e448 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 09 05:03:39.352356 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166135bf-dec1-4767-a439-8d6fea04e448 service placement] RBAC: Authorization granted {{(pid=79177) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 09 05:03:39.362378 dv-cinder-798783-3-iscsi devstack@keystone.service[79177]: [pid: 79177|app: 0|req: 1449/2896] 10.222.0.36 () {60 vars in 1365 bytes} [Wed Feb 9 05:03:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)